Oct 30 20:37:02.441346 ip-10-0-138-85 systemd[1]: Starting Kubernetes Kubelet...
Oct 30 20:37:02.825254 ip-10-0-138-85 kubenswrapper[2577]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Oct 30 20:37:02.825254 ip-10-0-138-85 kubenswrapper[2577]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Oct 30 20:37:02.825254 ip-10-0-138-85 kubenswrapper[2577]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Oct 30 20:37:02.825254 ip-10-0-138-85 kubenswrapper[2577]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Oct 30 20:37:02.832116 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.832008    2577 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 30 20:37:02.832116 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.832114    2577 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 30 20:37:02.832116 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.832120    2577 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 30 20:37:02.832116 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.832125    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 30 20:37:02.832390 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.832129    2577 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 30 20:37:02.832390 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.832133    2577 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 30 20:37:02.832390 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.832137    2577 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 30 20:37:02.832390 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.832141    2577 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 30 20:37:02.832390 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.832145    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 30 20:37:02.832390 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.832149    2577 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 30 20:37:02.832390 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.832152    2577 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 30 20:37:02.832390 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.832155    2577 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 30 20:37:02.832390 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.832159    2577 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 30 20:37:02.832390 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.832163    2577 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 30 20:37:02.832390 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.832167    2577 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 30 20:37:02.832390 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.832172    2577 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 30 20:37:02.832390 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.832175    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 30 20:37:02.832390 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.832179    2577 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 30 20:37:02.832390 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.832183    2577 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 30 20:37:02.832390 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.832186    2577 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 30 20:37:02.832390 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.832206    2577 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 30 20:37:02.832390 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.832211    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 30 20:37:02.832390 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.832215    2577 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 30 20:37:02.833177 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.832219    2577 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 30 20:37:02.833177 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.832226    2577 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 30 20:37:02.833177 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.832232    2577 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 30 20:37:02.833177 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.832237    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 30 20:37:02.833177 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.832241    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 30 20:37:02.833177 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.832246    2577 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 30 20:37:02.833177 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.832250    2577 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 30 20:37:02.833177 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.832254    2577 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 30 20:37:02.833177 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.832258    2577 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 30 20:37:02.833177 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.832263    2577 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 30 20:37:02.833177 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.832269    2577 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 30 20:37:02.833177 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.832274    2577 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 30 20:37:02.833177 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.832278    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 30 20:37:02.833177 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.832283    2577 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 30 20:37:02.833177 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.832287    2577 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 30 20:37:02.833177 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.832291    2577 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 30 20:37:02.833177 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.832297    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 30 20:37:02.833177 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.832302    2577 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 30 20:37:02.833177 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.832306    2577 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 30 20:37:02.833861 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.832310    2577 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 30 20:37:02.833861 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.832315    2577 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 30 20:37:02.833861 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.832319    2577 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 30 20:37:02.833861 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.832323    2577 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 30 20:37:02.833861 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.832327    2577 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 30 20:37:02.833861 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.832331    2577 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 30 20:37:02.833861 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.832336    2577 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 30 20:37:02.833861 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.832340    2577 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 30 20:37:02.833861 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.832344    2577 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 30 20:37:02.833861 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.832348    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 30 20:37:02.833861 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.832353    2577 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 30 20:37:02.833861 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.832357    2577 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 30 20:37:02.833861 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.832362    2577 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 30 20:37:02.833861 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.832366    2577 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 30 20:37:02.833861 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.832370    2577 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 30 20:37:02.833861 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.832374    2577 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 30 20:37:02.833861 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.832378    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 30 20:37:02.833861 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.832383    2577 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 30 20:37:02.833861 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.832386    2577 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 30 20:37:02.833861 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.832391    2577 feature_gate.go:386] unrecognized feature gate: Example2
Oct 30 20:37:02.834363 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.832395    2577 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 30 20:37:02.834363 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.832398    2577 feature_gate.go:386] unrecognized feature gate: Example
Oct 30 20:37:02.834363 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.832403    2577 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 30 20:37:02.834363 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.832408    2577 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 30 20:37:02.834363 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.832412    2577 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 30 20:37:02.834363 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.832419    2577 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 30 20:37:02.834363 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.832427    2577 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 30 20:37:02.834363 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.832432    2577 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 30 20:37:02.834363 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.832436    2577 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 30 20:37:02.834363 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.832441    2577 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 30 20:37:02.834363 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.832445    2577 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 30 20:37:02.834363 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.832449    2577 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 30 20:37:02.834363 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.832454    2577 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 30 20:37:02.834363 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.832458    2577 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 30 20:37:02.834363 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.832462    2577 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 30 20:37:02.834363 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.832467    2577 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 30 20:37:02.834363 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.832471    2577 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 30 20:37:02.834363 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.832475    2577 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 30 20:37:02.834363 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.832480    2577 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 30 20:37:02.834851 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.832484    2577 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 30 20:37:02.834851 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.832488    2577 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 30 20:37:02.834851 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.832492    2577 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 30 20:37:02.834851 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.832497    2577 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 30 20:37:02.834851 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.832501    2577 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 30 20:37:02.834851 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.832506    2577 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 30 20:37:02.834851 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.832511    2577 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 30 20:37:02.834851 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.832515    2577 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 30 20:37:02.834851 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.832519    2577 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 30 20:37:02.834851 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.832523    2577 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 30 20:37:02.834851 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.832527    2577 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 30 20:37:02.834851 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.832531    2577 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 30 20:37:02.834851 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.832536    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 30 20:37:02.834851 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.832540    2577 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 30 20:37:02.834851 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.832545    2577 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 30 20:37:02.834851 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.832549    2577 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 30 20:37:02.834851 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.832553    2577 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 30 20:37:02.834851 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.832557    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 30 20:37:02.834851 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.832562    2577 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 30 20:37:02.834851 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.832566    2577 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 30 20:37:02.835343 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.832570    2577 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 30 20:37:02.835343 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.832575    2577 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 30 20:37:02.835343 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.832579    2577 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 30 20:37:02.835343 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.832584    2577 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 30 20:37:02.835343 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.832588    2577 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 30 20:37:02.835343 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.833918    2577 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 30 20:37:02.835343 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.833931    2577 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 30 20:37:02.835343 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.833935    2577 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 30 20:37:02.835343 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.833938    2577 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 30 20:37:02.835343 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.833941    2577 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 30 20:37:02.835343 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.833946    2577 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 30 20:37:02.835343 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.833948    2577 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 30 20:37:02.835343 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.833952    2577 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 30 20:37:02.835343 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.833955    2577 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 30 20:37:02.835343 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.833957    2577 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 30 20:37:02.835343 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.833960    2577 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 30 20:37:02.835343 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.833963    2577 feature_gate.go:386] unrecognized feature gate: Example
Oct 30 20:37:02.835343 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.833966    2577 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 30 20:37:02.835343 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.833968    2577 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 30 20:37:02.835343 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.833971    2577 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 30 20:37:02.835872 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.833973    2577 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 30 20:37:02.835872 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.833976    2577 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 30 20:37:02.835872 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.833979    2577 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 30 20:37:02.835872 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.833981    2577 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 30 20:37:02.835872 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.833984    2577 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 30 20:37:02.835872 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.833986    2577 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 30 20:37:02.835872 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.833989    2577 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 30 20:37:02.835872 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.833991    2577 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 30 20:37:02.835872 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.833994    2577 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 30 20:37:02.835872 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.833997    2577 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 30 20:37:02.835872 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.834000    2577 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 30 20:37:02.835872 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.834002    2577 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 30 20:37:02.835872 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.834005    2577 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 30 20:37:02.835872 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.834007    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 30 20:37:02.835872 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.834010    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 30 20:37:02.835872 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.834013    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 30 20:37:02.835872 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.834016    2577 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 30 20:37:02.835872 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.834019    2577 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 30 20:37:02.835872 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.834022    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 30 20:37:02.835872 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.834024    2577 feature_gate.go:386] unrecognized feature gate: Example2
Oct 30 20:37:02.836373 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.834027    2577 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 30 20:37:02.836373 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.834030    2577 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 30 20:37:02.836373 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.834032    2577 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 30 20:37:02.836373 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.834034    2577 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 30 20:37:02.836373 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.834037    2577 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 30 20:37:02.836373 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.834040    2577 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 30 20:37:02.836373 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.834042    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 30 20:37:02.836373 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.834044    2577 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 30 20:37:02.836373 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.834059    2577 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 30 20:37:02.836373 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.834062    2577 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 30 20:37:02.836373 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.834065    2577 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 30 20:37:02.836373 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.834067    2577 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 30 20:37:02.836373 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.834070    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 30 20:37:02.836373 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.834073    2577 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 30 20:37:02.836373 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.834075    2577 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 30 20:37:02.836373 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.834078    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 30 20:37:02.836373 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.834081    2577 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 30 20:37:02.836373 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.834083    2577 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 30 20:37:02.836373 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.834086    2577 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 30 20:37:02.836373 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.834088    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 30 20:37:02.836872 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.834091    2577 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 30 20:37:02.836872 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.834094    2577 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 30 20:37:02.836872 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.834097    2577 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 30 20:37:02.836872 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.834100    2577 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 30 20:37:02.836872 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.834102    2577 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 30 20:37:02.836872 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.834105    2577 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 30 20:37:02.836872 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.834107    2577 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 30 20:37:02.836872 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.834110    2577 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 30 20:37:02.836872 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.834112    2577 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 30 20:37:02.836872 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.834116    2577 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 30 20:37:02.836872 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.834119    2577 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 30 20:37:02.836872 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.834122    2577 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 30 20:37:02.836872 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.834125    2577 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 30 20:37:02.836872 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.834127    2577 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 30 20:37:02.836872 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.834130    2577 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 30 20:37:02.836872 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.834132    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 30 20:37:02.836872 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.834135    2577 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 30 20:37:02.836872 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.834138    2577 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 30 20:37:02.836872 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.834140    2577 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 30 20:37:02.836872 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.834142    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 30 20:37:02.837456 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.834145    2577 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 30 20:37:02.837456 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.834148    2577 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 30 20:37:02.837456 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.834150    2577 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 30 20:37:02.837456 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.834153    2577 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 30 20:37:02.837456 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.834155    2577 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 30 20:37:02.837456 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.834159    2577 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 30 20:37:02.837456 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.834162    2577 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 30 20:37:02.837456 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.834164    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 30 20:37:02.837456 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.834166    2577 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 30 20:37:02.837456 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.834169    2577 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 30 20:37:02.837456 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.834173    2577 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 30 20:37:02.837456 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.834177    2577 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 30 20:37:02.837456 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.834180    2577 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 30 20:37:02.837456 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.834183    2577 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 30 20:37:02.837456 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.834186    2577 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 30 20:37:02.837456 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.834189    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 30 20:37:02.837456 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.834191    2577 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 30 20:37:02.837456 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.834194    2577 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 30 20:37:02.837888 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.834198    2577 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 30 20:37:02.837888 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.834202    2577 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 30 20:37:02.837888 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.834206    2577 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 30 20:37:02.837888 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.834211    2577 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 30 20:37:02.837888 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.834214    2577 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 30 20:37:02.837888 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.834217    2577 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 30 20:37:02.837888 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.834219    2577 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 30 20:37:02.837888 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.834222    2577 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 30 20:37:02.837888 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.834224    2577 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 30 20:37:02.837888 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.834228    2577 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 30 20:37:02.837888 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.834231    2577 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 30 20:37:02.837888 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.834234    2577 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 30 20:37:02.837888 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.834236    2577 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 30 20:37:02.837888 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.834829    2577 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 30 20:37:02.837888 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.834835    2577 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 30 20:37:02.837888 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.834838    2577 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 30 20:37:02.837888 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.834840    2577 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 30 20:37:02.837888 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.834843    2577 feature_gate.go:386] unrecognized feature gate: Example2
Oct 30 20:37:02.837888 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.834846    2577 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 30 20:37:02.838374 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.834849    2577 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 30 20:37:02.838374 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.834852    2577 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 30 20:37:02.838374 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.834855    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 30 20:37:02.838374 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.834864    2577 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 30 20:37:02.838374 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.834867    2577 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 30 20:37:02.838374 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.834869    2577 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 30 20:37:02.838374 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.834872    2577 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 30 20:37:02.838374 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.834875    2577 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 30 20:37:02.838374 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.834877    2577 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 30 20:37:02.838374 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.834880    2577 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 30 20:37:02.838374 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.834889    2577 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 30 20:37:02.838374 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.834891    2577 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 30 20:37:02.838374 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.834894    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 30 20:37:02.838374 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.834897    2577 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 30 20:37:02.838374 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.834900    2577 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 30 20:37:02.838374 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.834902    2577 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 30 20:37:02.838374 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.834905    2577 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 30 20:37:02.838374 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.834908    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 30 20:37:02.838374 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.834911    2577 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 30 20:37:02.838995 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.834913    2577 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 30 20:37:02.838995 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.834916    2577 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 30 20:37:02.838995 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.834918    2577 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 30 20:37:02.838995 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.834921    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 30 20:37:02.838995 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.834923    2577 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 30 20:37:02.838995 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.834926    2577 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 30 20:37:02.838995 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.834928    2577 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 30 20:37:02.838995 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.834931    2577 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 30 20:37:02.838995 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.834933    2577 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 30 20:37:02.838995 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.834936    2577 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 30 20:37:02.838995 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.834938    2577 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 30 20:37:02.838995 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.834941    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 30 20:37:02.838995 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.834943    2577 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 30 20:37:02.838995 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.834946    2577 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 30 20:37:02.838995 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.834948    2577 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 30 20:37:02.838995 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.834952    2577 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 30 20:37:02.838995 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.834956    2577 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 30 20:37:02.838995 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.834958    2577 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 30 20:37:02.838995 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.834961    2577 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 30 20:37:02.839719 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.834964    2577 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 30 20:37:02.839719 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.834967    2577 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 30 20:37:02.839719 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.834969    2577 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 30 20:37:02.839719 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.834972    2577 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 30 20:37:02.839719 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.834975    2577 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 30 20:37:02.839719 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.834984    2577 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 30 20:37:02.839719 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.834986    2577 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 30 20:37:02.839719 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.834989    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 30 20:37:02.839719 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.834992    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 30 20:37:02.839719 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.834994    2577 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 30 20:37:02.839719 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.834997    2577 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 30 20:37:02.839719 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.835000    2577 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 30 20:37:02.839719 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.835002    2577 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 30 20:37:02.839719 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.835005    2577 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 30 20:37:02.839719 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.835008    2577 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 30 20:37:02.839719 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.835010    2577 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 30 20:37:02.839719 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.835013    2577 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 30 20:37:02.839719 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.835015    2577 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 30 20:37:02.839719 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.835018    2577 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 30 20:37:02.839719 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.835020    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 30 20:37:02.840208 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.835023    2577 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 30 20:37:02.840208 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.835026    2577 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 30 20:37:02.840208 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.835028    2577 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 30 20:37:02.840208 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.835031    2577 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 30 20:37:02.840208 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.835033    2577 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 30 20:37:02.840208 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.835038    2577 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 30 20:37:02.840208 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.835041    2577 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 30 20:37:02.840208 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.835043    2577 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 30 20:37:02.840208 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.835059    2577 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 30 20:37:02.840208 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.835061    2577 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 30 20:37:02.840208 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.835064    2577 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 30 20:37:02.840208 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.835067    2577 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 30 20:37:02.840208 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.835070    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 30 20:37:02.840208 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.835072    2577 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 30 20:37:02.840208 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.835075    2577 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 30 20:37:02.840208 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.835077    2577 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 30 20:37:02.840208 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.835080    2577 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 30 20:37:02.840208 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.835083    2577 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 30 20:37:02.840208 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.835091    2577 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 30 20:37:02.840208 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.835094    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 30 20:37:02.840680 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.835097    2577 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 30 20:37:02.840680 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.835099    2577 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 30 20:37:02.840680 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.835102    2577 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 30 20:37:02.840680 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.835105    2577 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 30 20:37:02.840680 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.835107    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 30 20:37:02.840680 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.835109    2577 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 30 20:37:02.840680 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.835112    2577 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 30 20:37:02.840680 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.835116    2577 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 30 20:37:02.840680 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.835119    2577 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 30 20:37:02.840680 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.835122    2577 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 30 20:37:02.840680 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.835125    2577 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 30 20:37:02.840680 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.835127    2577 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 30 20:37:02.840680 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.835129    2577 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 30 20:37:02.840680 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.835132    2577 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 30 20:37:02.840680 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.835134    2577 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 30 20:37:02.840680 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.835137    2577 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 30 20:37:02.840680 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.835140    2577 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 30 20:37:02.840680 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.835146    2577 feature_gate.go:386] unrecognized feature gate: Example
Oct 30 20:37:02.840680 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.835148    2577 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 30 20:37:02.840680 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.835152    2577 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 30 20:37:02.841172 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.835155    2577 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 30 20:37:02.841172 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.835157    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 30 20:37:02.841172 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:02.838368    2577 flags.go:64] FLAG: --address="0.0.0.0"
Oct 30 20:37:02.841172 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:02.838380    2577 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Oct 30 20:37:02.841172 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:02.838390    2577 flags.go:64] FLAG: --anonymous-auth="true"
Oct 30 20:37:02.841172 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:02.838395    2577 flags.go:64] FLAG: --application-metrics-count-limit="100"
Oct 30 20:37:02.841172 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:02.838400    2577 flags.go:64] FLAG: --authentication-token-webhook="false"
Oct 30 20:37:02.841172 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:02.838403    2577 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Oct 30 20:37:02.841172 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:02.838408    2577 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Oct 30 20:37:02.841172 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:02.838412    2577 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Oct 30 20:37:02.841172 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:02.838415    2577 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Oct 30 20:37:02.841172 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:02.838427    2577 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Oct 30 20:37:02.841172 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:02.838431    2577 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Oct 30 20:37:02.841172 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:02.838434    2577 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Oct 30 20:37:02.841172 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:02.838438    2577 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Oct 30 20:37:02.841172 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:02.838441    2577 flags.go:64] FLAG: --cgroup-root=""
Oct 30 20:37:02.841172 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:02.838444    2577 flags.go:64] FLAG: --cgroups-per-qos="true"
Oct 30 20:37:02.841172 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:02.838447    2577 flags.go:64] FLAG: --client-ca-file=""
Oct 30 20:37:02.841172 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:02.838450    2577 flags.go:64] FLAG: --cloud-provider="external"
Oct 30 20:37:02.841172 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:02.838453    2577 flags.go:64] FLAG: --cluster-dns="[]"
Oct 30 20:37:02.841172 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:02.838461    2577 flags.go:64] FLAG: --cluster-domain=""
Oct 30 20:37:02.841172 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:02.838464    2577 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Oct 30 20:37:02.841172 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:02.838467    2577 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Oct 30 20:37:02.841713 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:02.838470    2577 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Oct 30 20:37:02.841713 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:02.838473    2577 flags.go:64] FLAG: --container-log-max-files="5"
Oct 30 20:37:02.841713 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:02.838478    2577 flags.go:64] FLAG: --container-log-max-size="10Mi"
Oct 30 20:37:02.841713 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:02.838481    2577 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Oct 30 20:37:02.841713 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:02.838484    2577 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Oct 30 20:37:02.841713 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:02.838487    2577 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Oct 30 20:37:02.841713 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:02.838491    2577 flags.go:64] FLAG: --contention-profiling="false"
Oct 30 20:37:02.841713 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:02.838494    2577 flags.go:64] FLAG: --cpu-cfs-quota="true"
Oct 30 20:37:02.841713 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:02.838497    2577 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Oct 30 20:37:02.841713 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:02.838500    2577 flags.go:64] FLAG: --cpu-manager-policy="none"
Oct 30 20:37:02.841713 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:02.838503    2577 flags.go:64] FLAG: --cpu-manager-policy-options=""
Oct 30 20:37:02.841713 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:02.838508    2577 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Oct 30 20:37:02.841713 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:02.838512    2577 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Oct 30 20:37:02.841713 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:02.838732    2577 flags.go:64] FLAG: --enable-debugging-handlers="true"
Oct 30 20:37:02.841713 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:02.838773    2577 flags.go:64] FLAG: --enable-load-reader="false"
Oct 30 20:37:02.841713 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:02.838780    2577 flags.go:64] FLAG: --enable-server="true"
Oct 30 20:37:02.841713 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:02.838786    2577 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Oct 30 20:37:02.841713 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:02.838807    2577 flags.go:64] FLAG: --event-burst="100"
Oct 30 20:37:02.841713 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:02.838812    2577 flags.go:64] FLAG: --event-qps="50"
Oct 30 20:37:02.841713 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:02.838817    2577 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Oct 30 20:37:02.841713 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:02.838823    2577 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Oct 30 20:37:02.841713 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:02.838853    2577 flags.go:64] FLAG: --eviction-hard=""
Oct 30 20:37:02.841713 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:02.838867    2577 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Oct 30 20:37:02.841713 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:02.838871    2577 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Oct 30 20:37:02.842348 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:02.838876    2577 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Oct 30 20:37:02.842348 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:02.838881    2577 flags.go:64] FLAG: --eviction-soft=""
Oct 30 20:37:02.842348 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:02.838886    2577 flags.go:64] FLAG: --eviction-soft-grace-period=""
Oct 30 20:37:02.842348 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:02.838891    2577 flags.go:64] FLAG: --exit-on-lock-contention="false"
Oct 30 20:37:02.842348 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:02.838896    2577 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Oct 30 20:37:02.842348 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:02.838900    2577 flags.go:64] FLAG: --experimental-mounter-path=""
Oct 30 20:37:02.842348 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:02.838909    2577 flags.go:64] FLAG: --fail-cgroupv1="true"
Oct 30 20:37:02.842348 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:02.838914    2577 flags.go:64] FLAG: --fail-swap-on="true"
Oct 30 20:37:02.842348 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:02.838919    2577 flags.go:64] FLAG: --feature-gates=""
Oct 30 20:37:02.842348 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:02.838926    2577 flags.go:64] FLAG: --file-check-frequency="20s"
Oct 30 20:37:02.842348 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:02.838931    2577 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Oct 30 20:37:02.842348 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:02.838936    2577 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Oct 30 20:37:02.842348 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:02.838941    2577 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Oct 30 20:37:02.842348 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:02.838946    2577 flags.go:64] FLAG: --healthz-port="10248"
Oct 30 20:37:02.842348 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:02.838956    2577 flags.go:64] FLAG: --help="false"
Oct 30 20:37:02.842348 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:02.838961    2577 flags.go:64] FLAG: --hostname-override="ip-10-0-138-85.us-west-1.compute.internal"
Oct 30 20:37:02.842348 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:02.838966    2577 flags.go:64] FLAG: --housekeeping-interval="10s"
Oct 30 20:37:02.842348 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:02.838971    2577 flags.go:64] FLAG: --http-check-frequency="20s"
Oct 30 20:37:02.842348 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:02.838976    2577 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Oct 30 20:37:02.842348 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:02.838982    2577 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Oct 30 20:37:02.842348 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:02.838988    2577 flags.go:64] FLAG: --image-gc-high-threshold="85"
Oct 30 20:37:02.842348 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:02.838992    2577 flags.go:64] FLAG: --image-gc-low-threshold="80"
Oct 30 20:37:02.842348 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:02.838997    2577 flags.go:64] FLAG: --image-service-endpoint=""
Oct 30 20:37:02.842880 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:02.839006    2577 flags.go:64] FLAG: --kernel-memcg-notification="false"
Oct 30 20:37:02.842880 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:02.839012    2577 flags.go:64] FLAG: --kube-api-burst="100"
Oct 30 20:37:02.842880 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:02.839017    2577 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Oct 30 20:37:02.842880 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:02.839022    2577 flags.go:64] FLAG: --kube-api-qps="50"
Oct 30 20:37:02.842880 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:02.839026    2577 flags.go:64] FLAG: --kube-reserved=""
Oct 30 20:37:02.842880 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:02.839031    2577 flags.go:64] FLAG: --kube-reserved-cgroup=""
Oct 30 20:37:02.842880 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:02.839036    2577 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Oct 30 20:37:02.842880 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:02.839081    2577 flags.go:64] FLAG: --kubelet-cgroups=""
Oct 30 20:37:02.842880 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:02.839091    2577 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Oct 30 20:37:02.842880 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:02.839096    2577 flags.go:64] FLAG: --lock-file=""
Oct 30 20:37:02.842880 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:02.839100    2577 flags.go:64] FLAG: --log-cadvisor-usage="false"
Oct 30 20:37:02.842880 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:02.839105    2577 flags.go:64] FLAG: --log-flush-frequency="5s"
Oct 30 20:37:02.842880 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:02.839110    2577 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Oct 30 20:37:02.842880 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:02.839119    2577 flags.go:64] FLAG: --log-json-split-stream="false"
Oct 30 20:37:02.842880 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:02.839124    2577 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Oct 30 20:37:02.842880 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:02.839129    2577 flags.go:64] FLAG: --log-text-split-stream="false"
Oct 30 20:37:02.842880 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:02.839134    2577 flags.go:64] FLAG: --logging-format="text"
Oct 30 20:37:02.842880 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:02.839143    2577 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Oct 30 20:37:02.842880 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:02.839148    2577 flags.go:64] FLAG: --make-iptables-util-chains="true"
Oct 30 20:37:02.842880 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:02.839153    2577 flags.go:64] FLAG: --manifest-url=""
Oct 30 20:37:02.842880 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:02.839158    2577 flags.go:64] FLAG: --manifest-url-header=""
Oct 30 20:37:02.842880 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:02.839165    2577 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Oct 30 20:37:02.842880 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:02.839170    2577 flags.go:64] FLAG: --max-open-files="1000000"
Oct 30 20:37:02.842880 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:02.839177    2577 flags.go:64] FLAG: --max-pods="110"
Oct 30 20:37:02.842880 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:02.839182    2577 flags.go:64] FLAG: --maximum-dead-containers="-1"
Oct 30 20:37:02.843494 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:02.839191    2577 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Oct 30 20:37:02.843494 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:02.839196    2577 flags.go:64] FLAG: --memory-manager-policy="None"
Oct 30 20:37:02.843494 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:02.839201    2577 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Oct 30 20:37:02.843494 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:02.839206    2577 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Oct 30 20:37:02.843494 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:02.839210    2577 flags.go:64] FLAG: --node-ip="0.0.0.0"
Oct 30 20:37:02.843494 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:02.839216    2577 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Oct 30 20:37:02.843494 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:02.839242    2577 flags.go:64] FLAG: --node-status-max-images="50"
Oct 30 20:37:02.843494 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:02.839253    2577 flags.go:64] FLAG: --node-status-update-frequency="10s"
Oct 30 20:37:02.843494 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:02.839258    2577 flags.go:64] FLAG: --oom-score-adj="-999"
Oct 30 20:37:02.843494 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:02.839263    2577 flags.go:64] FLAG: --pod-cidr=""
Oct 30 20:37:02.843494 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:02.839267    2577 flags.go:64] FLAG: --pod-manifest-path=""
Oct 30 20:37:02.843494 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:02.839272    2577 flags.go:64] FLAG: --pod-max-pids="-1"
Oct 30 20:37:02.843494 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:02.839277    2577 flags.go:64] FLAG: --pods-per-core="0"
Oct 30 20:37:02.843494 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:02.839281    2577 flags.go:64] FLAG: --port="10250"
Oct 30 20:37:02.843494 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:02.839286    2577 flags.go:64] FLAG: --protect-kernel-defaults="false"
Oct 30 20:37:02.843494 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:02.839317    2577 flags.go:64] FLAG: --provider-id="aws:///us-west-1a/i-0628b1f1e57a8dbfd"
Oct 30 20:37:02.843494 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:02.839328    2577 flags.go:64] FLAG: --qos-reserved=""
Oct 30 20:37:02.843494 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:02.839333    2577 flags.go:64] FLAG: --read-only-port="10255"
Oct 30 20:37:02.843494 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:02.839338    2577 flags.go:64] FLAG: --register-node="true"
Oct 30 20:37:02.843494 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:02.839342    2577 flags.go:64] FLAG: --register-with-taints=""
Oct 30 20:37:02.843494 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:02.839349    2577 flags.go:64] FLAG: --registry-burst="10"
Oct 30 20:37:02.843494 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:02.839354    2577 flags.go:64] FLAG: --registry-qps="5"
Oct 30 20:37:02.843494 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:02.839358    2577 flags.go:64] FLAG: --reserved-cpus=""
Oct 30 20:37:02.843494 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:02.839363    2577 flags.go:64] FLAG: --reserved-memory=""
Oct 30 20:37:02.843494 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:02.839373    2577 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Oct 30 20:37:02.843494 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:02.839379    2577 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Oct 30 20:37:02.844124 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:02.839383    2577 flags.go:64] FLAG: --rotate-certificates="false"
Oct 30 20:37:02.844124 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:02.839388    2577 flags.go:64] FLAG: --rotate-server-certificates="false"
Oct 30 20:37:02.844124 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:02.839393    2577 flags.go:64] FLAG: --runonce="false"
Oct 30 20:37:02.844124 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:02.839398    2577 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Oct 30 20:37:02.844124 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:02.839403    2577 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Oct 30 20:37:02.844124 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:02.839407    2577 flags.go:64] FLAG: --seccomp-default="false"
Oct 30 20:37:02.844124 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:02.839412    2577 flags.go:64] FLAG: --serialize-image-pulls="true"
Oct 30 20:37:02.844124 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:02.839421    2577 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Oct 30 20:37:02.844124 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:02.839432    2577 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Oct 30 20:37:02.844124 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:02.839437    2577 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Oct 30 20:37:02.844124 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:02.839442    2577 flags.go:64] FLAG: --storage-driver-password="root"
Oct 30 20:37:02.844124 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:02.839446    2577 flags.go:64] FLAG: --storage-driver-secure="false"
Oct 30 20:37:02.844124 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:02.839451    2577 flags.go:64] FLAG: --storage-driver-table="stats"
Oct 30 20:37:02.844124 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:02.839456    2577 flags.go:64] FLAG: --storage-driver-user="root"
Oct 30 20:37:02.844124 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:02.839460    2577 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Oct 30 20:37:02.844124 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:02.839470    2577 flags.go:64] FLAG: --sync-frequency="1m0s"
Oct 30 20:37:02.844124 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:02.839475    2577 flags.go:64] FLAG: --system-cgroups=""
Oct 30 20:37:02.844124 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:02.839479    2577 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Oct 30 20:37:02.844124 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:02.839489    2577 flags.go:64] FLAG: --system-reserved-cgroup=""
Oct 30 20:37:02.844124 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:02.839493    2577 flags.go:64] FLAG: --tls-cert-file=""
Oct 30 20:37:02.844124 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:02.839497    2577 flags.go:64] FLAG: --tls-cipher-suites="[]"
Oct 30 20:37:02.844124 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:02.839518    2577 flags.go:64] FLAG: --tls-min-version=""
Oct 30 20:37:02.844124 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:02.839554    2577 flags.go:64] FLAG: --tls-private-key-file=""
Oct 30 20:37:02.844124 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:02.839560    2577 flags.go:64] FLAG: --topology-manager-policy="none"
Oct 30 20:37:02.844124 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:02.839565    2577 flags.go:64] FLAG: --topology-manager-policy-options=""
Oct 30 20:37:02.844703 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:02.839570    2577 flags.go:64] FLAG: --topology-manager-scope="container"
Oct 30 20:37:02.844703 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:02.839575    2577 flags.go:64] FLAG: --v="2"
Oct 30 20:37:02.844703 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:02.839588    2577 flags.go:64] FLAG: --version="false"
Oct 30 20:37:02.844703 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:02.839608    2577 flags.go:64] FLAG: --vmodule=""
Oct 30 20:37:02.844703 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:02.839659    2577 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Oct 30 20:37:02.844703 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:02.839667    2577 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Oct 30 20:37:02.844703 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.839964    2577 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 30 20:37:02.844703 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.839973    2577 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 30 20:37:02.844703 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.839976    2577 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 30 20:37:02.844703 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.839979    2577 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 30 20:37:02.844703 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.839982    2577 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 30 20:37:02.844703 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.839985    2577 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 30 20:37:02.844703 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.839987    2577 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 30 20:37:02.844703 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.839990    2577 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 30 20:37:02.844703 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.839993    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 30 20:37:02.844703 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.839995    2577 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 30 20:37:02.844703 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.839998    2577 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 30 20:37:02.844703 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.840001    2577 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 30 20:37:02.844703 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.840004    2577 feature_gate.go:386] unrecognized feature gate: Example2
Oct 30 20:37:02.844703 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.840006    2577 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 30 20:37:02.844703 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.840009    2577 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 30 20:37:02.845229 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.840012    2577 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 30 20:37:02.845229 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.840015    2577 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 30 20:37:02.845229 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.840018    2577 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 30 20:37:02.845229 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.840021    2577 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 30 20:37:02.845229 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.840024    2577 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 30 20:37:02.845229 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.840026    2577 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 30 20:37:02.845229 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.840029    2577 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 30 20:37:02.845229 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.840031    2577 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 30 20:37:02.845229 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.840034    2577 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 30 20:37:02.845229 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.840037    2577 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 30 20:37:02.845229 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.840040    2577 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 30 20:37:02.845229 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.840042    2577 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 30 20:37:02.845229 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.840045    2577 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 30 20:37:02.845229 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.840059    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 30 20:37:02.845229 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.840062    2577 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 30 20:37:02.845229 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.840066    2577 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 30 20:37:02.845229 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.840069    2577 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 30 20:37:02.845229 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.840072    2577 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 30 20:37:02.845229 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.840075    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 30 20:37:02.845674 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.840078    2577 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 30 20:37:02.845674 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.840081    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 30 20:37:02.845674 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.840084    2577 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 30 20:37:02.845674 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.840086    2577 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 30 20:37:02.845674 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.840089    2577 feature_gate.go:386] unrecognized feature gate: Example
Oct 30 20:37:02.845674 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.840092    2577 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 30 20:37:02.845674 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.840094    2577 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 30 20:37:02.845674 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.840097    2577 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 30 20:37:02.845674 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.840099    2577 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 30 20:37:02.845674 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.840102    2577 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 30 20:37:02.845674 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.840104    2577 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 30 20:37:02.845674 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.840107    2577 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 30 20:37:02.845674 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.840110    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 30 20:37:02.845674 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.840112    2577 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 30 20:37:02.845674 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.840115    2577 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 30 20:37:02.845674 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.840118    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 30 20:37:02.845674 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.840121    2577 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 30 20:37:02.845674 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.840124    2577 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 30 20:37:02.845674 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.840127    2577 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 30 20:37:02.845674 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.840129    2577 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 30 20:37:02.846243 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.840132    2577 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 30 20:37:02.846243 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.840134    2577 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 30 20:37:02.846243 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.840137    2577 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 30 20:37:02.846243 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.840139    2577 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 30 20:37:02.846243 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.840142    2577 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 30 20:37:02.846243 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.840145    2577 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 30 20:37:02.846243 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.840147    2577 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 30 20:37:02.846243 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.840150    2577 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 30 20:37:02.846243 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.840155    2577 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 30 20:37:02.846243 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.840157    2577 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 30 20:37:02.846243 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.840160    2577 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 30 20:37:02.846243 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.840163    2577 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 30 20:37:02.846243 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.840165    2577 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 30 20:37:02.846243 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.840168    2577 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 30 20:37:02.846243 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.840171    2577 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 30 20:37:02.846243 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.840174    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 30 20:37:02.846243 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.840176    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 30 20:37:02.846243 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.840179    2577 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 30 20:37:02.846243 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.840182    2577 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 30 20:37:02.846719 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.840186    2577 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 30 20:37:02.846719 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.840190    2577 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 30 20:37:02.846719 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.840193    2577 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 30 20:37:02.846719 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.840196    2577 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 30 20:37:02.846719 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.840199    2577 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 30 20:37:02.846719 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.840203    2577 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 30 20:37:02.846719 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.840206    2577 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 30 20:37:02.846719 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.840208    2577 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 30 20:37:02.846719 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.840212    2577 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 30 20:37:02.846719 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.840214    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 30 20:37:02.846719 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.840218    2577 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 30 20:37:02.846719 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.840221    2577 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 30 20:37:02.846719 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.840225    2577 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 30 20:37:02.846719 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.840229    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 30 20:37:02.846719 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.840232    2577 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 30 20:37:02.846719 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.840236    2577 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 30 20:37:02.846719 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.840238    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 30 20:37:02.846719 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.840241    2577 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 30 20:37:02.846719 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.840244    2577 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 30 20:37:02.847195 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.840247    2577 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 30 20:37:02.847195 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.840250    2577 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 30 20:37:02.847195 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.840253    2577 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 30 20:37:02.847195 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.840256    2577 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 30 20:37:02.847195 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.840259    2577 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 30 20:37:02.847195 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.840261    2577 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 30 20:37:02.847195 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.840264    2577 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 30 20:37:02.847195 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.840267    2577 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 30 20:37:02.847195 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.840269    2577 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 30 20:37:02.847195 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.840272    2577 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 30 20:37:02.847195 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.840275    2577 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 30 20:37:02.847195 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.840277    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 30 20:37:02.847195 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.840280    2577 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 30 20:37:02.847195 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.840282    2577 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 30 20:37:02.847195 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:02.840315    2577 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]}
Oct 30 20:37:02.847195 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.840359    2577 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 30 20:37:02.847585 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.840363    2577 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 30 20:37:02.847585 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.840366    2577 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 30 20:37:02.847585 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.840369    2577 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 30 20:37:02.847585 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.840371    2577 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 30 20:37:02.847585 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.840374    2577 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 30 20:37:02.847585 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.840377    2577 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 30 20:37:02.847585 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.840379    2577 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 30 20:37:02.847585 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.840382    2577 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 30 20:37:02.847585 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.840385    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 30 20:37:02.847585 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.840387    2577 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 30 20:37:02.847585 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.840390    2577 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 30 20:37:02.847585 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.840393    2577 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 30 20:37:02.847585 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.840395    2577 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 30 20:37:02.847585 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.840398    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 30 20:37:02.847585 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.840401    2577 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 30 20:37:02.847585 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.840403    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 30 20:37:02.847585 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.840406    2577 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 30 20:37:02.847585 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.840409    2577 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 30 20:37:02.847585 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.840411    2577 feature_gate.go:386] unrecognized feature gate: Example
Oct 30 20:37:02.848039 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.840414    2577 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 30 20:37:02.848039 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.840417    2577 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 30 20:37:02.848039 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.840420    2577 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 30 20:37:02.848039 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.840422    2577 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 30 20:37:02.848039 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.840425    2577 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 30 20:37:02.848039 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.840429    2577 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 30 20:37:02.848039 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.840431    2577 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 30 20:37:02.848039 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.840434    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 30 20:37:02.848039 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.840436    2577 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 30 20:37:02.848039 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.840439    2577 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 30 20:37:02.848039 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.840441    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 30 20:37:02.848039 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.840444    2577 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 30 20:37:02.848039 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.840446    2577 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 30 20:37:02.848039 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.840449    2577 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 30 20:37:02.848039 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.840451    2577 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 30 20:37:02.848039 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.840454    2577 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 30 20:37:02.848039 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.840456    2577 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 30 20:37:02.848039 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.840459    2577 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 30 20:37:02.848039 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.840462    2577 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 30 20:37:02.848039 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.840464    2577 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 30 20:37:02.848531 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.840467    2577 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 30 20:37:02.848531 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.840469    2577 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 30 20:37:02.848531 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.840472    2577 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 30 20:37:02.848531 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.840475    2577 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 30 20:37:02.848531 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.840477    2577 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 30 20:37:02.848531 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.840480    2577 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 30 20:37:02.848531 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.840482    2577 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 30 20:37:02.848531 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.840485    2577 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 30 20:37:02.848531 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.840488    2577 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 30 20:37:02.848531 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.840490    2577 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 30 20:37:02.848531 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.840493    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 30 20:37:02.848531 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.840496    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 30 20:37:02.848531 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.840500    2577 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 30 20:37:02.848531 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.840503    2577 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 30 20:37:02.848531 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.840507    2577 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 30 20:37:02.848531 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.840510    2577 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 30 20:37:02.848531 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.840514    2577 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 30 20:37:02.848531 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.840516    2577 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 30 20:37:02.848531 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.840520    2577 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 30 20:37:02.848974 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.840522    2577 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 30 20:37:02.848974 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.840525    2577 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 30 20:37:02.848974 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.840528    2577 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 30 20:37:02.848974 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.840530    2577 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 30 20:37:02.848974 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.840533    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 30 20:37:02.848974 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.840536    2577 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 30 20:37:02.848974 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.840539    2577 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 30 20:37:02.848974 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.840543    2577 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 30 20:37:02.848974 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.840547    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 30 20:37:02.848974 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.840550    2577 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 30 20:37:02.848974 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.840553    2577 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 30 20:37:02.848974 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.840556    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 30 20:37:02.848974 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.840559    2577 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 30 20:37:02.848974 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.840562    2577 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 30 20:37:02.848974 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.840564    2577 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 30 20:37:02.848974 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.840567    2577 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 30 20:37:02.848974 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.840570    2577 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 30 20:37:02.848974 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.840572    2577 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 30 20:37:02.848974 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.840575    2577 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 30 20:37:02.849436 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.840577    2577 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 30 20:37:02.849436 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.840580    2577 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 30 20:37:02.849436 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.840582    2577 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 30 20:37:02.849436 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.840585    2577 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 30 20:37:02.849436 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.840588    2577 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 30 20:37:02.849436 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.840591    2577 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 30 20:37:02.849436 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.840595    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 30 20:37:02.849436 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.840598    2577 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 30 20:37:02.849436 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.840600    2577 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 30 20:37:02.849436 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.840603    2577 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 30 20:37:02.849436 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.840606    2577 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 30 20:37:02.849436 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.840608    2577 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 30 20:37:02.849436 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.840611    2577 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 30 20:37:02.849436 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.840614    2577 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 30 20:37:02.849436 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.840616    2577 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 30 20:37:02.849436 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.840619    2577 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 30 20:37:02.849436 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.840621    2577 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 30 20:37:02.849436 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.840624    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 30 20:37:02.849436 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.840627    2577 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 30 20:37:02.849436 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.840629    2577 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 30 20:37:02.849911 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.840632    2577 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 30 20:37:02.849911 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.840634    2577 feature_gate.go:386] unrecognized feature gate: Example2
Oct 30 20:37:02.849911 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.840637    2577 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 30 20:37:02.849911 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.840639    2577 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 30 20:37:02.849911 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.840642    2577 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 30 20:37:02.849911 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.840645    2577 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 30 20:37:02.849911 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.840647    2577 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 30 20:37:02.849911 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.840650    2577 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 30 20:37:02.849911 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:02.847921    2577 server.go:525] "Kubelet version" kubeletVersion="v1.35.9"
Oct 30 20:37:02.849911 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:02.847935    2577 server.go:527] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Oct 30 20:37:02.849911 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:02.847955    2577 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Oct 30 20:37:02.849911 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:02.847960    2577 watchdog_linux.go:138] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Oct 30 20:37:02.849911 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.848017    2577 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 30 20:37:02.849911 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.848022    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 30 20:37:02.849911 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.848025    2577 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 30 20:37:02.849911 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.848028    2577 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 30 20:37:02.849911 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.848031    2577 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 30 20:37:02.849911 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.848034    2577 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 30 20:37:02.849911 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.848036    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 30 20:37:02.850372 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.848039    2577 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 30 20:37:02.850372 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.848042    2577 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 30 20:37:02.850372 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.848060    2577 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 30 20:37:02.850372 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.848064    2577 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 30 20:37:02.850372 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.848067    2577 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 30 20:37:02.850372 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.848070    2577 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 30 20:37:02.850372 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.848073    2577 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 30 20:37:02.850372 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.848075    2577 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 30 20:37:02.850372 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.848078    2577 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 30 20:37:02.850372 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.848081    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 30 20:37:02.850372 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.848083    2577 feature_gate.go:386] unrecognized feature gate: Example2
Oct 30 20:37:02.850372 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.848086    2577 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 30 20:37:02.850372 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.848088    2577 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 30 20:37:02.850372 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.848091    2577 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 30 20:37:02.850372 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.848094    2577 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 30 20:37:02.850372 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.848096    2577 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 30 20:37:02.850372 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.848099    2577 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 30 20:37:02.850372 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.848101    2577 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 30 20:37:02.850372 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.848104    2577 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 30 20:37:02.850372 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.848107    2577 feature_gate.go:386] unrecognized feature gate: Example
Oct 30 20:37:02.850827 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.848109    2577 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 30 20:37:02.850827 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.848112    2577 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 30 20:37:02.850827 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.848120    2577 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 30 20:37:02.850827 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.848125    2577 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 30 20:37:02.850827 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.848129    2577 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 30 20:37:02.850827 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.848132    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 30 20:37:02.850827 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.848135    2577 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 30 20:37:02.850827 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.848138    2577 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 30 20:37:02.850827 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.848140    2577 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 30 20:37:02.850827 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.848143    2577 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 30 20:37:02.850827 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.848146    2577 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 30 20:37:02.850827 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.848148    2577 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 30 20:37:02.850827 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.848151    2577 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 30 20:37:02.850827 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.848154    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 30 20:37:02.850827 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.848156    2577 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 30 20:37:02.850827 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.848159    2577 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 30 20:37:02.850827 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.848162    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 30 20:37:02.850827 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.848165    2577 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 30 20:37:02.850827 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.848167    2577 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 30 20:37:02.851295 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.848170    2577 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 30 20:37:02.851295 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.848172    2577 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 30 20:37:02.851295 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.848175    2577 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 30 20:37:02.851295 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.848178    2577 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 30 20:37:02.851295 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.848181    2577 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 30 20:37:02.851295 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.848183    2577 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 30 20:37:02.851295 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.848186    2577 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 30 20:37:02.851295 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.848188    2577 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 30 20:37:02.851295 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.848191    2577 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 30 20:37:02.851295 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.848194    2577 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 30 20:37:02.851295 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.848196    2577 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 30 20:37:02.851295 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.848199    2577 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 30 20:37:02.851295 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.848202    2577 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 30 20:37:02.851295 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.848204    2577 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 30 20:37:02.851295 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.848207    2577 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 30 20:37:02.851295 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.848210    2577 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 30 20:37:02.851295 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.848214    2577 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 30 20:37:02.851295 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.848217    2577 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 30 20:37:02.851295 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.848219    2577 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 30 20:37:02.851787 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.848222    2577 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 30 20:37:02.851787 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.848225    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 30 20:37:02.851787 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.848227    2577 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 30 20:37:02.851787 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.848230    2577 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 30 20:37:02.851787 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.848232    2577 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 30 20:37:02.851787 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.848235    2577 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 30 20:37:02.851787 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.848237    2577 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 30 20:37:02.851787 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.848240    2577 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 30 20:37:02.851787 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.848243    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 30 20:37:02.851787 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.848245    2577 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 30 20:37:02.851787 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.848248    2577 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 30 20:37:02.851787 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.848250    2577 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 30 20:37:02.851787 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.848253    2577 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 30 20:37:02.851787 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.848256    2577 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 30 20:37:02.851787 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.848258    2577 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 30 20:37:02.851787 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.848261    2577 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 30 20:37:02.851787 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.848263    2577 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 30 20:37:02.851787 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.848266    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 30 20:37:02.851787 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.848268    2577 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 30 20:37:02.852259 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.848271    2577 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 30 20:37:02.852259 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.848273    2577 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 30 20:37:02.852259 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.848276    2577 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 30 20:37:02.852259 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.848278    2577 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 30 20:37:02.852259 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.848281    2577 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 30 20:37:02.852259 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.848284    2577 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 30 20:37:02.852259 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.848286    2577 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 30 20:37:02.852259 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.848289    2577 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 30 20:37:02.852259 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.848291    2577 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 30 20:37:02.852259 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.848294    2577 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 30 20:37:02.852259 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.848296    2577 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 30 20:37:02.852259 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.848299    2577 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 30 20:37:02.852259 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.848302    2577 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 30 20:37:02.852259 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.848305    2577 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 30 20:37:02.852259 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.848307    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 30 20:37:02.852259 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.848310    2577 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 30 20:37:02.852259 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.848312    2577 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 30 20:37:02.852259 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.848316    2577 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 30 20:37:02.852259 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.848320    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 30 20:37:02.852702 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.848322    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 30 20:37:02.852702 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.848325    2577 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 30 20:37:02.852702 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.848328    2577 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 30 20:37:02.852702 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:02.848357    2577 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]}
Oct 30 20:37:02.852702 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.848505    2577 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 30 20:37:02.852702 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.848511    2577 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 30 20:37:02.852702 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.848514    2577 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 30 20:37:02.852702 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.848517    2577 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 30 20:37:02.852702 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.848520    2577 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 30 20:37:02.852702 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.848523    2577 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 30 20:37:02.852702 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.848526    2577 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 30 20:37:02.852702 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.848528    2577 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 30 20:37:02.852702 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.848531    2577 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 30 20:37:02.852702 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.848534    2577 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 30 20:37:02.852702 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.848536    2577 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 30 20:37:02.852702 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.848539    2577 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 30 20:37:02.853092 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.848542    2577 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 30 20:37:02.853092 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.848545    2577 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 30 20:37:02.853092 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.848548    2577 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 30 20:37:02.853092 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.848551    2577 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 30 20:37:02.853092 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.848554    2577 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 30 20:37:02.853092 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.848556    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 30 20:37:02.853092 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.848559    2577 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 30 20:37:02.853092 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.848563    2577 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 30 20:37:02.853092 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.848566    2577 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 30 20:37:02.853092 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.848570    2577 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 30 20:37:02.853092 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.848573    2577 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 30 20:37:02.853092 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.848576    2577 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 30 20:37:02.853092 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.848579    2577 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 30 20:37:02.853092 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.848582    2577 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 30 20:37:02.853092 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.848584    2577 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 30 20:37:02.853092 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.848587    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 30 20:37:02.853092 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.848590    2577 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 30 20:37:02.853092 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.848592    2577 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 30 20:37:02.853092 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.848595    2577 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 30 20:37:02.853572 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.848598    2577 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 30 20:37:02.853572 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.848600    2577 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 30 20:37:02.853572 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.848604    2577 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 30 20:37:02.853572 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.848607    2577 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 30 20:37:02.853572 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.848609    2577 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 30 20:37:02.853572 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.848612    2577 feature_gate.go:386] unrecognized feature gate: Example
Oct 30 20:37:02.853572 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.848614    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 30 20:37:02.853572 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.848617    2577 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 30 20:37:02.853572 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.848620    2577 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 30 20:37:02.853572 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.848623    2577 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 30 20:37:02.853572 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.848625    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 30 20:37:02.853572 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.848628    2577 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 30 20:37:02.853572 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.848630    2577 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 30 20:37:02.853572 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.848633    2577 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 30 20:37:02.853572 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.848635    2577 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 30 20:37:02.853572 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.848638    2577 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 30 20:37:02.853572 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.848640    2577 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 30 20:37:02.853572 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.848643    2577 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 30 20:37:02.853572 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.848645    2577 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 30 20:37:02.853572 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.848648    2577 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 30 20:37:02.854042 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.848650    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 30 20:37:02.854042 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.848653    2577 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 30 20:37:02.854042 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.848655    2577 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 30 20:37:02.854042 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.848658    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 30 20:37:02.854042 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.848661    2577 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 30 20:37:02.854042 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.848664    2577 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 30 20:37:02.854042 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.848666    2577 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 30 20:37:02.854042 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.848669    2577 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 30 20:37:02.854042 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.848671    2577 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 30 20:37:02.854042 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.848674    2577 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 30 20:37:02.854042 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.848676    2577 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 30 20:37:02.854042 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.848679    2577 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 30 20:37:02.854042 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.848681    2577 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 30 20:37:02.854042 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.848684    2577 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 30 20:37:02.854042 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.848687    2577 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 30 20:37:02.854042 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.848689    2577 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 30 20:37:02.854042 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.848692    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 30 20:37:02.854042 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.848696    2577 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 30 20:37:02.854042 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.848699    2577 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 30 20:37:02.854600 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.848702    2577 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 30 20:37:02.854600 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.848705    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 30 20:37:02.854600 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.848708    2577 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 30 20:37:02.854600 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.848711    2577 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 30 20:37:02.854600 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.848713    2577 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 30 20:37:02.854600 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.848716    2577 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 30 20:37:02.854600 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.848719    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 30 20:37:02.854600 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.848721    2577 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 30 20:37:02.854600 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.848724    2577 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 30 20:37:02.854600 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.848726    2577 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 30 20:37:02.854600 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.848729    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 30 20:37:02.854600 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.848731    2577 feature_gate.go:386] unrecognized feature gate: Example2
Oct 30 20:37:02.854600 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.848734    2577 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 30 20:37:02.854600 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.848736    2577 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 30 20:37:02.854600 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.848739    2577 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 30 20:37:02.854600 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.848741    2577 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 30 20:37:02.854600 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.848744    2577 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 30 20:37:02.854600 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.848747    2577 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 30 20:37:02.854600 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.848750    2577 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 30 20:37:02.855035 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.848752    2577 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 30 20:37:02.855035 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.848755    2577 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 30 20:37:02.855035 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.848757    2577 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 30 20:37:02.855035 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.848760    2577 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 30 20:37:02.855035 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.848762    2577 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 30 20:37:02.855035 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.848765    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 30 20:37:02.855035 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.848767    2577 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 30 20:37:02.855035 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.848770    2577 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 30 20:37:02.855035 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.848772    2577 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 30 20:37:02.855035 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.848775    2577 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 30 20:37:02.855035 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.848777    2577 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 30 20:37:02.855035 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.848780    2577 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 30 20:37:02.855035 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.848782    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 30 20:37:02.855035 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.848785    2577 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 30 20:37:02.855035 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.848788    2577 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 30 20:37:02.855035 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.848790    2577 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 30 20:37:02.855035 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.848793    2577 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 30 20:37:02.855447 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:02.848816    2577 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]}
Oct 30 20:37:02.855447 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.848851    2577 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 30 20:37:02.855447 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.848855    2577 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 30 20:37:02.855447 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.848858    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 30 20:37:02.855447 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.848862    2577 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 30 20:37:02.855447 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.848866    2577 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 30 20:37:02.855447 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.848870    2577 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 30 20:37:02.855447 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.848872    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 30 20:37:02.855447 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.848875    2577 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 30 20:37:02.855447 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.848877    2577 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 30 20:37:02.855447 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.848880    2577 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 30 20:37:02.855447 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.848883    2577 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 30 20:37:02.855447 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.848885    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 30 20:37:02.855447 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.848888    2577 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 30 20:37:02.855447 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.848891    2577 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 30 20:37:02.855793 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.848894    2577 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 30 20:37:02.855793 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.848897    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 30 20:37:02.855793 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.848903    2577 feature_gate.go:386] unrecognized feature gate: Example2
Oct 30 20:37:02.855793 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.848906    2577 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 30 20:37:02.855793 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.848908    2577 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 30 20:37:02.855793 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.848911    2577 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 30 20:37:02.855793 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.848914    2577 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 30 20:37:02.855793 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.848917    2577 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 30 20:37:02.855793 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.848920    2577 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 30 20:37:02.855793 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.848922    2577 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 30 20:37:02.855793 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.848925    2577 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 30 20:37:02.855793 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.848927    2577 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 30 20:37:02.855793 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.848930    2577 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 30 20:37:02.855793 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.848933    2577 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 30 20:37:02.855793 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.848935    2577 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 30 20:37:02.855793 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.848938    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 30 20:37:02.855793 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.848940    2577 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 30 20:37:02.855793 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.848943    2577 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 30 20:37:02.855793 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.848946    2577 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 30 20:37:02.856299 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.848948    2577 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 30 20:37:02.856299 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.848951    2577 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 30 20:37:02.856299 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.848953    2577 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 30 20:37:02.856299 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.848956    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 30 20:37:02.856299 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.848959    2577 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 30 20:37:02.856299 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.848961    2577 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 30 20:37:02.856299 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.848964    2577 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 30 20:37:02.856299 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.848966    2577 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 30 20:37:02.856299 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.848969    2577 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 30 20:37:02.856299 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.848972    2577 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 30 20:37:02.856299 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.848974    2577 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 30 20:37:02.856299 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.848977    2577 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 30 20:37:02.856299 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.848980    2577 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 30 20:37:02.856299 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.848984    2577 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 30 20:37:02.856299 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.848987    2577 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 30 20:37:02.856299 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.848991    2577 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 30 20:37:02.856299 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.848994    2577 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 30 20:37:02.856299 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.848996    2577 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 30 20:37:02.856299 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.848999    2577 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 30 20:37:02.856299 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.849002    2577 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 30 20:37:02.856785 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.849004    2577 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 30 20:37:02.856785 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.849007    2577 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 30 20:37:02.856785 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.849010    2577 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 30 20:37:02.856785 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.849013    2577 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 30 20:37:02.856785 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.849016    2577 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 30 20:37:02.856785 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.849019    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 30 20:37:02.856785 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.849021    2577 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 30 20:37:02.856785 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.849025    2577 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 30 20:37:02.856785 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.849028    2577 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 30 20:37:02.856785 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.849031    2577 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 30 20:37:02.856785 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.849034    2577 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 30 20:37:02.856785 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.849036    2577 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 30 20:37:02.856785 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.849039    2577 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 30 20:37:02.856785 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.849042    2577 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 30 20:37:02.856785 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.849044    2577 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 30 20:37:02.856785 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.849063    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 30 20:37:02.856785 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.849068    2577 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 30 20:37:02.856785 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.849071    2577 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 30 20:37:02.856785 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.849074    2577 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 30 20:37:02.857227 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.849076    2577 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 30 20:37:02.857227 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.849079    2577 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 30 20:37:02.857227 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.849082    2577 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 30 20:37:02.857227 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.849085    2577 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 30 20:37:02.857227 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.849087    2577 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 30 20:37:02.857227 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.849091    2577 feature_gate.go:386] unrecognized feature gate: Example
Oct 30 20:37:02.857227 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.849094    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 30 20:37:02.857227 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.849097    2577 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 30 20:37:02.857227 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.849101    2577 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 30 20:37:02.857227 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.849104    2577 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 30 20:37:02.857227 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.849107    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 30 20:37:02.857227 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.849109    2577 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 30 20:37:02.857227 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.849112    2577 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 30 20:37:02.857227 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.849114    2577 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 30 20:37:02.857227 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.849117    2577 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 30 20:37:02.857227 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.849120    2577 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 30 20:37:02.857227 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.849122    2577 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 30 20:37:02.857227 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.849125    2577 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 30 20:37:02.857227 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.849128    2577 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 30 20:37:02.857227 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.849130    2577 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 30 20:37:02.858391 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.849133    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 30 20:37:02.858391 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.849136    2577 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 30 20:37:02.858391 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.849138    2577 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 30 20:37:02.858391 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.849141    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 30 20:37:02.858391 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.849143    2577 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 30 20:37:02.858391 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.849147    2577 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 30 20:37:02.858391 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.849150    2577 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 30 20:37:02.858391 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.849152    2577 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 30 20:37:02.858391 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.849155    2577 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 30 20:37:02.858391 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.849157    2577 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 30 20:37:02.858391 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.849160    2577 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 30 20:37:02.858391 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.849162    2577 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 30 20:37:02.858391 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.849165    2577 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 30 20:37:02.858391 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:02.849167    2577 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 30 20:37:02.858391 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:02.849231    2577 server.go:957] "Client rotation is on, will bootstrap in background"
Oct 30 20:37:02.858391 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:02.853085    2577 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Oct 30 20:37:02.858391 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:02.854096    2577 server.go:1014] "Starting client certificate rotation"
Oct 30 20:37:02.858391 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:02.854192    2577 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Oct 30 20:37:02.858391 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:02.854218    2577 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Oct 30 20:37:02.858861 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:02.856020    2577 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Oct 30 20:37:02.859073 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:02.859041    2577 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Oct 30 20:37:02.870009 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:02.869800    2577 log.go:25] "Validated CRI v1 runtime API"
Oct 30 20:37:02.873859 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:02.873842    2577 log.go:25] "Validated CRI v1 image API"
Oct 30 20:37:02.874617 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:02.874584    2577 server.go:1424] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Oct 30 20:37:02.877425 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:02.877406    2577 fs.go:135] Filesystem UUIDs: map[115fb574-e3e5-444a-a567-d8172141dbde:/dev/nvme0n1p4 2ebbd8e8-a9f6-4fa0-a75c-89c745e108b7:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2]
Oct 30 20:37:02.877477 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:02.877426    2577 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:24 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:26 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:32 fsType:tmpfs blockSize:0} composefs_0-34:{mountpoint:/ major:0 minor:34 fsType:overlay blockSize:0}]
Oct 30 20:37:02.882397 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:02.882286    2577 manager.go:217] Machine: {Timestamp:2026-10-30 20:37:02.881164471 +0000 UTC m=+0.327959917 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3099161 MemoryCapacity:33164341248 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec249774129e9f58503a43148f81e109 SystemUUID:ec249774-129e-9f58-503a-43148f81e109 BootID:6a45faa9-a6bf-45fc-9942-079f160db608 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:24 Capacity:16582168576 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:26 Capacity:6632869888 Type:vfs Inodes:819200 HasInodes:true} {Device:composefs_0-34 DeviceMajor:0 DeviceMinor:34 Capacity:6422528 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:32 Capacity:16582172672 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:3f:b8:00:75:6d Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:3f:b8:00:75:6d Speed:0 Mtu:9001} {Name:ovs-system MacAddress:b6:b6:f9:d9:b7:db Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164341248 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Oct 30 20:37:02.882397 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:02.882395    2577 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Oct 30 20:37:02.882520 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:02.882505    2577 manager.go:233] Version: {KernelVersion:5.14.0-687.60.1.el9_8.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.8.20261023-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Oct 30 20:37:02.884973 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:02.884944    2577 container_manager_linux.go:275] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Oct 30 20:37:02.885119 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:02.884974    2577 container_manager_linux.go:280] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-138-85.us-west-1.compute.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"/system.slice","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{},"system-reserved-compressible":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Oct 30 20:37:02.885162 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:02.885122    2577 topology_manager.go:143] "Creating topology manager with none policy"
Oct 30 20:37:02.885162 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:02.885129    2577 container_manager_linux.go:311] "Creating device plugin manager"
Oct 30 20:37:02.885211 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:02.885170    2577 manager.go:144] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Oct 30 20:37:02.885211 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:02.885189    2577 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Oct 30 20:37:02.886006 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:02.885997    2577 container_manager_linux.go:320] "Creating Dynamic Resource Allocation (DRA) manager"
Oct 30 20:37:02.889824 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:02.889812    2577 state_mem.go:41] "Initialized" logger="CPUManager state memory"
Oct 30 20:37:02.889949 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:02.889940    2577 server.go:1235] "Using root directory" path="/var/lib/kubelet"
Oct 30 20:37:02.890541 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:02.890531    2577 kubelet.go:493] "Attempting to sync node with API server"
Oct 30 20:37:02.890575 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:02.890545    2577 kubelet.go:394] "Adding static pod path" path="/etc/kubernetes/manifests"
Oct 30 20:37:02.890575 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:02.890556    2577 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Oct 30 20:37:02.890575 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:02.890564    2577 kubelet.go:405] "Adding apiserver pod source"
Oct 30 20:37:02.890575 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:02.890575    2577 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Oct 30 20:37:02.890947 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:02.890934    2577 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Oct 30 20:37:02.894254 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:02.894236    2577 kuberuntime_manager.go:304] "Container runtime initialized" containerRuntime="cri-o" version="1.35.10-3.rhaos4.22.git9383502.el9" apiVersion="v1"
Oct 30 20:37:02.898919 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:02.898906    2577 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Oct 30 20:37:02.899811 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:02.899799    2577 kubelet.go:963] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Oct 30 20:37:02.899849 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:02.899829    2577 kubelet.go:990] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Oct 30 20:37:02.899983 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:02.899971    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Oct 30 20:37:02.900017 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:02.899987    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Oct 30 20:37:02.900017 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:02.899994    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Oct 30 20:37:02.900017 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:02.900000    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Oct 30 20:37:02.900017 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:02.900005    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Oct 30 20:37:02.900017 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:02.900011    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Oct 30 20:37:02.900630 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:02.900621    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Oct 30 20:37:02.900665 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:02.900631    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Oct 30 20:37:02.900665 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:02.900639    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Oct 30 20:37:02.900665 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:02.900644    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Oct 30 20:37:02.900665 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:02.900653    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Oct 30 20:37:02.900665 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:02.900661    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Oct 30 20:37:02.901880 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:02.901870    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Oct 30 20:37:02.901880 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:02.901879    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Oct 30 20:37:02.905524 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:02.905509    2577 server.go:1263] "Started kubelet"
Oct 30 20:37:02.905613 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:02.905570    2577 server.go:182] "Starting to listen" address="0.0.0.0" port=10250
Oct 30 20:37:02.905900 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:02.905815    2577 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Oct 30 20:37:02.905983 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:02.905920    2577 server_v1.go:49] "podresources" method="list" useActivePods=true
Oct 30 20:37:02.906353 ip-10-0-138-85 systemd[1]: Started Kubernetes Kubelet.
Oct 30 20:37:02.909688 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:02.908619    2577 server.go:317] "Adding debug handlers to kubelet server"
Oct 30 20:37:02.911017 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:02.910996    2577 server.go:254] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Oct 30 20:37:02.913023 ip-10-0-138-85 kubenswrapper[2577]: E1030 20:37:02.912991    2577 kubelet.go:1679] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Oct 30 20:37:02.916384 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:02.916367    2577 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Oct 30 20:37:02.917320 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:02.917306    2577 fs_resource_analyzer.go:69] "Starting FS ResourceAnalyzer"
Oct 30 20:37:02.917439 ip-10-0-138-85 kubenswrapper[2577]: E1030 20:37:02.917416    2577 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-138-85.us-west-1.compute.internal\" not found"
Oct 30 20:37:02.917905 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:02.917889    2577 volume_manager.go:309] "The desired_state_of_world populator starts"
Oct 30 20:37:02.917905 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:02.917906    2577 volume_manager.go:311] "Starting Kubelet Volume Manager"
Oct 30 20:37:02.918026 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:02.917888    2577 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Oct 30 20:37:02.918107 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:02.918085    2577 reconstruct.go:97] "Volume reconstruction finished"
Oct 30 20:37:02.918107 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:02.918094    2577 reconciler.go:29] "Reconciler: start to sync state"
Oct 30 20:37:02.918239 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:02.918220    2577 factory.go:55] Registering systemd factory
Oct 30 20:37:02.918239 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:02.918241    2577 factory.go:223] Registration of the systemd container factory successfully
Oct 30 20:37:02.918609 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:02.918493    2577 factory.go:153] Registering CRI-O factory
Oct 30 20:37:02.918609 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:02.918507    2577 factory.go:223] Registration of the crio container factory successfully
Oct 30 20:37:02.918609 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:02.918569    2577 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Oct 30 20:37:02.918609 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:02.918588    2577 factory.go:103] Registering Raw factory
Oct 30 20:37:02.918609 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:02.918602    2577 manager.go:1199] Started watching for new ooms in manager
Oct 30 20:37:02.919762 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:02.919746    2577 manager.go:319] Starting recovery of all containers
Oct 30 20:37:02.930730 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:02.930713    2577 manager.go:324] Recovery completed
Oct 30 20:37:02.934745 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:02.934728    2577 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Oct 30 20:37:02.936472 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:02.936454    2577 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-138-85.us-west-1.compute.internal" event="NodeHasSufficientMemory"
Oct 30 20:37:02.936549 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:02.936488    2577 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-138-85.us-west-1.compute.internal" event="NodeHasNoDiskPressure"
Oct 30 20:37:02.936549 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:02.936504    2577 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-138-85.us-west-1.compute.internal" event="NodeHasSufficientPID"
Oct 30 20:37:02.937032 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:02.937018    2577 cpu_manager.go:226] "Starting" policy="none"
Oct 30 20:37:02.937113 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:02.937032    2577 cpu_manager.go:227] "Reconciling" reconcilePeriod="10s"
Oct 30 20:37:02.937113 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:02.937025    2577 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Oct 30 20:37:02.937192 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:02.937067    2577 state_mem.go:41] "Initialized" logger="CPUManager state checkpoint.CPUManager state memory"
Oct 30 20:37:02.937938 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:02.937923    2577 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-138-85.us-west-1.compute.internal" event="NodeHasSufficientMemory"
Oct 30 20:37:02.937991 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:02.937955    2577 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-138-85.us-west-1.compute.internal" event="NodeHasNoDiskPressure"
Oct 30 20:37:02.937991 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:02.937978    2577 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-138-85.us-west-1.compute.internal" event="NodeHasSufficientPID"
Oct 30 20:37:02.939408 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:02.939396    2577 policy_none.go:50] "Start"
Oct 30 20:37:02.939461 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:02.939412    2577 memory_manager.go:187] "Starting memorymanager" policy="None"
Oct 30 20:37:02.939461 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:02.939423    2577 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Oct 30 20:37:02.941408 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:02.941393    2577 policy_none.go:44] "Start"
Oct 30 20:37:03.018519 ip-10-0-138-85 kubenswrapper[2577]: E1030 20:37:03.017820    2577 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-138-85.us-west-1.compute.internal\" not found"
Oct 30 20:37:03.042877 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:03.042838    2577 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Oct 30 20:37:03.043987 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:03.043964    2577 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Oct 30 20:37:03.043987 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:03.043987    2577 status_manager.go:249] "Starting to sync pod status with apiserver"
Oct 30 20:37:03.044139 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:03.044006    2577 kubelet.go:2521] "Starting kubelet main sync loop"
Oct 30 20:37:03.044139 ip-10-0-138-85 kubenswrapper[2577]: E1030 20:37:03.044035    2577 kubelet.go:2545] "Skipping pod synchronization" err="[container runtime status check may not have completed yet, PLEG is not healthy: pleg has yet to be successful]"
Oct 30 20:37:03.045903 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:03.045873    2577 node_container_manager_linux.go:130] "Enforcing system reserved compressible on cgroup" cgroupName="/system.slice" limits={"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"}
Oct 30 20:37:03.049852 ip-10-0-138-85 kubenswrapper[2577]: E1030 20:37:03.049816    2577 controller.go:201] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-138-85.us-west-1.compute.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Oct 30 20:37:03.050406 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:03.050392    2577 manager.go:341] "Starting Device Plugin manager"
Oct 30 20:37:03.050501 ip-10-0-138-85 kubenswrapper[2577]: E1030 20:37:03.050421    2577 manager.go:525] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Oct 30 20:37:03.050501 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:03.050430    2577 server.go:87] "Starting device plugin registration server"
Oct 30 20:37:03.050665 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:03.050653    2577 eviction_manager.go:194] "Eviction manager: starting control loop"
Oct 30 20:37:03.050707 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:03.050668    2577 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Oct 30 20:37:03.050877 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:03.050777    2577 plugin_watcher.go:53] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Oct 30 20:37:03.050877 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:03.050856    2577 plugin_manager.go:119] "The desired_state_of_world populator (plugin watcher) starts"
Oct 30 20:37:03.050877 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:03.050867    2577 plugin_manager.go:121] "Starting Kubelet Plugin Manager"
Oct 30 20:37:03.051074 ip-10-0-138-85 kubenswrapper[2577]: E1030 20:37:03.049820    2577 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-138-85.us-west-1.compute.internal.18e36916b7165850  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-138-85.us-west-1.compute.internal,UID:,APIVersion:v1,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-138-85.us-west-1.compute.internal,},FirstTimestamp:2026-10-30 20:37:02.905481296 +0000 UTC m=+0.352276736,LastTimestamp:2026-10-30 20:37:02.905481296 +0000 UTC m=+0.352276736,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-138-85.us-west-1.compute.internal,}"
Oct 30 20:37:03.051394 ip-10-0-138-85 kubenswrapper[2577]: E1030 20:37:03.051373    2577 eviction_manager.go:272] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Oct 30 20:37:03.051486 ip-10-0-138-85 kubenswrapper[2577]: E1030 20:37:03.051434    2577 eviction_manager.go:297] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-138-85.us-west-1.compute.internal\" not found"
Oct 30 20:37:03.098100 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:03.098009    2577 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-138-85.us-west-1.compute.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Oct 30 20:37:03.128630 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:03.128599    2577 reflector.go:446] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Oct 30 20:37:03.128765 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:03.128674    2577 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-kqf4t"
Oct 30 20:37:03.144736 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:03.144709    2577 kubelet.go:2608] "SyncLoop ADD" source="file" pods=["kube-system/kube-apiserver-proxy-ip-10-0-138-85.us-west-1.compute.internal","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-85.us-west-1.compute.internal"]
Oct 30 20:37:03.144840 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:03.144767    2577 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Oct 30 20:37:03.145682 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:03.145665    2577 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-138-85.us-west-1.compute.internal" event="NodeHasSufficientMemory"
Oct 30 20:37:03.145765 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:03.145699    2577 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-138-85.us-west-1.compute.internal" event="NodeHasNoDiskPressure"
Oct 30 20:37:03.145765 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:03.145714    2577 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-138-85.us-west-1.compute.internal" event="NodeHasSufficientPID"
Oct 30 20:37:03.147958 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:03.147946    2577 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Oct 30 20:37:03.148130 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:03.148114    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-85.us-west-1.compute.internal"
Oct 30 20:37:03.148170 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:03.148145    2577 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Oct 30 20:37:03.149485 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:03.149467    2577 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-138-85.us-west-1.compute.internal" event="NodeHasSufficientMemory"
Oct 30 20:37:03.149586 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:03.149495    2577 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-138-85.us-west-1.compute.internal" event="NodeHasNoDiskPressure"
Oct 30 20:37:03.149586 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:03.149506    2577 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-138-85.us-west-1.compute.internal" event="NodeHasSufficientPID"
Oct 30 20:37:03.149586 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:03.149470    2577 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-138-85.us-west-1.compute.internal" event="NodeHasSufficientMemory"
Oct 30 20:37:03.149586 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:03.149566    2577 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-138-85.us-west-1.compute.internal" event="NodeHasNoDiskPressure"
Oct 30 20:37:03.149586 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:03.149577    2577 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-138-85.us-west-1.compute.internal" event="NodeHasSufficientPID"
Oct 30 20:37:03.151262 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:03.151247    2577 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Oct 30 20:37:03.151762 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:03.151746    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-85.us-west-1.compute.internal"
Oct 30 20:37:03.151836 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:03.151773    2577 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Oct 30 20:37:03.152002 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:03.151986    2577 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-138-85.us-west-1.compute.internal" event="NodeHasSufficientMemory"
Oct 30 20:37:03.152070 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:03.152019    2577 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-138-85.us-west-1.compute.internal" event="NodeHasNoDiskPressure"
Oct 30 20:37:03.152070 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:03.152037    2577 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-138-85.us-west-1.compute.internal" event="NodeHasSufficientPID"
Oct 30 20:37:03.152137 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:03.152077    2577 kubelet_node_status.go:77] "Attempting to register node" node="ip-10-0-138-85.us-west-1.compute.internal"
Oct 30 20:37:03.152375 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:03.152350    2577 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-138-85.us-west-1.compute.internal" event="NodeHasSufficientMemory"
Oct 30 20:37:03.152477 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:03.152383    2577 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-138-85.us-west-1.compute.internal" event="NodeHasNoDiskPressure"
Oct 30 20:37:03.152477 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:03.152397    2577 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-138-85.us-west-1.compute.internal" event="NodeHasSufficientPID"
Oct 30 20:37:03.180043 ip-10-0-138-85 kubenswrapper[2577]: E1030 20:37:03.180019    2577 kubelet.go:3364] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-138-85.us-west-1.compute.internal\" not found" node="ip-10-0-138-85.us-west-1.compute.internal"
Oct 30 20:37:03.186457 ip-10-0-138-85 kubenswrapper[2577]: E1030 20:37:03.186439    2577 kubelet.go:3364] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-138-85.us-west-1.compute.internal\" not found" node="ip-10-0-138-85.us-west-1.compute.internal"
Oct 30 20:37:03.205727 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:03.205710    2577 reflector.go:446] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:161"
Oct 30 20:37:03.220078 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:03.220041    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/9d0b6e5dd2bbef8c0c7895485f0fdbd3-config\") pod \"kube-apiserver-proxy-ip-10-0-138-85.us-west-1.compute.internal\" (UID: \"9d0b6e5dd2bbef8c0c7895485f0fdbd3\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-85.us-west-1.compute.internal"
Oct 30 20:37:03.220159 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:03.220126    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/6d131c2bf86bd4364de095ada64f40ce-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-85.us-west-1.compute.internal\" (UID: \"6d131c2bf86bd4364de095ada64f40ce\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-85.us-west-1.compute.internal"
Oct 30 20:37:03.220217 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:03.220156    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6d131c2bf86bd4364de095ada64f40ce-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-85.us-west-1.compute.internal\" (UID: \"6d131c2bf86bd4364de095ada64f40ce\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-85.us-west-1.compute.internal"
Oct 30 20:37:03.303059 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:03.303026    2577 reflector.go:446] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:161"
Oct 30 20:37:03.303733 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:03.303708    2577 kubelet_node_status.go:80] "Successfully registered node" node="ip-10-0-138-85.us-west-1.compute.internal"
Oct 30 20:37:03.303834 ip-10-0-138-85 kubenswrapper[2577]: E1030 20:37:03.303738    2577 kubelet_node_status.go:524] "Error updating node status, will retry" err="error getting node \"ip-10-0-138-85.us-west-1.compute.internal\": node \"ip-10-0-138-85.us-west-1.compute.internal\" not found"
Oct 30 20:37:03.303834 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:03.303747    2577 reflector.go:446] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:161"
Oct 30 20:37:03.304804 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:03.304788    2577 reflector.go:446] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:161"
Oct 30 20:37:03.318205 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:03.318186    2577 kubelet.go:3368] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-85.us-west-1.compute.internal"
Oct 30 20:37:03.320387 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:03.320370    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/9d0b6e5dd2bbef8c0c7895485f0fdbd3-config\") pod \"kube-apiserver-proxy-ip-10-0-138-85.us-west-1.compute.internal\" (UID: \"9d0b6e5dd2bbef8c0c7895485f0fdbd3\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-85.us-west-1.compute.internal"
Oct 30 20:37:03.320477 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:03.320402    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/6d131c2bf86bd4364de095ada64f40ce-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-85.us-west-1.compute.internal\" (UID: \"6d131c2bf86bd4364de095ada64f40ce\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-85.us-west-1.compute.internal"
Oct 30 20:37:03.320477 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:03.320427    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6d131c2bf86bd4364de095ada64f40ce-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-85.us-west-1.compute.internal\" (UID: \"6d131c2bf86bd4364de095ada64f40ce\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-85.us-west-1.compute.internal"
Oct 30 20:37:03.320565 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:03.320481    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/6d131c2bf86bd4364de095ada64f40ce-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-85.us-west-1.compute.internal\" (UID: \"6d131c2bf86bd4364de095ada64f40ce\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-85.us-west-1.compute.internal"
Oct 30 20:37:03.320565 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:03.320482    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/9d0b6e5dd2bbef8c0c7895485f0fdbd3-config\") pod \"kube-apiserver-proxy-ip-10-0-138-85.us-west-1.compute.internal\" (UID: \"9d0b6e5dd2bbef8c0c7895485f0fdbd3\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-85.us-west-1.compute.internal"
Oct 30 20:37:03.320565 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:03.320483    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6d131c2bf86bd4364de095ada64f40ce-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-85.us-west-1.compute.internal\" (UID: \"6d131c2bf86bd4364de095ada64f40ce\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-85.us-west-1.compute.internal"
Oct 30 20:37:03.380394 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:03.380324    2577 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Oct 30 20:37:03.382281 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:03.382266    2577 kubelet.go:3368] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-85.us-west-1.compute.internal"
Oct 30 20:37:03.484329 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:03.484299    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-85.us-west-1.compute.internal"
Oct 30 20:37:03.490194 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:03.490087    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-85.us-west-1.compute.internal"
Oct 30 20:37:03.534458 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:03.534434    2577 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Oct 30 20:37:03.853549 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:03.853453    2577 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Oct 30 20:37:03.854140 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:03.853600    2577 reflector.go:578] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:161" type="*v1.Service" err="very short watch: k8s.io/client-go/informers/factory.go:161: Unexpected watch close - watch lasted less than a second and no items received"
Oct 30 20:37:03.854140 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:03.853607    2577 reflector.go:578] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:161" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:161: Unexpected watch close - watch lasted less than a second and no items received"
Oct 30 20:37:03.854140 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:03.853633    2577 reflector.go:578] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:161" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:161: Unexpected watch close - watch lasted less than a second and no items received"
Oct 30 20:37:03.854140 ip-10-0-138-85 kubenswrapper[2577]: E1030 20:37:03.853611    2577 event.go:368] "Unable to write event (may retry after sleeping)" err="Patch \"https://a3138b275a5484ea19a8d9971322f756-b97bd68a7b677e68.elb.us-east-2.amazonaws.com:6443/api/v1/namespaces/default/events/ip-10-0-138-85.us-west-1.compute.internal.18e36916b8efcf0f\": read tcp 10.0.138.85:46528->3.130.166.39:6443: use of closed network connection" event="&Event{ObjectMeta:{ip-10-0-138-85.us-west-1.compute.internal.18e36916b8efcf0f  default   4891 0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-138-85.us-west-1.compute.internal,UID:,APIVersion:v1,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-138-85.us-west-1.compute.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-138-85.us-west-1.compute.internal,},FirstTimestamp:2026-10-30 20:37:02 +0000 UTC,LastTimestamp:2026-10-30 20:37:03.145718368 +0000 UTC m=+0.592513807,Count:3,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-138-85.us-west-1.compute.internal,}"
Oct 30 20:37:03.890935 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:03.890908    2577 apiserver.go:52] "Watching apiserver"
Oct 30 20:37:03.917063 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:03.917028    2577 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Oct 30 20:37:04.133399 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:04.133290    2577 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-10-29 20:32:03 +0000 UTC" deadline="2028-08-06 14:42:44.016963266 +0000 UTC"
Oct 30 20:37:04.133399 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:04.133337    2577 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15498h5m39.883630518s"
Oct 30 20:37:04.190072 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:04.190038    2577 reflector.go:446] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Oct 30 20:37:04.190400 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:04.190377    2577 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-image-registry/node-ca-jnn4r","openshift-multus/network-metrics-daemon-mlctd","openshift-network-diagnostics/network-check-target-lqdtq","kube-system/global-pull-secret-syncer-tvvd9","kube-system/konnectivity-agent-x6f58","openshift-multus/multus-additional-cni-plugins-hmdcd","openshift-network-operator/iptables-alerter-cll8f","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qbnnn","openshift-cluster-node-tuning-operator/tuned-zpr5c","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-85.us-west-1.compute.internal","openshift-multus/multus-sxqtp","openshift-dns/node-resolver-t4227","openshift-ovn-kubernetes/ovnkube-node-mw7xm","kube-system/kube-apiserver-proxy-ip-10-0-138-85.us-west-1.compute.internal"]
Oct 30 20:37:04.192965 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:04.192949    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-jnn4r"
Oct 30 20:37:04.195147 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:04.195127    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lqdtq"
Oct 30 20:37:04.195237 ip-10-0-138-85 kubenswrapper[2577]: E1030 20:37:04.195204    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lqdtq" podUID="50e37bd4-e46f-4577-b7b2-1ac7695637ea"
Oct 30 20:37:04.197331 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:04.197315    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-zpr5c"
Oct 30 20:37:04.199471 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:04.199457    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-x6f58"
Oct 30 20:37:04.201670 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:04.201657    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-cll8f"
Oct 30 20:37:04.203848 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:04.203835    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-hmdcd"
Oct 30 20:37:04.206140 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:04.206120    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qbnnn"
Oct 30 20:37:04.208361 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:04.208342    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tvvd9"
Oct 30 20:37:04.208472 ip-10-0-138-85 kubenswrapper[2577]: E1030 20:37:04.208451    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tvvd9" podUID="a4cdc725-3dd0-4917-b8a0-c8ff77a40abb"
Oct 30 20:37:04.210728 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:04.210702    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-sxqtp"
Oct 30 20:37:04.213034 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:04.213016    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-t4227"
Oct 30 20:37:04.215611 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:04.215593    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-mw7xm"
Oct 30 20:37:04.218026 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:04.218009    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mlctd"
Oct 30 20:37:04.218104 ip-10-0-138-85 kubenswrapper[2577]: E1030 20:37:04.218063    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mlctd" podUID="0f424633-11a5-49fa-a933-f9c6ec7ca97e"
Oct 30 20:37:04.218793 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:04.218778    2577 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Oct 30 20:37:04.224421 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:04.224406    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/1dc89e41-1e32-476f-b5fc-e45945a45efd-etc-sysconfig\") pod \"tuned-zpr5c\" (UID: \"1dc89e41-1e32-476f-b5fc-e45945a45efd\") " pod="openshift-cluster-node-tuning-operator/tuned-zpr5c"
Oct 30 20:37:04.224474 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:04.224428    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1dc89e41-1e32-476f-b5fc-e45945a45efd-etc-kubernetes\") pod \"tuned-zpr5c\" (UID: \"1dc89e41-1e32-476f-b5fc-e45945a45efd\") " pod="openshift-cluster-node-tuning-operator/tuned-zpr5c"
Oct 30 20:37:04.224474 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:04.224447    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4179c36b-8003-46e5-82b0-67f6edea7553-host\") pod \"node-ca-jnn4r\" (UID: \"4179c36b-8003-46e5-82b0-67f6edea7553\") " pod="openshift-image-registry/node-ca-jnn4r"
Oct 30 20:37:04.224535 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:04.224476    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/16e71e18-453a-41bf-a3f8-9618482c9a50-tmp-dir\") pod \"node-resolver-t4227\" (UID: \"16e71e18-453a-41bf-a3f8-9618482c9a50\") " pod="openshift-dns/node-resolver-t4227"
Oct 30 20:37:04.224535 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:04.224502    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0b7ae038-91bf-40f1-9930-8a6158706a3e-run-openvswitch\") pod \"ovnkube-node-mw7xm\" (UID: \"0b7ae038-91bf-40f1-9930-8a6158706a3e\") " pod="openshift-ovn-kubernetes/ovnkube-node-mw7xm"
Oct 30 20:37:04.224598 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:04.224544    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/1dc89e41-1e32-476f-b5fc-e45945a45efd-etc-sysctl-d\") pod \"tuned-zpr5c\" (UID: \"1dc89e41-1e32-476f-b5fc-e45945a45efd\") " pod="openshift-cluster-node-tuning-operator/tuned-zpr5c"
Oct 30 20:37:04.224598 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:04.224572    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1dc89e41-1e32-476f-b5fc-e45945a45efd-tmp\") pod \"tuned-zpr5c\" (UID: \"1dc89e41-1e32-476f-b5fc-e45945a45efd\") " pod="openshift-cluster-node-tuning-operator/tuned-zpr5c"
Oct 30 20:37:04.224663 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:04.224598    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/a4cdc725-3dd0-4917-b8a0-c8ff77a40abb-dbus\") pod \"global-pull-secret-syncer-tvvd9\" (UID: \"a4cdc725-3dd0-4917-b8a0-c8ff77a40abb\") " pod="kube-system/global-pull-secret-syncer-tvvd9"
Oct 30 20:37:04.224663 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:04.224638    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/780e67fb-196e-485a-8aa4-e11cecdc4b63-registration-dir\") pod \"aws-ebs-csi-driver-node-qbnnn\" (UID: \"780e67fb-196e-485a-8aa4-e11cecdc4b63\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qbnnn"
Oct 30 20:37:04.224724 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:04.224678    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1dc89e41-1e32-476f-b5fc-e45945a45efd-lib-modules\") pod \"tuned-zpr5c\" (UID: \"1dc89e41-1e32-476f-b5fc-e45945a45efd\") " pod="openshift-cluster-node-tuning-operator/tuned-zpr5c"
Oct 30 20:37:04.224724 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:04.224706    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1dc89e41-1e32-476f-b5fc-e45945a45efd-host\") pod \"tuned-zpr5c\" (UID: \"1dc89e41-1e32-476f-b5fc-e45945a45efd\") " pod="openshift-cluster-node-tuning-operator/tuned-zpr5c"
Oct 30 20:37:04.224788 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:04.224739    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/1dc89e41-1e32-476f-b5fc-e45945a45efd-etc-tuned\") pod \"tuned-zpr5c\" (UID: \"1dc89e41-1e32-476f-b5fc-e45945a45efd\") " pod="openshift-cluster-node-tuning-operator/tuned-zpr5c"
Oct 30 20:37:04.224788 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:04.224765    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2f9dd030-281c-473e-b441-9ee972019413-system-cni-dir\") pod \"multus-additional-cni-plugins-hmdcd\" (UID: \"2f9dd030-281c-473e-b441-9ee972019413\") " pod="openshift-multus/multus-additional-cni-plugins-hmdcd"
Oct 30 20:37:04.224852 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:04.224798    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-48plj\" (UniqueName: \"kubernetes.io/projected/2f9dd030-281c-473e-b441-9ee972019413-kube-api-access-48plj\") pod \"multus-additional-cni-plugins-hmdcd\" (UID: \"2f9dd030-281c-473e-b441-9ee972019413\") " pod="openshift-multus/multus-additional-cni-plugins-hmdcd"
Oct 30 20:37:04.224852 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:04.224830    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a4cdc725-3dd0-4917-b8a0-c8ff77a40abb-original-pull-secret\") pod \"global-pull-secret-syncer-tvvd9\" (UID: \"a4cdc725-3dd0-4917-b8a0-c8ff77a40abb\") " pod="kube-system/global-pull-secret-syncer-tvvd9"
Oct 30 20:37:04.224915 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:04.224856    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ac7adab4-061f-4371-bc6c-96260eb988d8-system-cni-dir\") pod \"multus-sxqtp\" (UID: \"ac7adab4-061f-4371-bc6c-96260eb988d8\") " pod="openshift-multus/multus-sxqtp"
Oct 30 20:37:04.224915 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:04.224881    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-49sfp\" (UniqueName: \"kubernetes.io/projected/780e67fb-196e-485a-8aa4-e11cecdc4b63-kube-api-access-49sfp\") pod \"aws-ebs-csi-driver-node-qbnnn\" (UID: \"780e67fb-196e-485a-8aa4-e11cecdc4b63\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qbnnn"
Oct 30 20:37:04.224973 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:04.224913    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0b7ae038-91bf-40f1-9930-8a6158706a3e-host-run-ovn-kubernetes\") pod \"ovnkube-node-mw7xm\" (UID: \"0b7ae038-91bf-40f1-9930-8a6158706a3e\") " pod="openshift-ovn-kubernetes/ovnkube-node-mw7xm"
Oct 30 20:37:04.224973 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:04.224941    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ac7adab4-061f-4371-bc6c-96260eb988d8-cni-binary-copy\") pod \"multus-sxqtp\" (UID: \"ac7adab4-061f-4371-bc6c-96260eb988d8\") " pod="openshift-multus/multus-sxqtp"
Oct 30 20:37:04.224973 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:04.224957    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ac7adab4-061f-4371-bc6c-96260eb988d8-host-var-lib-kubelet\") pod \"multus-sxqtp\" (UID: \"ac7adab4-061f-4371-bc6c-96260eb988d8\") " pod="openshift-multus/multus-sxqtp"
Oct 30 20:37:04.225079 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:04.224988    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0b7ae038-91bf-40f1-9930-8a6158706a3e-etc-openvswitch\") pod \"ovnkube-node-mw7xm\" (UID: \"0b7ae038-91bf-40f1-9930-8a6158706a3e\") " pod="openshift-ovn-kubernetes/ovnkube-node-mw7xm"
Oct 30 20:37:04.225079 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:04.225015    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lq6t2\" (UniqueName: \"kubernetes.io/projected/0f424633-11a5-49fa-a933-f9c6ec7ca97e-kube-api-access-lq6t2\") pod \"network-metrics-daemon-mlctd\" (UID: \"0f424633-11a5-49fa-a933-f9c6ec7ca97e\") " pod="openshift-multus/network-metrics-daemon-mlctd"
Oct 30 20:37:04.225079 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:04.225036    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/1dc89e41-1e32-476f-b5fc-e45945a45efd-etc-systemd\") pod \"tuned-zpr5c\" (UID: \"1dc89e41-1e32-476f-b5fc-e45945a45efd\") " pod="openshift-cluster-node-tuning-operator/tuned-zpr5c"
Oct 30 20:37:04.225079 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:04.225073    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wc2mp\" (UniqueName: \"kubernetes.io/projected/1dc89e41-1e32-476f-b5fc-e45945a45efd-kube-api-access-wc2mp\") pod \"tuned-zpr5c\" (UID: \"1dc89e41-1e32-476f-b5fc-e45945a45efd\") " pod="openshift-cluster-node-tuning-operator/tuned-zpr5c"
Oct 30 20:37:04.225294 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:04.225162    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0b7ae038-91bf-40f1-9930-8a6158706a3e-host-slash\") pod \"ovnkube-node-mw7xm\" (UID: \"0b7ae038-91bf-40f1-9930-8a6158706a3e\") " pod="openshift-ovn-kubernetes/ovnkube-node-mw7xm"
Oct 30 20:37:04.225294 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:04.225206    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0b7ae038-91bf-40f1-9930-8a6158706a3e-host-run-netns\") pod \"ovnkube-node-mw7xm\" (UID: \"0b7ae038-91bf-40f1-9930-8a6158706a3e\") " pod="openshift-ovn-kubernetes/ovnkube-node-mw7xm"
Oct 30 20:37:04.225294 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:04.225273    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ac7adab4-061f-4371-bc6c-96260eb988d8-etc-kubernetes\") pod \"multus-sxqtp\" (UID: \"ac7adab4-061f-4371-bc6c-96260eb988d8\") " pod="openshift-multus/multus-sxqtp"
Oct 30 20:37:04.225443 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:04.225314    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2f9dd030-281c-473e-b441-9ee972019413-cnibin\") pod \"multus-additional-cni-plugins-hmdcd\" (UID: \"2f9dd030-281c-473e-b441-9ee972019413\") " pod="openshift-multus/multus-additional-cni-plugins-hmdcd"
Oct 30 20:37:04.225443 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:04.225347    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ac7adab4-061f-4371-bc6c-96260eb988d8-cnibin\") pod \"multus-sxqtp\" (UID: \"ac7adab4-061f-4371-bc6c-96260eb988d8\") " pod="openshift-multus/multus-sxqtp"
Oct 30 20:37:04.225443 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:04.225403    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/ac7adab4-061f-4371-bc6c-96260eb988d8-hostroot\") pod \"multus-sxqtp\" (UID: \"ac7adab4-061f-4371-bc6c-96260eb988d8\") " pod="openshift-multus/multus-sxqtp"
Oct 30 20:37:04.225951 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:04.225447    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/780e67fb-196e-485a-8aa4-e11cecdc4b63-kubelet-dir\") pod \"aws-ebs-csi-driver-node-qbnnn\" (UID: \"780e67fb-196e-485a-8aa4-e11cecdc4b63\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qbnnn"
Oct 30 20:37:04.226041 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:04.225966    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/780e67fb-196e-485a-8aa4-e11cecdc4b63-etc-selinux\") pod \"aws-ebs-csi-driver-node-qbnnn\" (UID: \"780e67fb-196e-485a-8aa4-e11cecdc4b63\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qbnnn"
Oct 30 20:37:04.226041 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:04.225984    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ac7adab4-061f-4371-bc6c-96260eb988d8-multus-conf-dir\") pod \"multus-sxqtp\" (UID: \"ac7adab4-061f-4371-bc6c-96260eb988d8\") " pod="openshift-multus/multus-sxqtp"
Oct 30 20:37:04.226041 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:04.225999    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2f9dd030-281c-473e-b441-9ee972019413-cni-binary-copy\") pod \"multus-additional-cni-plugins-hmdcd\" (UID: \"2f9dd030-281c-473e-b441-9ee972019413\") " pod="openshift-multus/multus-additional-cni-plugins-hmdcd"
Oct 30 20:37:04.226041 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:04.226016    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ac7adab4-061f-4371-bc6c-96260eb988d8-multus-cni-dir\") pod \"multus-sxqtp\" (UID: \"ac7adab4-061f-4371-bc6c-96260eb988d8\") " pod="openshift-multus/multus-sxqtp"
Oct 30 20:37:04.226210 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:04.226060    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0f424633-11a5-49fa-a933-f9c6ec7ca97e-metrics-certs\") pod \"network-metrics-daemon-mlctd\" (UID: \"0f424633-11a5-49fa-a933-f9c6ec7ca97e\") " pod="openshift-multus/network-metrics-daemon-mlctd"
Oct 30 20:37:04.226210 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:04.226114    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/780e67fb-196e-485a-8aa4-e11cecdc4b63-device-dir\") pod \"aws-ebs-csi-driver-node-qbnnn\" (UID: \"780e67fb-196e-485a-8aa4-e11cecdc4b63\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qbnnn"
Oct 30 20:37:04.226210 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:04.226146    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/0b7ae038-91bf-40f1-9930-8a6158706a3e-log-socket\") pod \"ovnkube-node-mw7xm\" (UID: \"0b7ae038-91bf-40f1-9930-8a6158706a3e\") " pod="openshift-ovn-kubernetes/ovnkube-node-mw7xm"
Oct 30 20:37:04.226210 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:04.226163    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0b7ae038-91bf-40f1-9930-8a6158706a3e-host-cni-bin\") pod \"ovnkube-node-mw7xm\" (UID: \"0b7ae038-91bf-40f1-9930-8a6158706a3e\") " pod="openshift-ovn-kubernetes/ovnkube-node-mw7xm"
Oct 30 20:37:04.226210 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:04.226187    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/0b7ae038-91bf-40f1-9930-8a6158706a3e-host-cni-netd\") pod \"ovnkube-node-mw7xm\" (UID: \"0b7ae038-91bf-40f1-9930-8a6158706a3e\") " pod="openshift-ovn-kubernetes/ovnkube-node-mw7xm"
Oct 30 20:37:04.226210 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:04.226205    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0b7ae038-91bf-40f1-9930-8a6158706a3e-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-mw7xm\" (UID: \"0b7ae038-91bf-40f1-9930-8a6158706a3e\") " pod="openshift-ovn-kubernetes/ovnkube-node-mw7xm"
Oct 30 20:37:04.226445 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:04.226222    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ac7adab4-061f-4371-bc6c-96260eb988d8-host-var-lib-cni-bin\") pod \"multus-sxqtp\" (UID: \"ac7adab4-061f-4371-bc6c-96260eb988d8\") " pod="openshift-multus/multus-sxqtp"
Oct 30 20:37:04.226445 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:04.226243    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/0b7ae038-91bf-40f1-9930-8a6158706a3e-systemd-units\") pod \"ovnkube-node-mw7xm\" (UID: \"0b7ae038-91bf-40f1-9930-8a6158706a3e\") " pod="openshift-ovn-kubernetes/ovnkube-node-mw7xm"
Oct 30 20:37:04.226445 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:04.226274    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mh8k8\" (UniqueName: \"kubernetes.io/projected/0b7ae038-91bf-40f1-9930-8a6158706a3e-kube-api-access-mh8k8\") pod \"ovnkube-node-mw7xm\" (UID: \"0b7ae038-91bf-40f1-9930-8a6158706a3e\") " pod="openshift-ovn-kubernetes/ovnkube-node-mw7xm"
Oct 30 20:37:04.226445 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:04.226313    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/1dc89e41-1e32-476f-b5fc-e45945a45efd-etc-modprobe-d\") pod \"tuned-zpr5c\" (UID: \"1dc89e41-1e32-476f-b5fc-e45945a45efd\") " pod="openshift-cluster-node-tuning-operator/tuned-zpr5c"
Oct 30 20:37:04.226445 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:04.226340    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/ac7adab4-061f-4371-bc6c-96260eb988d8-multus-daemon-config\") pod \"multus-sxqtp\" (UID: \"ac7adab4-061f-4371-bc6c-96260eb988d8\") " pod="openshift-multus/multus-sxqtp"
Oct 30 20:37:04.226445 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:04.226383    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/ac7adab4-061f-4371-bc6c-96260eb988d8-multus-socket-dir-parent\") pod \"multus-sxqtp\" (UID: \"ac7adab4-061f-4371-bc6c-96260eb988d8\") " pod="openshift-multus/multus-sxqtp"
Oct 30 20:37:04.226445 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:04.226434    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7qzv8\" (UniqueName: \"kubernetes.io/projected/50e37bd4-e46f-4577-b7b2-1ac7695637ea-kube-api-access-7qzv8\") pod \"network-check-target-lqdtq\" (UID: \"50e37bd4-e46f-4577-b7b2-1ac7695637ea\") " pod="openshift-network-diagnostics/network-check-target-lqdtq"
Oct 30 20:37:04.226742 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:04.226474    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b2dae567-b378-41ed-9f7e-881153b7d03b-host-slash\") pod \"iptables-alerter-cll8f\" (UID: \"b2dae567-b378-41ed-9f7e-881153b7d03b\") " pod="openshift-network-operator/iptables-alerter-cll8f"
Oct 30 20:37:04.226742 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:04.226509    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c2w8k\" (UniqueName: \"kubernetes.io/projected/16e71e18-453a-41bf-a3f8-9618482c9a50-kube-api-access-c2w8k\") pod \"node-resolver-t4227\" (UID: \"16e71e18-453a-41bf-a3f8-9618482c9a50\") " pod="openshift-dns/node-resolver-t4227"
Oct 30 20:37:04.226742 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:04.226573    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/0b7ae038-91bf-40f1-9930-8a6158706a3e-run-systemd\") pod \"ovnkube-node-mw7xm\" (UID: \"0b7ae038-91bf-40f1-9930-8a6158706a3e\") " pod="openshift-ovn-kubernetes/ovnkube-node-mw7xm"
Oct 30 20:37:04.226742 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:04.226611    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/1dc89e41-1e32-476f-b5fc-e45945a45efd-etc-sysctl-conf\") pod \"tuned-zpr5c\" (UID: \"1dc89e41-1e32-476f-b5fc-e45945a45efd\") " pod="openshift-cluster-node-tuning-operator/tuned-zpr5c"
Oct 30 20:37:04.226742 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:04.226641    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/1dc89e41-1e32-476f-b5fc-e45945a45efd-run\") pod \"tuned-zpr5c\" (UID: \"1dc89e41-1e32-476f-b5fc-e45945a45efd\") " pod="openshift-cluster-node-tuning-operator/tuned-zpr5c"
Oct 30 20:37:04.226742 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:04.226669    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/4179c36b-8003-46e5-82b0-67f6edea7553-serviceca\") pod \"node-ca-jnn4r\" (UID: \"4179c36b-8003-46e5-82b0-67f6edea7553\") " pod="openshift-image-registry/node-ca-jnn4r"
Oct 30 20:37:04.226742 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:04.226699    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/780e67fb-196e-485a-8aa4-e11cecdc4b63-sys-fs\") pod \"aws-ebs-csi-driver-node-qbnnn\" (UID: \"780e67fb-196e-485a-8aa4-e11cecdc4b63\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qbnnn"
Oct 30 20:37:04.226742 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:04.226738    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/0b7ae038-91bf-40f1-9930-8a6158706a3e-node-log\") pod \"ovnkube-node-mw7xm\" (UID: \"0b7ae038-91bf-40f1-9930-8a6158706a3e\") " pod="openshift-ovn-kubernetes/ovnkube-node-mw7xm"
Oct 30 20:37:04.227170 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:04.226783    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/0b7ae038-91bf-40f1-9930-8a6158706a3e-ovn-node-metrics-cert\") pod \"ovnkube-node-mw7xm\" (UID: \"0b7ae038-91bf-40f1-9930-8a6158706a3e\") " pod="openshift-ovn-kubernetes/ovnkube-node-mw7xm"
Oct 30 20:37:04.227170 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:04.226827    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/0b7ae038-91bf-40f1-9930-8a6158706a3e-ovnkube-script-lib\") pod \"ovnkube-node-mw7xm\" (UID: \"0b7ae038-91bf-40f1-9930-8a6158706a3e\") " pod="openshift-ovn-kubernetes/ovnkube-node-mw7xm"
Oct 30 20:37:04.227170 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:04.226865    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1dc89e41-1e32-476f-b5fc-e45945a45efd-sys\") pod \"tuned-zpr5c\" (UID: \"1dc89e41-1e32-476f-b5fc-e45945a45efd\") " pod="openshift-cluster-node-tuning-operator/tuned-zpr5c"
Oct 30 20:37:04.227170 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:04.227024    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/ef128f2b-0a66-4c2d-a969-6197e0f82c58-agent-certs\") pod \"konnectivity-agent-x6f58\" (UID: \"ef128f2b-0a66-4c2d-a969-6197e0f82c58\") " pod="kube-system/konnectivity-agent-x6f58"
Oct 30 20:37:04.227170 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:04.227085    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/a4cdc725-3dd0-4917-b8a0-c8ff77a40abb-kubelet-config\") pod \"global-pull-secret-syncer-tvvd9\" (UID: \"a4cdc725-3dd0-4917-b8a0-c8ff77a40abb\") " pod="kube-system/global-pull-secret-syncer-tvvd9"
Oct 30 20:37:04.227170 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:04.227107    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mwd9g\" (UniqueName: \"kubernetes.io/projected/ac7adab4-061f-4371-bc6c-96260eb988d8-kube-api-access-mwd9g\") pod \"multus-sxqtp\" (UID: \"ac7adab4-061f-4371-bc6c-96260eb988d8\") " pod="openshift-multus/multus-sxqtp"
Oct 30 20:37:04.227170 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:04.227122    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/16e71e18-453a-41bf-a3f8-9618482c9a50-hosts-file\") pod \"node-resolver-t4227\" (UID: \"16e71e18-453a-41bf-a3f8-9618482c9a50\") " pod="openshift-dns/node-resolver-t4227"
Oct 30 20:37:04.227170 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:04.227145    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/0b7ae038-91bf-40f1-9930-8a6158706a3e-host-kubelet\") pod \"ovnkube-node-mw7xm\" (UID: \"0b7ae038-91bf-40f1-9930-8a6158706a3e\") " pod="openshift-ovn-kubernetes/ovnkube-node-mw7xm"
Oct 30 20:37:04.227170 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:04.227172    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1dc89e41-1e32-476f-b5fc-e45945a45efd-var-lib-kubelet\") pod \"tuned-zpr5c\" (UID: \"1dc89e41-1e32-476f-b5fc-e45945a45efd\") " pod="openshift-cluster-node-tuning-operator/tuned-zpr5c"
Oct 30 20:37:04.227543 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:04.227193    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/ac7adab4-061f-4371-bc6c-96260eb988d8-host-run-multus-certs\") pod \"multus-sxqtp\" (UID: \"ac7adab4-061f-4371-bc6c-96260eb988d8\") " pod="openshift-multus/multus-sxqtp"
Oct 30 20:37:04.227543 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:04.227218    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zkkqp\" (UniqueName: \"kubernetes.io/projected/b2dae567-b378-41ed-9f7e-881153b7d03b-kube-api-access-zkkqp\") pod \"iptables-alerter-cll8f\" (UID: \"b2dae567-b378-41ed-9f7e-881153b7d03b\") " pod="openshift-network-operator/iptables-alerter-cll8f"
Oct 30 20:37:04.227543 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:04.227233    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/ef128f2b-0a66-4c2d-a969-6197e0f82c58-konnectivity-ca\") pod \"konnectivity-agent-x6f58\" (UID: \"ef128f2b-0a66-4c2d-a969-6197e0f82c58\") " pod="kube-system/konnectivity-agent-x6f58"
Oct 30 20:37:04.227543 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:04.227274    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2f9dd030-281c-473e-b441-9ee972019413-tuning-conf-dir\") pod \"multus-additional-cni-plugins-hmdcd\" (UID: \"2f9dd030-281c-473e-b441-9ee972019413\") " pod="openshift-multus/multus-additional-cni-plugins-hmdcd"
Oct 30 20:37:04.227543 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:04.227314    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/ac7adab4-061f-4371-bc6c-96260eb988d8-host-run-k8s-cni-cncf-io\") pod \"multus-sxqtp\" (UID: \"ac7adab4-061f-4371-bc6c-96260eb988d8\") " pod="openshift-multus/multus-sxqtp"
Oct 30 20:37:04.227543 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:04.227348    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ac7adab4-061f-4371-bc6c-96260eb988d8-host-run-netns\") pod \"multus-sxqtp\" (UID: \"ac7adab4-061f-4371-bc6c-96260eb988d8\") " pod="openshift-multus/multus-sxqtp"
Oct 30 20:37:04.227543 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:04.227381    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/ac7adab4-061f-4371-bc6c-96260eb988d8-host-var-lib-cni-multus\") pod \"multus-sxqtp\" (UID: \"ac7adab4-061f-4371-bc6c-96260eb988d8\") " pod="openshift-multus/multus-sxqtp"
Oct 30 20:37:04.227543 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:04.227414    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/b2dae567-b378-41ed-9f7e-881153b7d03b-iptables-alerter-script\") pod \"iptables-alerter-cll8f\" (UID: \"b2dae567-b378-41ed-9f7e-881153b7d03b\") " pod="openshift-network-operator/iptables-alerter-cll8f"
Oct 30 20:37:04.227543 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:04.227457    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0b7ae038-91bf-40f1-9930-8a6158706a3e-var-lib-openvswitch\") pod \"ovnkube-node-mw7xm\" (UID: \"0b7ae038-91bf-40f1-9930-8a6158706a3e\") " pod="openshift-ovn-kubernetes/ovnkube-node-mw7xm"
Oct 30 20:37:04.227543 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:04.227491    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/0b7ae038-91bf-40f1-9930-8a6158706a3e-run-ovn\") pod \"ovnkube-node-mw7xm\" (UID: \"0b7ae038-91bf-40f1-9930-8a6158706a3e\") " pod="openshift-ovn-kubernetes/ovnkube-node-mw7xm"
Oct 30 20:37:04.227543 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:04.227536    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/0b7ae038-91bf-40f1-9930-8a6158706a3e-env-overrides\") pod \"ovnkube-node-mw7xm\" (UID: \"0b7ae038-91bf-40f1-9930-8a6158706a3e\") " pod="openshift-ovn-kubernetes/ovnkube-node-mw7xm"
Oct 30 20:37:04.227979 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:04.227579    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/2f9dd030-281c-473e-b441-9ee972019413-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-hmdcd\" (UID: \"2f9dd030-281c-473e-b441-9ee972019413\") " pod="openshift-multus/multus-additional-cni-plugins-hmdcd"
Oct 30 20:37:04.227979 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:04.227600    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/2f9dd030-281c-473e-b441-9ee972019413-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-hmdcd\" (UID: \"2f9dd030-281c-473e-b441-9ee972019413\") " pod="openshift-multus/multus-additional-cni-plugins-hmdcd"
Oct 30 20:37:04.227979 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:04.227625    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-79wpr\" (UniqueName: \"kubernetes.io/projected/4179c36b-8003-46e5-82b0-67f6edea7553-kube-api-access-79wpr\") pod \"node-ca-jnn4r\" (UID: \"4179c36b-8003-46e5-82b0-67f6edea7553\") " pod="openshift-image-registry/node-ca-jnn4r"
Oct 30 20:37:04.227979 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:04.227640    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/780e67fb-196e-485a-8aa4-e11cecdc4b63-socket-dir\") pod \"aws-ebs-csi-driver-node-qbnnn\" (UID: \"780e67fb-196e-485a-8aa4-e11cecdc4b63\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qbnnn"
Oct 30 20:37:04.227979 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:04.227675    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/0b7ae038-91bf-40f1-9930-8a6158706a3e-ovnkube-config\") pod \"ovnkube-node-mw7xm\" (UID: \"0b7ae038-91bf-40f1-9930-8a6158706a3e\") " pod="openshift-ovn-kubernetes/ovnkube-node-mw7xm"
Oct 30 20:37:04.249161 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:04.249138    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Oct 30 20:37:04.249161 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:04.249141    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Oct 30 20:37:04.249308 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:04.249181    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Oct 30 20:37:04.249308 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:04.249214    2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-sr85n\""
Oct 30 20:37:04.252975 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:04.252942    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Oct 30 20:37:04.253131 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:04.253119    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Oct 30 20:37:04.253192 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:04.253135    2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-86vxf\""
Oct 30 20:37:04.254815 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:04.254790    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Oct 30 20:37:04.254914 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:04.254899    2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Oct 30 20:37:04.254961 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:04.254925    2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent-dockercfg-c5chh\""
Oct 30 20:37:04.257046 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:04.257029    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Oct 30 20:37:04.257168 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:04.257151    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Oct 30 20:37:04.257168 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:04.257151    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Oct 30 20:37:04.257304 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:04.257240    2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-nvzwj\""
Oct 30 20:37:04.259367 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:04.259349    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Oct 30 20:37:04.259556 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:04.259541    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Oct 30 20:37:04.259610 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:04.259592    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Oct 30 20:37:04.296313 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:04.296292    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Oct 30 20:37:04.296531 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:04.296510    2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Oct 30 20:37:04.296704 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:04.296681    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Oct 30 20:37:04.296775 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:04.296763    2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-bmpds\""
Oct 30 20:37:04.299624 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:04.299607    2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-node-identity-dockercfg-rv75s\""
Oct 30 20:37:04.299675 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:04.299644    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Oct 30 20:37:04.299709 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:04.299685    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Oct 30 20:37:04.299745 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:04.299726    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Oct 30 20:37:04.299745 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:04.299735    2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-94s75\""
Oct 30 20:37:04.299808 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:04.299756    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Oct 30 20:37:04.299841 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:04.299827    2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-jwfqc\""
Oct 30 20:37:04.299884 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:04.299872    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Oct 30 20:37:04.301137 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:04.301116    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Oct 30 20:37:04.301199 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:04.301185    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Oct 30 20:37:04.302797 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:04.302771    2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-g2pwr\""
Oct 30 20:37:04.302894 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:04.302834    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Oct 30 20:37:04.302956 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:04.302939    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Oct 30 20:37:04.303137 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:04.303110    2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Oct 30 20:37:04.303191 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:04.303177    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Oct 30 20:37:04.303259 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:04.303241    2577 reflector.go:446] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Oct 30 20:37:04.303326 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:04.303313    2577 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-kjpk6"
Oct 30 20:37:04.328195 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:04.328166    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ac7adab4-061f-4371-bc6c-96260eb988d8-host-var-lib-cni-bin\") pod \"multus-sxqtp\" (UID: \"ac7adab4-061f-4371-bc6c-96260eb988d8\") " pod="openshift-multus/multus-sxqtp"
Oct 30 20:37:04.328300 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:04.328198    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/0b7ae038-91bf-40f1-9930-8a6158706a3e-systemd-units\") pod \"ovnkube-node-mw7xm\" (UID: \"0b7ae038-91bf-40f1-9930-8a6158706a3e\") " pod="openshift-ovn-kubernetes/ovnkube-node-mw7xm"
Oct 30 20:37:04.328300 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:04.328215    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mh8k8\" (UniqueName: \"kubernetes.io/projected/0b7ae038-91bf-40f1-9930-8a6158706a3e-kube-api-access-mh8k8\") pod \"ovnkube-node-mw7xm\" (UID: \"0b7ae038-91bf-40f1-9930-8a6158706a3e\") " pod="openshift-ovn-kubernetes/ovnkube-node-mw7xm"
Oct 30 20:37:04.328300 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:04.328232    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/1dc89e41-1e32-476f-b5fc-e45945a45efd-etc-modprobe-d\") pod \"tuned-zpr5c\" (UID: \"1dc89e41-1e32-476f-b5fc-e45945a45efd\") " pod="openshift-cluster-node-tuning-operator/tuned-zpr5c"
Oct 30 20:37:04.328300 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:04.328259    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/ac7adab4-061f-4371-bc6c-96260eb988d8-multus-daemon-config\") pod \"multus-sxqtp\" (UID: \"ac7adab4-061f-4371-bc6c-96260eb988d8\") " pod="openshift-multus/multus-sxqtp"
Oct 30 20:37:04.328300 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:04.328281    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/0b7ae038-91bf-40f1-9930-8a6158706a3e-systemd-units\") pod \"ovnkube-node-mw7xm\" (UID: \"0b7ae038-91bf-40f1-9930-8a6158706a3e\") " pod="openshift-ovn-kubernetes/ovnkube-node-mw7xm"
Oct 30 20:37:04.328467 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:04.328296    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ac7adab4-061f-4371-bc6c-96260eb988d8-host-var-lib-cni-bin\") pod \"multus-sxqtp\" (UID: \"ac7adab4-061f-4371-bc6c-96260eb988d8\") " pod="openshift-multus/multus-sxqtp"
Oct 30 20:37:04.328467 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:04.328312    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/ac7adab4-061f-4371-bc6c-96260eb988d8-multus-socket-dir-parent\") pod \"multus-sxqtp\" (UID: \"ac7adab4-061f-4371-bc6c-96260eb988d8\") " pod="openshift-multus/multus-sxqtp"
Oct 30 20:37:04.328467 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:04.328350    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7qzv8\" (UniqueName: \"kubernetes.io/projected/50e37bd4-e46f-4577-b7b2-1ac7695637ea-kube-api-access-7qzv8\") pod \"network-check-target-lqdtq\" (UID: \"50e37bd4-e46f-4577-b7b2-1ac7695637ea\") " pod="openshift-network-diagnostics/network-check-target-lqdtq"
Oct 30 20:37:04.328467 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:04.328400    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/ac7adab4-061f-4371-bc6c-96260eb988d8-multus-socket-dir-parent\") pod \"multus-sxqtp\" (UID: \"ac7adab4-061f-4371-bc6c-96260eb988d8\") " pod="openshift-multus/multus-sxqtp"
Oct 30 20:37:04.328467 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:04.328401    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b2dae567-b378-41ed-9f7e-881153b7d03b-host-slash\") pod \"iptables-alerter-cll8f\" (UID: \"b2dae567-b378-41ed-9f7e-881153b7d03b\") " pod="openshift-network-operator/iptables-alerter-cll8f"
Oct 30 20:37:04.328467 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:04.328442    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b2dae567-b378-41ed-9f7e-881153b7d03b-host-slash\") pod \"iptables-alerter-cll8f\" (UID: \"b2dae567-b378-41ed-9f7e-881153b7d03b\") " pod="openshift-network-operator/iptables-alerter-cll8f"
Oct 30 20:37:04.328467 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:04.328402    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/1dc89e41-1e32-476f-b5fc-e45945a45efd-etc-modprobe-d\") pod \"tuned-zpr5c\" (UID: \"1dc89e41-1e32-476f-b5fc-e45945a45efd\") " pod="openshift-cluster-node-tuning-operator/tuned-zpr5c"
Oct 30 20:37:04.328467 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:04.328460    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c2w8k\" (UniqueName: \"kubernetes.io/projected/16e71e18-453a-41bf-a3f8-9618482c9a50-kube-api-access-c2w8k\") pod \"node-resolver-t4227\" (UID: \"16e71e18-453a-41bf-a3f8-9618482c9a50\") " pod="openshift-dns/node-resolver-t4227"
Oct 30 20:37:04.328704 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:04.328492    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/0b7ae038-91bf-40f1-9930-8a6158706a3e-run-systemd\") pod \"ovnkube-node-mw7xm\" (UID: \"0b7ae038-91bf-40f1-9930-8a6158706a3e\") " pod="openshift-ovn-kubernetes/ovnkube-node-mw7xm"
Oct 30 20:37:04.328704 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:04.328529    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/1dc89e41-1e32-476f-b5fc-e45945a45efd-etc-sysctl-conf\") pod \"tuned-zpr5c\" (UID: \"1dc89e41-1e32-476f-b5fc-e45945a45efd\") " pod="openshift-cluster-node-tuning-operator/tuned-zpr5c"
Oct 30 20:37:04.328704 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:04.328593    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/0b7ae038-91bf-40f1-9930-8a6158706a3e-run-systemd\") pod \"ovnkube-node-mw7xm\" (UID: \"0b7ae038-91bf-40f1-9930-8a6158706a3e\") " pod="openshift-ovn-kubernetes/ovnkube-node-mw7xm"
Oct 30 20:37:04.328704 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:04.328642    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/1dc89e41-1e32-476f-b5fc-e45945a45efd-run\") pod \"tuned-zpr5c\" (UID: \"1dc89e41-1e32-476f-b5fc-e45945a45efd\") " pod="openshift-cluster-node-tuning-operator/tuned-zpr5c"
Oct 30 20:37:04.328704 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:04.328686    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/1dc89e41-1e32-476f-b5fc-e45945a45efd-run\") pod \"tuned-zpr5c\" (UID: \"1dc89e41-1e32-476f-b5fc-e45945a45efd\") " pod="openshift-cluster-node-tuning-operator/tuned-zpr5c"
Oct 30 20:37:04.328704 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:04.328689    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/4179c36b-8003-46e5-82b0-67f6edea7553-serviceca\") pod \"node-ca-jnn4r\" (UID: \"4179c36b-8003-46e5-82b0-67f6edea7553\") " pod="openshift-image-registry/node-ca-jnn4r"
Oct 30 20:37:04.328880 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:04.328725    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/780e67fb-196e-485a-8aa4-e11cecdc4b63-sys-fs\") pod \"aws-ebs-csi-driver-node-qbnnn\" (UID: \"780e67fb-196e-485a-8aa4-e11cecdc4b63\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qbnnn"
Oct 30 20:37:04.328880 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:04.328743    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/0b7ae038-91bf-40f1-9930-8a6158706a3e-node-log\") pod \"ovnkube-node-mw7xm\" (UID: \"0b7ae038-91bf-40f1-9930-8a6158706a3e\") " pod="openshift-ovn-kubernetes/ovnkube-node-mw7xm"
Oct 30 20:37:04.328880 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:04.328766    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/1dc89e41-1e32-476f-b5fc-e45945a45efd-etc-sysctl-conf\") pod \"tuned-zpr5c\" (UID: \"1dc89e41-1e32-476f-b5fc-e45945a45efd\") " pod="openshift-cluster-node-tuning-operator/tuned-zpr5c"
Oct 30 20:37:04.328880 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:04.328776    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/0b7ae038-91bf-40f1-9930-8a6158706a3e-node-log\") pod \"ovnkube-node-mw7xm\" (UID: \"0b7ae038-91bf-40f1-9930-8a6158706a3e\") " pod="openshift-ovn-kubernetes/ovnkube-node-mw7xm"
Oct 30 20:37:04.328880 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:04.328799    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/780e67fb-196e-485a-8aa4-e11cecdc4b63-sys-fs\") pod \"aws-ebs-csi-driver-node-qbnnn\" (UID: \"780e67fb-196e-485a-8aa4-e11cecdc4b63\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qbnnn"
Oct 30 20:37:04.328880 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:04.328829    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/0b7ae038-91bf-40f1-9930-8a6158706a3e-ovn-node-metrics-cert\") pod \"ovnkube-node-mw7xm\" (UID: \"0b7ae038-91bf-40f1-9930-8a6158706a3e\") " pod="openshift-ovn-kubernetes/ovnkube-node-mw7xm"
Oct 30 20:37:04.328880 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:04.328849    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/0b7ae038-91bf-40f1-9930-8a6158706a3e-ovnkube-script-lib\") pod \"ovnkube-node-mw7xm\" (UID: \"0b7ae038-91bf-40f1-9930-8a6158706a3e\") " pod="openshift-ovn-kubernetes/ovnkube-node-mw7xm"
Oct 30 20:37:04.328880 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:04.328870    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1dc89e41-1e32-476f-b5fc-e45945a45efd-sys\") pod \"tuned-zpr5c\" (UID: \"1dc89e41-1e32-476f-b5fc-e45945a45efd\") " pod="openshift-cluster-node-tuning-operator/tuned-zpr5c"
Oct 30 20:37:04.329205 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:04.328897    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/ef128f2b-0a66-4c2d-a969-6197e0f82c58-agent-certs\") pod \"konnectivity-agent-x6f58\" (UID: \"ef128f2b-0a66-4c2d-a969-6197e0f82c58\") " pod="kube-system/konnectivity-agent-x6f58"
Oct 30 20:37:04.329205 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:04.328903    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/ac7adab4-061f-4371-bc6c-96260eb988d8-multus-daemon-config\") pod \"multus-sxqtp\" (UID: \"ac7adab4-061f-4371-bc6c-96260eb988d8\") " pod="openshift-multus/multus-sxqtp"
Oct 30 20:37:04.329205 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:04.328925    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/a4cdc725-3dd0-4917-b8a0-c8ff77a40abb-kubelet-config\") pod \"global-pull-secret-syncer-tvvd9\" (UID: \"a4cdc725-3dd0-4917-b8a0-c8ff77a40abb\") " pod="kube-system/global-pull-secret-syncer-tvvd9"
Oct 30 20:37:04.329205 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:04.328967    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mwd9g\" (UniqueName: \"kubernetes.io/projected/ac7adab4-061f-4371-bc6c-96260eb988d8-kube-api-access-mwd9g\") pod \"multus-sxqtp\" (UID: \"ac7adab4-061f-4371-bc6c-96260eb988d8\") " pod="openshift-multus/multus-sxqtp"
Oct 30 20:37:04.329205 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:04.328989    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/16e71e18-453a-41bf-a3f8-9618482c9a50-hosts-file\") pod \"node-resolver-t4227\" (UID: \"16e71e18-453a-41bf-a3f8-9618482c9a50\") " pod="openshift-dns/node-resolver-t4227"
Oct 30 20:37:04.329205 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:04.329001    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1dc89e41-1e32-476f-b5fc-e45945a45efd-sys\") pod \"tuned-zpr5c\" (UID: \"1dc89e41-1e32-476f-b5fc-e45945a45efd\") " pod="openshift-cluster-node-tuning-operator/tuned-zpr5c"
Oct 30 20:37:04.329205 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:04.329016    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/0b7ae038-91bf-40f1-9930-8a6158706a3e-host-kubelet\") pod \"ovnkube-node-mw7xm\" (UID: \"0b7ae038-91bf-40f1-9930-8a6158706a3e\") " pod="openshift-ovn-kubernetes/ovnkube-node-mw7xm"
Oct 30 20:37:04.329205 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:04.329091    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/16e71e18-453a-41bf-a3f8-9618482c9a50-hosts-file\") pod \"node-resolver-t4227\" (UID: \"16e71e18-453a-41bf-a3f8-9618482c9a50\") " pod="openshift-dns/node-resolver-t4227"
Oct 30 20:37:04.329205 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:04.329094    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/a4cdc725-3dd0-4917-b8a0-c8ff77a40abb-kubelet-config\") pod \"global-pull-secret-syncer-tvvd9\" (UID: \"a4cdc725-3dd0-4917-b8a0-c8ff77a40abb\") " pod="kube-system/global-pull-secret-syncer-tvvd9"
Oct 30 20:37:04.329205 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:04.329122    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1dc89e41-1e32-476f-b5fc-e45945a45efd-var-lib-kubelet\") pod \"tuned-zpr5c\" (UID: \"1dc89e41-1e32-476f-b5fc-e45945a45efd\") " pod="openshift-cluster-node-tuning-operator/tuned-zpr5c"
Oct 30 20:37:04.329205 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:04.329146    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/ac7adab4-061f-4371-bc6c-96260eb988d8-host-run-multus-certs\") pod \"multus-sxqtp\" (UID: \"ac7adab4-061f-4371-bc6c-96260eb988d8\") " pod="openshift-multus/multus-sxqtp"
Oct 30 20:37:04.329205 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:04.329147    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/4179c36b-8003-46e5-82b0-67f6edea7553-serviceca\") pod \"node-ca-jnn4r\" (UID: \"4179c36b-8003-46e5-82b0-67f6edea7553\") " pod="openshift-image-registry/node-ca-jnn4r"
Oct 30 20:37:04.329205 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:04.329171    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zkkqp\" (UniqueName: \"kubernetes.io/projected/b2dae567-b378-41ed-9f7e-881153b7d03b-kube-api-access-zkkqp\") pod \"iptables-alerter-cll8f\" (UID: \"b2dae567-b378-41ed-9f7e-881153b7d03b\") " pod="openshift-network-operator/iptables-alerter-cll8f"
Oct 30 20:37:04.329205 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:04.329200    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/ef128f2b-0a66-4c2d-a969-6197e0f82c58-konnectivity-ca\") pod \"konnectivity-agent-x6f58\" (UID: \"ef128f2b-0a66-4c2d-a969-6197e0f82c58\") " pod="kube-system/konnectivity-agent-x6f58"
Oct 30 20:37:04.329205 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:04.329203    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/0b7ae038-91bf-40f1-9930-8a6158706a3e-host-kubelet\") pod \"ovnkube-node-mw7xm\" (UID: \"0b7ae038-91bf-40f1-9930-8a6158706a3e\") " pod="openshift-ovn-kubernetes/ovnkube-node-mw7xm"
Oct 30 20:37:04.329898 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:04.329247    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/ac7adab4-061f-4371-bc6c-96260eb988d8-host-run-multus-certs\") pod \"multus-sxqtp\" (UID: \"ac7adab4-061f-4371-bc6c-96260eb988d8\") " pod="openshift-multus/multus-sxqtp"
Oct 30 20:37:04.329898 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:04.329268    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1dc89e41-1e32-476f-b5fc-e45945a45efd-var-lib-kubelet\") pod \"tuned-zpr5c\" (UID: \"1dc89e41-1e32-476f-b5fc-e45945a45efd\") " pod="openshift-cluster-node-tuning-operator/tuned-zpr5c"
Oct 30 20:37:04.329898 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:04.329329    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2f9dd030-281c-473e-b441-9ee972019413-tuning-conf-dir\") pod \"multus-additional-cni-plugins-hmdcd\" (UID: \"2f9dd030-281c-473e-b441-9ee972019413\") " pod="openshift-multus/multus-additional-cni-plugins-hmdcd"
Oct 30 20:37:04.329898 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:04.329362    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/ac7adab4-061f-4371-bc6c-96260eb988d8-host-run-k8s-cni-cncf-io\") pod \"multus-sxqtp\" (UID: \"ac7adab4-061f-4371-bc6c-96260eb988d8\") " pod="openshift-multus/multus-sxqtp"
Oct 30 20:37:04.329898 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:04.329389    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ac7adab4-061f-4371-bc6c-96260eb988d8-host-run-netns\") pod \"multus-sxqtp\" (UID: \"ac7adab4-061f-4371-bc6c-96260eb988d8\") " pod="openshift-multus/multus-sxqtp"
Oct 30 20:37:04.329898 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:04.329396    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/ac7adab4-061f-4371-bc6c-96260eb988d8-host-run-k8s-cni-cncf-io\") pod \"multus-sxqtp\" (UID: \"ac7adab4-061f-4371-bc6c-96260eb988d8\") " pod="openshift-multus/multus-sxqtp"
Oct 30 20:37:04.329898 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:04.329416    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/ac7adab4-061f-4371-bc6c-96260eb988d8-host-var-lib-cni-multus\") pod \"multus-sxqtp\" (UID: \"ac7adab4-061f-4371-bc6c-96260eb988d8\") " pod="openshift-multus/multus-sxqtp"
Oct 30 20:37:04.329898 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:04.329356    2577 swap_util.go:78] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Oct 30 20:37:04.329898 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:04.329446    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ac7adab4-061f-4371-bc6c-96260eb988d8-host-run-netns\") pod \"multus-sxqtp\" (UID: \"ac7adab4-061f-4371-bc6c-96260eb988d8\") " pod="openshift-multus/multus-sxqtp"
Oct 30 20:37:04.329898 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:04.329463    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/ac7adab4-061f-4371-bc6c-96260eb988d8-host-var-lib-cni-multus\") pod \"multus-sxqtp\" (UID: \"ac7adab4-061f-4371-bc6c-96260eb988d8\") " pod="openshift-multus/multus-sxqtp"
Oct 30 20:37:04.329898 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:04.329517    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/b2dae567-b378-41ed-9f7e-881153b7d03b-iptables-alerter-script\") pod \"iptables-alerter-cll8f\" (UID: \"b2dae567-b378-41ed-9f7e-881153b7d03b\") " pod="openshift-network-operator/iptables-alerter-cll8f"
Oct 30 20:37:04.329898 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:04.329519    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2f9dd030-281c-473e-b441-9ee972019413-tuning-conf-dir\") pod \"multus-additional-cni-plugins-hmdcd\" (UID: \"2f9dd030-281c-473e-b441-9ee972019413\") " pod="openshift-multus/multus-additional-cni-plugins-hmdcd"
Oct 30 20:37:04.329898 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:04.329540    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0b7ae038-91bf-40f1-9930-8a6158706a3e-var-lib-openvswitch\") pod \"ovnkube-node-mw7xm\" (UID: \"0b7ae038-91bf-40f1-9930-8a6158706a3e\") " pod="openshift-ovn-kubernetes/ovnkube-node-mw7xm"
Oct 30 20:37:04.329898 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:04.329565    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/0b7ae038-91bf-40f1-9930-8a6158706a3e-run-ovn\") pod \"ovnkube-node-mw7xm\" (UID: \"0b7ae038-91bf-40f1-9930-8a6158706a3e\") " pod="openshift-ovn-kubernetes/ovnkube-node-mw7xm"
Oct 30 20:37:04.329898 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:04.329586    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/0b7ae038-91bf-40f1-9930-8a6158706a3e-env-overrides\") pod \"ovnkube-node-mw7xm\" (UID: \"0b7ae038-91bf-40f1-9930-8a6158706a3e\") " pod="openshift-ovn-kubernetes/ovnkube-node-mw7xm"
Oct 30 20:37:04.329898 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:04.329630    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0b7ae038-91bf-40f1-9930-8a6158706a3e-var-lib-openvswitch\") pod \"ovnkube-node-mw7xm\" (UID: \"0b7ae038-91bf-40f1-9930-8a6158706a3e\") " pod="openshift-ovn-kubernetes/ovnkube-node-mw7xm"
Oct 30 20:37:04.329898 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:04.329669    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/0b7ae038-91bf-40f1-9930-8a6158706a3e-ovnkube-script-lib\") pod \"ovnkube-node-mw7xm\" (UID: \"0b7ae038-91bf-40f1-9930-8a6158706a3e\") " pod="openshift-ovn-kubernetes/ovnkube-node-mw7xm"
Oct 30 20:37:04.329898 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:04.329668    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/2f9dd030-281c-473e-b441-9ee972019413-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-hmdcd\" (UID: \"2f9dd030-281c-473e-b441-9ee972019413\") " pod="openshift-multus/multus-additional-cni-plugins-hmdcd"
Oct 30 20:37:04.330803 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:04.329725    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/2f9dd030-281c-473e-b441-9ee972019413-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-hmdcd\" (UID: \"2f9dd030-281c-473e-b441-9ee972019413\") " pod="openshift-multus/multus-additional-cni-plugins-hmdcd"
Oct 30 20:37:04.330803 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:04.329742    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/0b7ae038-91bf-40f1-9930-8a6158706a3e-run-ovn\") pod \"ovnkube-node-mw7xm\" (UID: \"0b7ae038-91bf-40f1-9930-8a6158706a3e\") " pod="openshift-ovn-kubernetes/ovnkube-node-mw7xm"
Oct 30 20:37:04.330803 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:04.329751    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-79wpr\" (UniqueName: \"kubernetes.io/projected/4179c36b-8003-46e5-82b0-67f6edea7553-kube-api-access-79wpr\") pod \"node-ca-jnn4r\" (UID: \"4179c36b-8003-46e5-82b0-67f6edea7553\") " pod="openshift-image-registry/node-ca-jnn4r"
Oct 30 20:37:04.330803 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:04.329785    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/ef128f2b-0a66-4c2d-a969-6197e0f82c58-konnectivity-ca\") pod \"konnectivity-agent-x6f58\" (UID: \"ef128f2b-0a66-4c2d-a969-6197e0f82c58\") " pod="kube-system/konnectivity-agent-x6f58"
Oct 30 20:37:04.330803 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:04.329786    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/780e67fb-196e-485a-8aa4-e11cecdc4b63-socket-dir\") pod \"aws-ebs-csi-driver-node-qbnnn\" (UID: \"780e67fb-196e-485a-8aa4-e11cecdc4b63\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qbnnn"
Oct 30 20:37:04.330803 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:04.329831    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/0b7ae038-91bf-40f1-9930-8a6158706a3e-ovnkube-config\") pod \"ovnkube-node-mw7xm\" (UID: \"0b7ae038-91bf-40f1-9930-8a6158706a3e\") " pod="openshift-ovn-kubernetes/ovnkube-node-mw7xm"
Oct 30 20:37:04.330803 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:04.329883    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/1dc89e41-1e32-476f-b5fc-e45945a45efd-etc-sysconfig\") pod \"tuned-zpr5c\" (UID: \"1dc89e41-1e32-476f-b5fc-e45945a45efd\") " pod="openshift-cluster-node-tuning-operator/tuned-zpr5c"
Oct 30 20:37:04.330803 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:04.329907    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/780e67fb-196e-485a-8aa4-e11cecdc4b63-socket-dir\") pod \"aws-ebs-csi-driver-node-qbnnn\" (UID: \"780e67fb-196e-485a-8aa4-e11cecdc4b63\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qbnnn"
Oct 30 20:37:04.330803 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:04.329909    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1dc89e41-1e32-476f-b5fc-e45945a45efd-etc-kubernetes\") pod \"tuned-zpr5c\" (UID: \"1dc89e41-1e32-476f-b5fc-e45945a45efd\") " pod="openshift-cluster-node-tuning-operator/tuned-zpr5c"
Oct 30 20:37:04.330803 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:04.329950    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4179c36b-8003-46e5-82b0-67f6edea7553-host\") pod \"node-ca-jnn4r\" (UID: \"4179c36b-8003-46e5-82b0-67f6edea7553\") " pod="openshift-image-registry/node-ca-jnn4r"
Oct 30 20:37:04.330803 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:04.329976    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/16e71e18-453a-41bf-a3f8-9618482c9a50-tmp-dir\") pod \"node-resolver-t4227\" (UID: \"16e71e18-453a-41bf-a3f8-9618482c9a50\") " pod="openshift-dns/node-resolver-t4227"
Oct 30 20:37:04.330803 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:04.329998    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0b7ae038-91bf-40f1-9930-8a6158706a3e-run-openvswitch\") pod \"ovnkube-node-mw7xm\" (UID: \"0b7ae038-91bf-40f1-9930-8a6158706a3e\") " pod="openshift-ovn-kubernetes/ovnkube-node-mw7xm"
Oct 30 20:37:04.330803 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:04.330017    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/1dc89e41-1e32-476f-b5fc-e45945a45efd-etc-sysctl-d\") pod \"tuned-zpr5c\" (UID: \"1dc89e41-1e32-476f-b5fc-e45945a45efd\") " pod="openshift-cluster-node-tuning-operator/tuned-zpr5c"
Oct 30 20:37:04.330803 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:04.330040    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1dc89e41-1e32-476f-b5fc-e45945a45efd-tmp\") pod \"tuned-zpr5c\" (UID: \"1dc89e41-1e32-476f-b5fc-e45945a45efd\") " pod="openshift-cluster-node-tuning-operator/tuned-zpr5c"
Oct 30 20:37:04.330803 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:04.330019    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1dc89e41-1e32-476f-b5fc-e45945a45efd-etc-kubernetes\") pod \"tuned-zpr5c\" (UID: \"1dc89e41-1e32-476f-b5fc-e45945a45efd\") " pod="openshift-cluster-node-tuning-operator/tuned-zpr5c"
Oct 30 20:37:04.330803 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:04.330075    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/a4cdc725-3dd0-4917-b8a0-c8ff77a40abb-dbus\") pod \"global-pull-secret-syncer-tvvd9\" (UID: \"a4cdc725-3dd0-4917-b8a0-c8ff77a40abb\") " pod="kube-system/global-pull-secret-syncer-tvvd9"
Oct 30 20:37:04.330803 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:04.330104    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/780e67fb-196e-485a-8aa4-e11cecdc4b63-registration-dir\") pod \"aws-ebs-csi-driver-node-qbnnn\" (UID: \"780e67fb-196e-485a-8aa4-e11cecdc4b63\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qbnnn"
Oct 30 20:37:04.331629 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:04.330121    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/0b7ae038-91bf-40f1-9930-8a6158706a3e-env-overrides\") pod \"ovnkube-node-mw7xm\" (UID: \"0b7ae038-91bf-40f1-9930-8a6158706a3e\") " pod="openshift-ovn-kubernetes/ovnkube-node-mw7xm"
Oct 30 20:37:04.331629 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:04.330152    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/b2dae567-b378-41ed-9f7e-881153b7d03b-iptables-alerter-script\") pod \"iptables-alerter-cll8f\" (UID: \"b2dae567-b378-41ed-9f7e-881153b7d03b\") " pod="openshift-network-operator/iptables-alerter-cll8f"
Oct 30 20:37:04.331629 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:04.330170    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1dc89e41-1e32-476f-b5fc-e45945a45efd-lib-modules\") pod \"tuned-zpr5c\" (UID: \"1dc89e41-1e32-476f-b5fc-e45945a45efd\") " pod="openshift-cluster-node-tuning-operator/tuned-zpr5c"
Oct 30 20:37:04.331629 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:04.330215    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4179c36b-8003-46e5-82b0-67f6edea7553-host\") pod \"node-ca-jnn4r\" (UID: \"4179c36b-8003-46e5-82b0-67f6edea7553\") " pod="openshift-image-registry/node-ca-jnn4r"
Oct 30 20:37:04.331629 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:04.330235    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1dc89e41-1e32-476f-b5fc-e45945a45efd-host\") pod \"tuned-zpr5c\" (UID: \"1dc89e41-1e32-476f-b5fc-e45945a45efd\") " pod="openshift-cluster-node-tuning-operator/tuned-zpr5c"
Oct 30 20:37:04.331629 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:04.330263    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1dc89e41-1e32-476f-b5fc-e45945a45efd-lib-modules\") pod \"tuned-zpr5c\" (UID: \"1dc89e41-1e32-476f-b5fc-e45945a45efd\") " pod="openshift-cluster-node-tuning-operator/tuned-zpr5c"
Oct 30 20:37:04.331629 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:04.330340    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/1dc89e41-1e32-476f-b5fc-e45945a45efd-etc-tuned\") pod \"tuned-zpr5c\" (UID: \"1dc89e41-1e32-476f-b5fc-e45945a45efd\") " pod="openshift-cluster-node-tuning-operator/tuned-zpr5c"
Oct 30 20:37:04.331629 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:04.330359    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/2f9dd030-281c-473e-b441-9ee972019413-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-hmdcd\" (UID: \"2f9dd030-281c-473e-b441-9ee972019413\") " pod="openshift-multus/multus-additional-cni-plugins-hmdcd"
Oct 30 20:37:04.331629 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:04.330367    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2f9dd030-281c-473e-b441-9ee972019413-system-cni-dir\") pod \"multus-additional-cni-plugins-hmdcd\" (UID: \"2f9dd030-281c-473e-b441-9ee972019413\") " pod="openshift-multus/multus-additional-cni-plugins-hmdcd"
Oct 30 20:37:04.331629 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:04.330403    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-48plj\" (UniqueName: \"kubernetes.io/projected/2f9dd030-281c-473e-b441-9ee972019413-kube-api-access-48plj\") pod \"multus-additional-cni-plugins-hmdcd\" (UID: \"2f9dd030-281c-473e-b441-9ee972019413\") " pod="openshift-multus/multus-additional-cni-plugins-hmdcd"
Oct 30 20:37:04.331629 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:04.330432    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a4cdc725-3dd0-4917-b8a0-c8ff77a40abb-original-pull-secret\") pod \"global-pull-secret-syncer-tvvd9\" (UID: \"a4cdc725-3dd0-4917-b8a0-c8ff77a40abb\") " pod="kube-system/global-pull-secret-syncer-tvvd9"
Oct 30 20:37:04.331629 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:04.330455    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ac7adab4-061f-4371-bc6c-96260eb988d8-system-cni-dir\") pod \"multus-sxqtp\" (UID: \"ac7adab4-061f-4371-bc6c-96260eb988d8\") " pod="openshift-multus/multus-sxqtp"
Oct 30 20:37:04.331629 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:04.330483    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-49sfp\" (UniqueName: \"kubernetes.io/projected/780e67fb-196e-485a-8aa4-e11cecdc4b63-kube-api-access-49sfp\") pod \"aws-ebs-csi-driver-node-qbnnn\" (UID: \"780e67fb-196e-485a-8aa4-e11cecdc4b63\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qbnnn"
Oct 30 20:37:04.331629 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:04.330514    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0b7ae038-91bf-40f1-9930-8a6158706a3e-host-run-ovn-kubernetes\") pod \"ovnkube-node-mw7xm\" (UID: \"0b7ae038-91bf-40f1-9930-8a6158706a3e\") " pod="openshift-ovn-kubernetes/ovnkube-node-mw7xm"
Oct 30 20:37:04.331629 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:04.330539    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ac7adab4-061f-4371-bc6c-96260eb988d8-cni-binary-copy\") pod \"multus-sxqtp\" (UID: \"ac7adab4-061f-4371-bc6c-96260eb988d8\") " pod="openshift-multus/multus-sxqtp"
Oct 30 20:37:04.331629 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:04.330614    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/0b7ae038-91bf-40f1-9930-8a6158706a3e-ovnkube-config\") pod \"ovnkube-node-mw7xm\" (UID: \"0b7ae038-91bf-40f1-9930-8a6158706a3e\") " pod="openshift-ovn-kubernetes/ovnkube-node-mw7xm"
Oct 30 20:37:04.331629 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:04.330638    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/16e71e18-453a-41bf-a3f8-9618482c9a50-tmp-dir\") pod \"node-resolver-t4227\" (UID: \"16e71e18-453a-41bf-a3f8-9618482c9a50\") " pod="openshift-dns/node-resolver-t4227"
Oct 30 20:37:04.332521 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:04.330675    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ac7adab4-061f-4371-bc6c-96260eb988d8-host-var-lib-kubelet\") pod \"multus-sxqtp\" (UID: \"ac7adab4-061f-4371-bc6c-96260eb988d8\") " pod="openshift-multus/multus-sxqtp"
Oct 30 20:37:04.332521 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:04.330681    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1dc89e41-1e32-476f-b5fc-e45945a45efd-host\") pod \"tuned-zpr5c\" (UID: \"1dc89e41-1e32-476f-b5fc-e45945a45efd\") " pod="openshift-cluster-node-tuning-operator/tuned-zpr5c"
Oct 30 20:37:04.332521 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:04.330696    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/1dc89e41-1e32-476f-b5fc-e45945a45efd-etc-sysconfig\") pod \"tuned-zpr5c\" (UID: \"1dc89e41-1e32-476f-b5fc-e45945a45efd\") " pod="openshift-cluster-node-tuning-operator/tuned-zpr5c"
Oct 30 20:37:04.332521 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:04.330704    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0b7ae038-91bf-40f1-9930-8a6158706a3e-etc-openvswitch\") pod \"ovnkube-node-mw7xm\" (UID: \"0b7ae038-91bf-40f1-9930-8a6158706a3e\") " pod="openshift-ovn-kubernetes/ovnkube-node-mw7xm"
Oct 30 20:37:04.332521 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:04.330682    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/2f9dd030-281c-473e-b441-9ee972019413-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-hmdcd\" (UID: \"2f9dd030-281c-473e-b441-9ee972019413\") " pod="openshift-multus/multus-additional-cni-plugins-hmdcd"
Oct 30 20:37:04.332521 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:04.330724    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0b7ae038-91bf-40f1-9930-8a6158706a3e-run-openvswitch\") pod \"ovnkube-node-mw7xm\" (UID: \"0b7ae038-91bf-40f1-9930-8a6158706a3e\") " pod="openshift-ovn-kubernetes/ovnkube-node-mw7xm"
Oct 30 20:37:04.332521 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:04.330739    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lq6t2\" (UniqueName: \"kubernetes.io/projected/0f424633-11a5-49fa-a933-f9c6ec7ca97e-kube-api-access-lq6t2\") pod \"network-metrics-daemon-mlctd\" (UID: \"0f424633-11a5-49fa-a933-f9c6ec7ca97e\") " pod="openshift-multus/network-metrics-daemon-mlctd"
Oct 30 20:37:04.332521 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:04.330749    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0b7ae038-91bf-40f1-9930-8a6158706a3e-etc-openvswitch\") pod \"ovnkube-node-mw7xm\" (UID: \"0b7ae038-91bf-40f1-9930-8a6158706a3e\") " pod="openshift-ovn-kubernetes/ovnkube-node-mw7xm"
Oct 30 20:37:04.332521 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:04.330770    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/1dc89e41-1e32-476f-b5fc-e45945a45efd-etc-systemd\") pod \"tuned-zpr5c\" (UID: \"1dc89e41-1e32-476f-b5fc-e45945a45efd\") " pod="openshift-cluster-node-tuning-operator/tuned-zpr5c"
Oct 30 20:37:04.332521 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:04.330798    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wc2mp\" (UniqueName: \"kubernetes.io/projected/1dc89e41-1e32-476f-b5fc-e45945a45efd-kube-api-access-wc2mp\") pod \"tuned-zpr5c\" (UID: \"1dc89e41-1e32-476f-b5fc-e45945a45efd\") " pod="openshift-cluster-node-tuning-operator/tuned-zpr5c"
Oct 30 20:37:04.332521 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:04.330825    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0b7ae038-91bf-40f1-9930-8a6158706a3e-host-slash\") pod \"ovnkube-node-mw7xm\" (UID: \"0b7ae038-91bf-40f1-9930-8a6158706a3e\") " pod="openshift-ovn-kubernetes/ovnkube-node-mw7xm"
Oct 30 20:37:04.332521 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:04.330854    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0b7ae038-91bf-40f1-9930-8a6158706a3e-host-run-netns\") pod \"ovnkube-node-mw7xm\" (UID: \"0b7ae038-91bf-40f1-9930-8a6158706a3e\") " pod="openshift-ovn-kubernetes/ovnkube-node-mw7xm"
Oct 30 20:37:04.332521 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:04.330881    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ac7adab4-061f-4371-bc6c-96260eb988d8-etc-kubernetes\") pod \"multus-sxqtp\" (UID: \"ac7adab4-061f-4371-bc6c-96260eb988d8\") " pod="openshift-multus/multus-sxqtp"
Oct 30 20:37:04.332521 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:04.330932    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ac7adab4-061f-4371-bc6c-96260eb988d8-etc-kubernetes\") pod \"multus-sxqtp\" (UID: \"ac7adab4-061f-4371-bc6c-96260eb988d8\") " pod="openshift-multus/multus-sxqtp"
Oct 30 20:37:04.332521 ip-10-0-138-85 kubenswrapper[2577]: E1030 20:37:04.330971    2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Oct 30 20:37:04.332521 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:04.331008    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2f9dd030-281c-473e-b441-9ee972019413-system-cni-dir\") pod \"multus-additional-cni-plugins-hmdcd\" (UID: \"2f9dd030-281c-473e-b441-9ee972019413\") " pod="openshift-multus/multus-additional-cni-plugins-hmdcd"
Oct 30 20:37:04.332521 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:04.331036    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/1dc89e41-1e32-476f-b5fc-e45945a45efd-etc-sysctl-d\") pod \"tuned-zpr5c\" (UID: \"1dc89e41-1e32-476f-b5fc-e45945a45efd\") " pod="openshift-cluster-node-tuning-operator/tuned-zpr5c"
Oct 30 20:37:04.333385 ip-10-0-138-85 kubenswrapper[2577]: E1030 20:37:04.331066    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a4cdc725-3dd0-4917-b8a0-c8ff77a40abb-original-pull-secret podName:a4cdc725-3dd0-4917-b8a0-c8ff77a40abb nodeName:}" failed. No retries permitted until 2026-10-30 20:37:04.831027312 +0000 UTC m=+2.277822766 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a4cdc725-3dd0-4917-b8a0-c8ff77a40abb-original-pull-secret") pod "global-pull-secret-syncer-tvvd9" (UID: "a4cdc725-3dd0-4917-b8a0-c8ff77a40abb") : object "kube-system"/"original-pull-secret" not registered
Oct 30 20:37:04.333385 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:04.331086    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0b7ae038-91bf-40f1-9930-8a6158706a3e-host-run-netns\") pod \"ovnkube-node-mw7xm\" (UID: \"0b7ae038-91bf-40f1-9930-8a6158706a3e\") " pod="openshift-ovn-kubernetes/ovnkube-node-mw7xm"
Oct 30 20:37:04.333385 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:04.331106    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2f9dd030-281c-473e-b441-9ee972019413-cnibin\") pod \"multus-additional-cni-plugins-hmdcd\" (UID: \"2f9dd030-281c-473e-b441-9ee972019413\") " pod="openshift-multus/multus-additional-cni-plugins-hmdcd"
Oct 30 20:37:04.333385 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:04.331151    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ac7adab4-061f-4371-bc6c-96260eb988d8-cnibin\") pod \"multus-sxqtp\" (UID: \"ac7adab4-061f-4371-bc6c-96260eb988d8\") " pod="openshift-multus/multus-sxqtp"
Oct 30 20:37:04.333385 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:04.331181    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/ac7adab4-061f-4371-bc6c-96260eb988d8-hostroot\") pod \"multus-sxqtp\" (UID: \"ac7adab4-061f-4371-bc6c-96260eb988d8\") " pod="openshift-multus/multus-sxqtp"
Oct 30 20:37:04.333385 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:04.331206    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/780e67fb-196e-485a-8aa4-e11cecdc4b63-kubelet-dir\") pod \"aws-ebs-csi-driver-node-qbnnn\" (UID: \"780e67fb-196e-485a-8aa4-e11cecdc4b63\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qbnnn"
Oct 30 20:37:04.333385 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:04.331230    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/780e67fb-196e-485a-8aa4-e11cecdc4b63-etc-selinux\") pod \"aws-ebs-csi-driver-node-qbnnn\" (UID: \"780e67fb-196e-485a-8aa4-e11cecdc4b63\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qbnnn"
Oct 30 20:37:04.333385 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:04.331245    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ac7adab4-061f-4371-bc6c-96260eb988d8-cni-binary-copy\") pod \"multus-sxqtp\" (UID: \"ac7adab4-061f-4371-bc6c-96260eb988d8\") " pod="openshift-multus/multus-sxqtp"
Oct 30 20:37:04.333385 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:04.331256    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ac7adab4-061f-4371-bc6c-96260eb988d8-multus-conf-dir\") pod \"multus-sxqtp\" (UID: \"ac7adab4-061f-4371-bc6c-96260eb988d8\") " pod="openshift-multus/multus-sxqtp"
Oct 30 20:37:04.333385 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:04.331252    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/1dc89e41-1e32-476f-b5fc-e45945a45efd-etc-systemd\") pod \"tuned-zpr5c\" (UID: \"1dc89e41-1e32-476f-b5fc-e45945a45efd\") " pod="openshift-cluster-node-tuning-operator/tuned-zpr5c"
Oct 30 20:37:04.333385 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:04.331295    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2f9dd030-281c-473e-b441-9ee972019413-cni-binary-copy\") pod \"multus-additional-cni-plugins-hmdcd\" (UID: \"2f9dd030-281c-473e-b441-9ee972019413\") " pod="openshift-multus/multus-additional-cni-plugins-hmdcd"
Oct 30 20:37:04.333385 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:04.331324    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ac7adab4-061f-4371-bc6c-96260eb988d8-cnibin\") pod \"multus-sxqtp\" (UID: \"ac7adab4-061f-4371-bc6c-96260eb988d8\") " pod="openshift-multus/multus-sxqtp"
Oct 30 20:37:04.333385 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:04.331406    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0b7ae038-91bf-40f1-9930-8a6158706a3e-host-run-ovn-kubernetes\") pod \"ovnkube-node-mw7xm\" (UID: \"0b7ae038-91bf-40f1-9930-8a6158706a3e\") " pod="openshift-ovn-kubernetes/ovnkube-node-mw7xm"
Oct 30 20:37:04.333385 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:04.331443    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2f9dd030-281c-473e-b441-9ee972019413-cnibin\") pod \"multus-additional-cni-plugins-hmdcd\" (UID: \"2f9dd030-281c-473e-b441-9ee972019413\") " pod="openshift-multus/multus-additional-cni-plugins-hmdcd"
Oct 30 20:37:04.333385 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:04.331441    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ac7adab4-061f-4371-bc6c-96260eb988d8-system-cni-dir\") pod \"multus-sxqtp\" (UID: \"ac7adab4-061f-4371-bc6c-96260eb988d8\") " pod="openshift-multus/multus-sxqtp"
Oct 30 20:37:04.333385 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:04.331479    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ac7adab4-061f-4371-bc6c-96260eb988d8-multus-conf-dir\") pod \"multus-sxqtp\" (UID: \"ac7adab4-061f-4371-bc6c-96260eb988d8\") " pod="openshift-multus/multus-sxqtp"
Oct 30 20:37:04.333385 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:04.331504    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/780e67fb-196e-485a-8aa4-e11cecdc4b63-kubelet-dir\") pod \"aws-ebs-csi-driver-node-qbnnn\" (UID: \"780e67fb-196e-485a-8aa4-e11cecdc4b63\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qbnnn"
Oct 30 20:37:04.334062 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:04.331543    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ac7adab4-061f-4371-bc6c-96260eb988d8-multus-cni-dir\") pod \"multus-sxqtp\" (UID: \"ac7adab4-061f-4371-bc6c-96260eb988d8\") " pod="openshift-multus/multus-sxqtp"
Oct 30 20:37:04.334062 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:04.331583    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0f424633-11a5-49fa-a933-f9c6ec7ca97e-metrics-certs\") pod \"network-metrics-daemon-mlctd\" (UID: \"0f424633-11a5-49fa-a933-f9c6ec7ca97e\") " pod="openshift-multus/network-metrics-daemon-mlctd"
Oct 30 20:37:04.334062 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:04.331612    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/780e67fb-196e-485a-8aa4-e11cecdc4b63-etc-selinux\") pod \"aws-ebs-csi-driver-node-qbnnn\" (UID: \"780e67fb-196e-485a-8aa4-e11cecdc4b63\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qbnnn"
Oct 30 20:37:04.334062 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:04.331618    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/780e67fb-196e-485a-8aa4-e11cecdc4b63-device-dir\") pod \"aws-ebs-csi-driver-node-qbnnn\" (UID: \"780e67fb-196e-485a-8aa4-e11cecdc4b63\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qbnnn"
Oct 30 20:37:04.334062 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:04.331645    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/0b7ae038-91bf-40f1-9930-8a6158706a3e-log-socket\") pod \"ovnkube-node-mw7xm\" (UID: \"0b7ae038-91bf-40f1-9930-8a6158706a3e\") " pod="openshift-ovn-kubernetes/ovnkube-node-mw7xm"
Oct 30 20:37:04.334062 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:04.331668    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0b7ae038-91bf-40f1-9930-8a6158706a3e-host-cni-bin\") pod \"ovnkube-node-mw7xm\" (UID: \"0b7ae038-91bf-40f1-9930-8a6158706a3e\") " pod="openshift-ovn-kubernetes/ovnkube-node-mw7xm"
Oct 30 20:37:04.334062 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:04.331720    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/0b7ae038-91bf-40f1-9930-8a6158706a3e-host-cni-netd\") pod \"ovnkube-node-mw7xm\" (UID: \"0b7ae038-91bf-40f1-9930-8a6158706a3e\") " pod="openshift-ovn-kubernetes/ovnkube-node-mw7xm"
Oct 30 20:37:04.334062 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:04.331743    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0b7ae038-91bf-40f1-9930-8a6158706a3e-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-mw7xm\" (UID: \"0b7ae038-91bf-40f1-9930-8a6158706a3e\") " pod="openshift-ovn-kubernetes/ovnkube-node-mw7xm"
Oct 30 20:37:04.334062 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:04.331814    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0b7ae038-91bf-40f1-9930-8a6158706a3e-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-mw7xm\" (UID: \"0b7ae038-91bf-40f1-9930-8a6158706a3e\") " pod="openshift-ovn-kubernetes/ovnkube-node-mw7xm"
Oct 30 20:37:04.334062 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:04.331852    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0b7ae038-91bf-40f1-9930-8a6158706a3e-host-cni-bin\") pod \"ovnkube-node-mw7xm\" (UID: \"0b7ae038-91bf-40f1-9930-8a6158706a3e\") " pod="openshift-ovn-kubernetes/ovnkube-node-mw7xm"
Oct 30 20:37:04.334062 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:04.331893    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/ac7adab4-061f-4371-bc6c-96260eb988d8-hostroot\") pod \"multus-sxqtp\" (UID: \"ac7adab4-061f-4371-bc6c-96260eb988d8\") " pod="openshift-multus/multus-sxqtp"
Oct 30 20:37:04.334062 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:04.331937    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/780e67fb-196e-485a-8aa4-e11cecdc4b63-registration-dir\") pod \"aws-ebs-csi-driver-node-qbnnn\" (UID: \"780e67fb-196e-485a-8aa4-e11cecdc4b63\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qbnnn"
Oct 30 20:37:04.334062 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:04.332028    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ac7adab4-061f-4371-bc6c-96260eb988d8-multus-cni-dir\") pod \"multus-sxqtp\" (UID: \"ac7adab4-061f-4371-bc6c-96260eb988d8\") " pod="openshift-multus/multus-sxqtp"
Oct 30 20:37:04.334062 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:04.332043    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/780e67fb-196e-485a-8aa4-e11cecdc4b63-device-dir\") pod \"aws-ebs-csi-driver-node-qbnnn\" (UID: \"780e67fb-196e-485a-8aa4-e11cecdc4b63\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qbnnn"
Oct 30 20:37:04.334062 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:04.332083    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/a4cdc725-3dd0-4917-b8a0-c8ff77a40abb-dbus\") pod \"global-pull-secret-syncer-tvvd9\" (UID: \"a4cdc725-3dd0-4917-b8a0-c8ff77a40abb\") " pod="kube-system/global-pull-secret-syncer-tvvd9"
Oct 30 20:37:04.334062 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:04.332113    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/0b7ae038-91bf-40f1-9930-8a6158706a3e-log-socket\") pod \"ovnkube-node-mw7xm\" (UID: \"0b7ae038-91bf-40f1-9930-8a6158706a3e\") " pod="openshift-ovn-kubernetes/ovnkube-node-mw7xm"
Oct 30 20:37:04.334062 ip-10-0-138-85 kubenswrapper[2577]: E1030 20:37:04.332191    2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 30 20:37:04.334062 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:04.332223    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ac7adab4-061f-4371-bc6c-96260eb988d8-host-var-lib-kubelet\") pod \"multus-sxqtp\" (UID: \"ac7adab4-061f-4371-bc6c-96260eb988d8\") " pod="openshift-multus/multus-sxqtp"
Oct 30 20:37:04.334623 ip-10-0-138-85 kubenswrapper[2577]: E1030 20:37:04.332244    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0f424633-11a5-49fa-a933-f9c6ec7ca97e-metrics-certs podName:0f424633-11a5-49fa-a933-f9c6ec7ca97e nodeName:}" failed. No retries permitted until 2026-10-30 20:37:04.832229135 +0000 UTC m=+2.279024582 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0f424633-11a5-49fa-a933-f9c6ec7ca97e-metrics-certs") pod "network-metrics-daemon-mlctd" (UID: "0f424633-11a5-49fa-a933-f9c6ec7ca97e") : object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 30 20:37:04.334623 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:04.332263    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0b7ae038-91bf-40f1-9930-8a6158706a3e-host-slash\") pod \"ovnkube-node-mw7xm\" (UID: \"0b7ae038-91bf-40f1-9930-8a6158706a3e\") " pod="openshift-ovn-kubernetes/ovnkube-node-mw7xm"
Oct 30 20:37:04.334623 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:04.332307    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/0b7ae038-91bf-40f1-9930-8a6158706a3e-host-cni-netd\") pod \"ovnkube-node-mw7xm\" (UID: \"0b7ae038-91bf-40f1-9930-8a6158706a3e\") " pod="openshift-ovn-kubernetes/ovnkube-node-mw7xm"
Oct 30 20:37:04.334623 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:04.333018    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2f9dd030-281c-473e-b441-9ee972019413-cni-binary-copy\") pod \"multus-additional-cni-plugins-hmdcd\" (UID: \"2f9dd030-281c-473e-b441-9ee972019413\") " pod="openshift-multus/multus-additional-cni-plugins-hmdcd"
Oct 30 20:37:04.334623 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:04.333722    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/0b7ae038-91bf-40f1-9930-8a6158706a3e-ovn-node-metrics-cert\") pod \"ovnkube-node-mw7xm\" (UID: \"0b7ae038-91bf-40f1-9930-8a6158706a3e\") " pod="openshift-ovn-kubernetes/ovnkube-node-mw7xm"
Oct 30 20:37:04.334623 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:04.333722    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/1dc89e41-1e32-476f-b5fc-e45945a45efd-etc-tuned\") pod \"tuned-zpr5c\" (UID: \"1dc89e41-1e32-476f-b5fc-e45945a45efd\") " pod="openshift-cluster-node-tuning-operator/tuned-zpr5c"
Oct 30 20:37:04.334623 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:04.333765    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1dc89e41-1e32-476f-b5fc-e45945a45efd-tmp\") pod \"tuned-zpr5c\" (UID: \"1dc89e41-1e32-476f-b5fc-e45945a45efd\") " pod="openshift-cluster-node-tuning-operator/tuned-zpr5c"
Oct 30 20:37:04.334623 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:04.333937    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/ef128f2b-0a66-4c2d-a969-6197e0f82c58-agent-certs\") pod \"konnectivity-agent-x6f58\" (UID: \"ef128f2b-0a66-4c2d-a969-6197e0f82c58\") " pod="kube-system/konnectivity-agent-x6f58"
Oct 30 20:37:04.387457 ip-10-0-138-85 kubenswrapper[2577]: E1030 20:37:04.387390    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Oct 30 20:37:04.387457 ip-10-0-138-85 kubenswrapper[2577]: E1030 20:37:04.387419    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Oct 30 20:37:04.387457 ip-10-0-138-85 kubenswrapper[2577]: E1030 20:37:04.387434    2577 projected.go:196] Error preparing data for projected volume kube-api-access-7qzv8 for pod openshift-network-diagnostics/network-check-target-lqdtq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 30 20:37:04.387671 ip-10-0-138-85 kubenswrapper[2577]: E1030 20:37:04.387502    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/50e37bd4-e46f-4577-b7b2-1ac7695637ea-kube-api-access-7qzv8 podName:50e37bd4-e46f-4577-b7b2-1ac7695637ea nodeName:}" failed. No retries permitted until 2026-10-30 20:37:04.887481274 +0000 UTC m=+2.334276722 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-7qzv8" (UniqueName: "kubernetes.io/projected/50e37bd4-e46f-4577-b7b2-1ac7695637ea-kube-api-access-7qzv8") pod "network-check-target-lqdtq" (UID: "50e37bd4-e46f-4577-b7b2-1ac7695637ea") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 30 20:37:04.390252 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:04.390208    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zkkqp\" (UniqueName: \"kubernetes.io/projected/b2dae567-b378-41ed-9f7e-881153b7d03b-kube-api-access-zkkqp\") pod \"iptables-alerter-cll8f\" (UID: \"b2dae567-b378-41ed-9f7e-881153b7d03b\") " pod="openshift-network-operator/iptables-alerter-cll8f"
Oct 30 20:37:04.390252 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:04.390240    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c2w8k\" (UniqueName: \"kubernetes.io/projected/16e71e18-453a-41bf-a3f8-9618482c9a50-kube-api-access-c2w8k\") pod \"node-resolver-t4227\" (UID: \"16e71e18-453a-41bf-a3f8-9618482c9a50\") " pod="openshift-dns/node-resolver-t4227"
Oct 30 20:37:04.390426 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:04.390310    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mh8k8\" (UniqueName: \"kubernetes.io/projected/0b7ae038-91bf-40f1-9930-8a6158706a3e-kube-api-access-mh8k8\") pod \"ovnkube-node-mw7xm\" (UID: \"0b7ae038-91bf-40f1-9930-8a6158706a3e\") " pod="openshift-ovn-kubernetes/ovnkube-node-mw7xm"
Oct 30 20:37:04.390518 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:04.390493    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mwd9g\" (UniqueName: \"kubernetes.io/projected/ac7adab4-061f-4371-bc6c-96260eb988d8-kube-api-access-mwd9g\") pod \"multus-sxqtp\" (UID: \"ac7adab4-061f-4371-bc6c-96260eb988d8\") " pod="openshift-multus/multus-sxqtp"
Oct 30 20:37:04.393512 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:04.393482    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wc2mp\" (UniqueName: \"kubernetes.io/projected/1dc89e41-1e32-476f-b5fc-e45945a45efd-kube-api-access-wc2mp\") pod \"tuned-zpr5c\" (UID: \"1dc89e41-1e32-476f-b5fc-e45945a45efd\") " pod="openshift-cluster-node-tuning-operator/tuned-zpr5c"
Oct 30 20:37:04.393512 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:04.393504    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-49sfp\" (UniqueName: \"kubernetes.io/projected/780e67fb-196e-485a-8aa4-e11cecdc4b63-kube-api-access-49sfp\") pod \"aws-ebs-csi-driver-node-qbnnn\" (UID: \"780e67fb-196e-485a-8aa4-e11cecdc4b63\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qbnnn"
Oct 30 20:37:04.393654 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:04.393484    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-79wpr\" (UniqueName: \"kubernetes.io/projected/4179c36b-8003-46e5-82b0-67f6edea7553-kube-api-access-79wpr\") pod \"node-ca-jnn4r\" (UID: \"4179c36b-8003-46e5-82b0-67f6edea7553\") " pod="openshift-image-registry/node-ca-jnn4r"
Oct 30 20:37:04.393654 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:04.393545    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lq6t2\" (UniqueName: \"kubernetes.io/projected/0f424633-11a5-49fa-a933-f9c6ec7ca97e-kube-api-access-lq6t2\") pod \"network-metrics-daemon-mlctd\" (UID: \"0f424633-11a5-49fa-a933-f9c6ec7ca97e\") " pod="openshift-multus/network-metrics-daemon-mlctd"
Oct 30 20:37:04.393654 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:04.393575    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-48plj\" (UniqueName: \"kubernetes.io/projected/2f9dd030-281c-473e-b441-9ee972019413-kube-api-access-48plj\") pod \"multus-additional-cni-plugins-hmdcd\" (UID: \"2f9dd030-281c-473e-b441-9ee972019413\") " pod="openshift-multus/multus-additional-cni-plugins-hmdcd"
Oct 30 20:37:04.531368 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:04.531343    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-jnn4r"
Oct 30 20:37:04.544904 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:04.544880    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-zpr5c"
Oct 30 20:37:04.565930 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:04.565911    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-x6f58"
Oct 30 20:37:04.580745 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:04.580723    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-cll8f"
Oct 30 20:37:04.605709 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:04.605646    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-hmdcd"
Oct 30 20:37:04.611901 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:04.611876    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qbnnn"
Oct 30 20:37:04.619115 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:04.619089    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-sxqtp"
Oct 30 20:37:04.624846 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:04.624822    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-t4227"
Oct 30 20:37:04.661253 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:04.661194    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-mw7xm"
Oct 30 20:37:04.714918 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:04.714877    2577 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6d131c2bf86bd4364de095ada64f40ce.slice/crio-4b0bf6d5013068d8bbb0e5ea418174eb6ed04e5fe648b32719858885afa323e1 WatchSource:0}: Error finding container 4b0bf6d5013068d8bbb0e5ea418174eb6ed04e5fe648b32719858885afa323e1: Status 404 returned error can't find the container with id 4b0bf6d5013068d8bbb0e5ea418174eb6ed04e5fe648b32719858885afa323e1
Oct 30 20:37:04.715604 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:04.715567    2577 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0b7ae038_91bf_40f1_9930_8a6158706a3e.slice/crio-66145fbcb03e7b18dcbe92eb181e4fb803aaee858de607365c278692a620f912 WatchSource:0}: Error finding container 66145fbcb03e7b18dcbe92eb181e4fb803aaee858de607365c278692a620f912: Status 404 returned error can't find the container with id 66145fbcb03e7b18dcbe92eb181e4fb803aaee858de607365c278692a620f912
Oct 30 20:37:04.718456 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:04.718427    2577 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9d0b6e5dd2bbef8c0c7895485f0fdbd3.slice/crio-baeacfc304391a12cde769f20bf03da6002f7385c5a2080b0648c42526e4bc00 WatchSource:0}: Error finding container baeacfc304391a12cde769f20bf03da6002f7385c5a2080b0648c42526e4bc00: Status 404 returned error can't find the container with id baeacfc304391a12cde769f20bf03da6002f7385c5a2080b0648c42526e4bc00
Oct 30 20:37:04.721569 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:04.721551    2577 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Oct 30 20:37:04.834715 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:04.834683    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a4cdc725-3dd0-4917-b8a0-c8ff77a40abb-original-pull-secret\") pod \"global-pull-secret-syncer-tvvd9\" (UID: \"a4cdc725-3dd0-4917-b8a0-c8ff77a40abb\") " pod="kube-system/global-pull-secret-syncer-tvvd9"
Oct 30 20:37:04.834715 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:04.834724    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0f424633-11a5-49fa-a933-f9c6ec7ca97e-metrics-certs\") pod \"network-metrics-daemon-mlctd\" (UID: \"0f424633-11a5-49fa-a933-f9c6ec7ca97e\") " pod="openshift-multus/network-metrics-daemon-mlctd"
Oct 30 20:37:04.834950 ip-10-0-138-85 kubenswrapper[2577]: E1030 20:37:04.834842    2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 30 20:37:04.834950 ip-10-0-138-85 kubenswrapper[2577]: E1030 20:37:04.834861    2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Oct 30 20:37:04.834950 ip-10-0-138-85 kubenswrapper[2577]: E1030 20:37:04.834907    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0f424633-11a5-49fa-a933-f9c6ec7ca97e-metrics-certs podName:0f424633-11a5-49fa-a933-f9c6ec7ca97e nodeName:}" failed. No retries permitted until 2026-10-30 20:37:05.834888946 +0000 UTC m=+3.281684389 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0f424633-11a5-49fa-a933-f9c6ec7ca97e-metrics-certs") pod "network-metrics-daemon-mlctd" (UID: "0f424633-11a5-49fa-a933-f9c6ec7ca97e") : object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 30 20:37:04.834950 ip-10-0-138-85 kubenswrapper[2577]: E1030 20:37:04.834926    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a4cdc725-3dd0-4917-b8a0-c8ff77a40abb-original-pull-secret podName:a4cdc725-3dd0-4917-b8a0-c8ff77a40abb nodeName:}" failed. No retries permitted until 2026-10-30 20:37:05.834916716 +0000 UTC m=+3.281712145 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a4cdc725-3dd0-4917-b8a0-c8ff77a40abb-original-pull-secret") pod "global-pull-secret-syncer-tvvd9" (UID: "a4cdc725-3dd0-4917-b8a0-c8ff77a40abb") : object "kube-system"/"original-pull-secret" not registered
Oct 30 20:37:04.935748 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:04.935661    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7qzv8\" (UniqueName: \"kubernetes.io/projected/50e37bd4-e46f-4577-b7b2-1ac7695637ea-kube-api-access-7qzv8\") pod \"network-check-target-lqdtq\" (UID: \"50e37bd4-e46f-4577-b7b2-1ac7695637ea\") " pod="openshift-network-diagnostics/network-check-target-lqdtq"
Oct 30 20:37:04.936374 ip-10-0-138-85 kubenswrapper[2577]: E1030 20:37:04.935836    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Oct 30 20:37:04.936374 ip-10-0-138-85 kubenswrapper[2577]: E1030 20:37:04.935861    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Oct 30 20:37:04.936374 ip-10-0-138-85 kubenswrapper[2577]: E1030 20:37:04.935872    2577 projected.go:196] Error preparing data for projected volume kube-api-access-7qzv8 for pod openshift-network-diagnostics/network-check-target-lqdtq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 30 20:37:04.936374 ip-10-0-138-85 kubenswrapper[2577]: E1030 20:37:04.935930    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/50e37bd4-e46f-4577-b7b2-1ac7695637ea-kube-api-access-7qzv8 podName:50e37bd4-e46f-4577-b7b2-1ac7695637ea nodeName:}" failed. No retries permitted until 2026-10-30 20:37:05.935916212 +0000 UTC m=+3.382711654 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-7qzv8" (UniqueName: "kubernetes.io/projected/50e37bd4-e46f-4577-b7b2-1ac7695637ea-kube-api-access-7qzv8") pod "network-check-target-lqdtq" (UID: "50e37bd4-e46f-4577-b7b2-1ac7695637ea") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 30 20:37:05.049384 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:05.049323    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-85.us-west-1.compute.internal" event={"ID":"9d0b6e5dd2bbef8c0c7895485f0fdbd3","Type":"ContainerStarted","Data":"baeacfc304391a12cde769f20bf03da6002f7385c5a2080b0648c42526e4bc00"}
Oct 30 20:37:05.050528 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:05.050501    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-85.us-west-1.compute.internal" event={"ID":"6d131c2bf86bd4364de095ada64f40ce","Type":"ContainerStarted","Data":"4b0bf6d5013068d8bbb0e5ea418174eb6ed04e5fe648b32719858885afa323e1"}
Oct 30 20:37:05.051738 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:05.051715    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mw7xm" event={"ID":"0b7ae038-91bf-40f1-9930-8a6158706a3e","Type":"ContainerStarted","Data":"66145fbcb03e7b18dcbe92eb181e4fb803aaee858de607365c278692a620f912"}
Oct 30 20:37:05.126276 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:05.126247    2577 reflector.go:446] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:161"
Oct 30 20:37:05.307068 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:05.306953    2577 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-10-29 20:32:04 +0000 UTC" deadline="2028-07-08 11:48:33.489118392 +0000 UTC"
Oct 30 20:37:05.307068 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:05.306996    2577 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14799h11m28.182124851s"
Oct 30 20:37:05.311220 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:05.311193    2577 reflector.go:446] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:161"
Oct 30 20:37:05.373671 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:05.373641    2577 reflector.go:446] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:161"
Oct 30 20:37:05.436932 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:05.436893    2577 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb2dae567_b378_41ed_9f7e_881153b7d03b.slice/crio-7464cdd104d1f5884d27de3ec909a225235235639e60bfb30473f7d70141fa42 WatchSource:0}: Error finding container 7464cdd104d1f5884d27de3ec909a225235235639e60bfb30473f7d70141fa42: Status 404 returned error can't find the container with id 7464cdd104d1f5884d27de3ec909a225235235639e60bfb30473f7d70141fa42
Oct 30 20:37:05.503735 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:05.503698    2577 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod16e71e18_453a_41bf_a3f8_9618482c9a50.slice/crio-6c147cd2e985b08382d5544ea140b781216100fb882810c0ace9cb47679cdccd WatchSource:0}: Error finding container 6c147cd2e985b08382d5544ea140b781216100fb882810c0ace9cb47679cdccd: Status 404 returned error can't find the container with id 6c147cd2e985b08382d5544ea140b781216100fb882810c0ace9cb47679cdccd
Oct 30 20:37:05.506625 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:05.506605    2577 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod780e67fb_196e_485a_8aa4_e11cecdc4b63.slice/crio-722d8048419608895a084525c22623910879d39fcee62a3b68e720e5acefbcc5 WatchSource:0}: Error finding container 722d8048419608895a084525c22623910879d39fcee62a3b68e720e5acefbcc5: Status 404 returned error can't find the container with id 722d8048419608895a084525c22623910879d39fcee62a3b68e720e5acefbcc5
Oct 30 20:37:05.507449 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:05.507429    2577 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1dc89e41_1e32_476f_b5fc_e45945a45efd.slice/crio-f6a3c1a1adedc04a457eecb77ec19ebc70a5035bc1c537a41fe4c624b75744ba WatchSource:0}: Error finding container f6a3c1a1adedc04a457eecb77ec19ebc70a5035bc1c537a41fe4c624b75744ba: Status 404 returned error can't find the container with id f6a3c1a1adedc04a457eecb77ec19ebc70a5035bc1c537a41fe4c624b75744ba
Oct 30 20:37:05.525411 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:05.525354    2577 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podef128f2b_0a66_4c2d_a969_6197e0f82c58.slice/crio-4098327b09c725e4b0c5dd15ca8b971b63d1118afac841b02f631d8b8eb7e440 WatchSource:0}: Error finding container 4098327b09c725e4b0c5dd15ca8b971b63d1118afac841b02f631d8b8eb7e440: Status 404 returned error can't find the container with id 4098327b09c725e4b0c5dd15ca8b971b63d1118afac841b02f631d8b8eb7e440
Oct 30 20:37:05.552380 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:05.552358    2577 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podac7adab4_061f_4371_bc6c_96260eb988d8.slice/crio-215a0f06b1ba627125a24388fe9d4c7883735f82bd784a859c0c6a9ae57b9599 WatchSource:0}: Error finding container 215a0f06b1ba627125a24388fe9d4c7883735f82bd784a859c0c6a9ae57b9599: Status 404 returned error can't find the container with id 215a0f06b1ba627125a24388fe9d4c7883735f82bd784a859c0c6a9ae57b9599
Oct 30 20:37:05.660331 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:05.660302    2577 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2f9dd030_281c_473e_b441_9ee972019413.slice/crio-19a86db780d09c50b7bb6f7d99b809986121c52c5fbdbca19debbd58212fb6e4 WatchSource:0}: Error finding container 19a86db780d09c50b7bb6f7d99b809986121c52c5fbdbca19debbd58212fb6e4: Status 404 returned error can't find the container with id 19a86db780d09c50b7bb6f7d99b809986121c52c5fbdbca19debbd58212fb6e4
Oct 30 20:37:05.842666 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:05.842617    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a4cdc725-3dd0-4917-b8a0-c8ff77a40abb-original-pull-secret\") pod \"global-pull-secret-syncer-tvvd9\" (UID: \"a4cdc725-3dd0-4917-b8a0-c8ff77a40abb\") " pod="kube-system/global-pull-secret-syncer-tvvd9"
Oct 30 20:37:05.842841 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:05.842691    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0f424633-11a5-49fa-a933-f9c6ec7ca97e-metrics-certs\") pod \"network-metrics-daemon-mlctd\" (UID: \"0f424633-11a5-49fa-a933-f9c6ec7ca97e\") " pod="openshift-multus/network-metrics-daemon-mlctd"
Oct 30 20:37:05.842841 ip-10-0-138-85 kubenswrapper[2577]: E1030 20:37:05.842820    2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 30 20:37:05.842841 ip-10-0-138-85 kubenswrapper[2577]: E1030 20:37:05.842822    2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Oct 30 20:37:05.843023 ip-10-0-138-85 kubenswrapper[2577]: E1030 20:37:05.842883    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0f424633-11a5-49fa-a933-f9c6ec7ca97e-metrics-certs podName:0f424633-11a5-49fa-a933-f9c6ec7ca97e nodeName:}" failed. No retries permitted until 2026-10-30 20:37:07.842864612 +0000 UTC m=+5.289660044 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0f424633-11a5-49fa-a933-f9c6ec7ca97e-metrics-certs") pod "network-metrics-daemon-mlctd" (UID: "0f424633-11a5-49fa-a933-f9c6ec7ca97e") : object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 30 20:37:05.843023 ip-10-0-138-85 kubenswrapper[2577]: E1030 20:37:05.842934    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a4cdc725-3dd0-4917-b8a0-c8ff77a40abb-original-pull-secret podName:a4cdc725-3dd0-4917-b8a0-c8ff77a40abb nodeName:}" failed. No retries permitted until 2026-10-30 20:37:07.842915384 +0000 UTC m=+5.289710826 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a4cdc725-3dd0-4917-b8a0-c8ff77a40abb-original-pull-secret") pod "global-pull-secret-syncer-tvvd9" (UID: "a4cdc725-3dd0-4917-b8a0-c8ff77a40abb") : object "kube-system"/"original-pull-secret" not registered
Oct 30 20:37:05.943590 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:05.943500    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7qzv8\" (UniqueName: \"kubernetes.io/projected/50e37bd4-e46f-4577-b7b2-1ac7695637ea-kube-api-access-7qzv8\") pod \"network-check-target-lqdtq\" (UID: \"50e37bd4-e46f-4577-b7b2-1ac7695637ea\") " pod="openshift-network-diagnostics/network-check-target-lqdtq"
Oct 30 20:37:05.944235 ip-10-0-138-85 kubenswrapper[2577]: E1030 20:37:05.943690    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Oct 30 20:37:05.944235 ip-10-0-138-85 kubenswrapper[2577]: E1030 20:37:05.943710    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Oct 30 20:37:05.944235 ip-10-0-138-85 kubenswrapper[2577]: E1030 20:37:05.943720    2577 projected.go:196] Error preparing data for projected volume kube-api-access-7qzv8 for pod openshift-network-diagnostics/network-check-target-lqdtq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 30 20:37:05.944235 ip-10-0-138-85 kubenswrapper[2577]: E1030 20:37:05.943791    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/50e37bd4-e46f-4577-b7b2-1ac7695637ea-kube-api-access-7qzv8 podName:50e37bd4-e46f-4577-b7b2-1ac7695637ea nodeName:}" failed. No retries permitted until 2026-10-30 20:37:07.943773066 +0000 UTC m=+5.390568502 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-7qzv8" (UniqueName: "kubernetes.io/projected/50e37bd4-e46f-4577-b7b2-1ac7695637ea-kube-api-access-7qzv8") pod "network-check-target-lqdtq" (UID: "50e37bd4-e46f-4577-b7b2-1ac7695637ea") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 30 20:37:06.044639 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:06.044595    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lqdtq"
Oct 30 20:37:06.044807 ip-10-0-138-85 kubenswrapper[2577]: E1030 20:37:06.044725    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lqdtq" podUID="50e37bd4-e46f-4577-b7b2-1ac7695637ea"
Oct 30 20:37:06.045099 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:06.045074    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tvvd9"
Oct 30 20:37:06.045210 ip-10-0-138-85 kubenswrapper[2577]: E1030 20:37:06.045179    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tvvd9" podUID="a4cdc725-3dd0-4917-b8a0-c8ff77a40abb"
Oct 30 20:37:06.045261 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:06.045254    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mlctd"
Oct 30 20:37:06.045322 ip-10-0-138-85 kubenswrapper[2577]: E1030 20:37:06.045308    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mlctd" podUID="0f424633-11a5-49fa-a933-f9c6ec7ca97e"
Oct 30 20:37:06.059164 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:06.059085    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hmdcd" event={"ID":"2f9dd030-281c-473e-b441-9ee972019413","Type":"ContainerStarted","Data":"19a86db780d09c50b7bb6f7d99b809986121c52c5fbdbca19debbd58212fb6e4"}
Oct 30 20:37:06.061437 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:06.061400    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-zpr5c" event={"ID":"1dc89e41-1e32-476f-b5fc-e45945a45efd","Type":"ContainerStarted","Data":"f6a3c1a1adedc04a457eecb77ec19ebc70a5035bc1c537a41fe4c624b75744ba"}
Oct 30 20:37:06.063439 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:06.063407    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qbnnn" event={"ID":"780e67fb-196e-485a-8aa4-e11cecdc4b63","Type":"ContainerStarted","Data":"722d8048419608895a084525c22623910879d39fcee62a3b68e720e5acefbcc5"}
Oct 30 20:37:06.065078 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:06.065051    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-t4227" event={"ID":"16e71e18-453a-41bf-a3f8-9618482c9a50","Type":"ContainerStarted","Data":"6c147cd2e985b08382d5544ea140b781216100fb882810c0ace9cb47679cdccd"}
Oct 30 20:37:06.067795 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:06.067766    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-jnn4r" event={"ID":"4179c36b-8003-46e5-82b0-67f6edea7553","Type":"ContainerStarted","Data":"3ee5674fefa80f861ac99efaff539b30317b132fd15d163a51175201cc743941"}
Oct 30 20:37:06.069924 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:06.069898    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-sxqtp" event={"ID":"ac7adab4-061f-4371-bc6c-96260eb988d8","Type":"ContainerStarted","Data":"215a0f06b1ba627125a24388fe9d4c7883735f82bd784a859c0c6a9ae57b9599"}
Oct 30 20:37:06.071722 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:06.071672    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-x6f58" event={"ID":"ef128f2b-0a66-4c2d-a969-6197e0f82c58","Type":"ContainerStarted","Data":"4098327b09c725e4b0c5dd15ca8b971b63d1118afac841b02f631d8b8eb7e440"}
Oct 30 20:37:06.073216 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:06.073161    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-cll8f" event={"ID":"b2dae567-b378-41ed-9f7e-881153b7d03b","Type":"ContainerStarted","Data":"7464cdd104d1f5884d27de3ec909a225235235639e60bfb30473f7d70141fa42"}
Oct 30 20:37:06.307633 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:06.307513    2577 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-10-29 20:32:04 +0000 UTC" deadline="2028-05-23 18:42:22.543979754 +0000 UTC"
Oct 30 20:37:06.307633 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:06.307582    2577 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13702h5m16.236402567s"
Oct 30 20:37:07.862052 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:07.861602    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a4cdc725-3dd0-4917-b8a0-c8ff77a40abb-original-pull-secret\") pod \"global-pull-secret-syncer-tvvd9\" (UID: \"a4cdc725-3dd0-4917-b8a0-c8ff77a40abb\") " pod="kube-system/global-pull-secret-syncer-tvvd9"
Oct 30 20:37:07.862052 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:07.861661    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0f424633-11a5-49fa-a933-f9c6ec7ca97e-metrics-certs\") pod \"network-metrics-daemon-mlctd\" (UID: \"0f424633-11a5-49fa-a933-f9c6ec7ca97e\") " pod="openshift-multus/network-metrics-daemon-mlctd"
Oct 30 20:37:07.862052 ip-10-0-138-85 kubenswrapper[2577]: E1030 20:37:07.861798    2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 30 20:37:07.862052 ip-10-0-138-85 kubenswrapper[2577]: E1030 20:37:07.861863    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0f424633-11a5-49fa-a933-f9c6ec7ca97e-metrics-certs podName:0f424633-11a5-49fa-a933-f9c6ec7ca97e nodeName:}" failed. No retries permitted until 2026-10-30 20:37:11.861840688 +0000 UTC m=+9.308636143 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0f424633-11a5-49fa-a933-f9c6ec7ca97e-metrics-certs") pod "network-metrics-daemon-mlctd" (UID: "0f424633-11a5-49fa-a933-f9c6ec7ca97e") : object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 30 20:37:07.862052 ip-10-0-138-85 kubenswrapper[2577]: E1030 20:37:07.861937    2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Oct 30 20:37:07.862052 ip-10-0-138-85 kubenswrapper[2577]: E1030 20:37:07.861975    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a4cdc725-3dd0-4917-b8a0-c8ff77a40abb-original-pull-secret podName:a4cdc725-3dd0-4917-b8a0-c8ff77a40abb nodeName:}" failed. No retries permitted until 2026-10-30 20:37:11.861962528 +0000 UTC m=+9.308757960 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a4cdc725-3dd0-4917-b8a0-c8ff77a40abb-original-pull-secret") pod "global-pull-secret-syncer-tvvd9" (UID: "a4cdc725-3dd0-4917-b8a0-c8ff77a40abb") : object "kube-system"/"original-pull-secret" not registered
Oct 30 20:37:07.962148 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:07.962115    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7qzv8\" (UniqueName: \"kubernetes.io/projected/50e37bd4-e46f-4577-b7b2-1ac7695637ea-kube-api-access-7qzv8\") pod \"network-check-target-lqdtq\" (UID: \"50e37bd4-e46f-4577-b7b2-1ac7695637ea\") " pod="openshift-network-diagnostics/network-check-target-lqdtq"
Oct 30 20:37:07.962318 ip-10-0-138-85 kubenswrapper[2577]: E1030 20:37:07.962287    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Oct 30 20:37:07.962318 ip-10-0-138-85 kubenswrapper[2577]: E1030 20:37:07.962306    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Oct 30 20:37:07.962318 ip-10-0-138-85 kubenswrapper[2577]: E1030 20:37:07.962318    2577 projected.go:196] Error preparing data for projected volume kube-api-access-7qzv8 for pod openshift-network-diagnostics/network-check-target-lqdtq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 30 20:37:07.962509 ip-10-0-138-85 kubenswrapper[2577]: E1030 20:37:07.962383    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/50e37bd4-e46f-4577-b7b2-1ac7695637ea-kube-api-access-7qzv8 podName:50e37bd4-e46f-4577-b7b2-1ac7695637ea nodeName:}" failed. No retries permitted until 2026-10-30 20:37:11.962363764 +0000 UTC m=+9.409159194 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-7qzv8" (UniqueName: "kubernetes.io/projected/50e37bd4-e46f-4577-b7b2-1ac7695637ea-kube-api-access-7qzv8") pod "network-check-target-lqdtq" (UID: "50e37bd4-e46f-4577-b7b2-1ac7695637ea") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 30 20:37:08.044598 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:08.044563    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mlctd"
Oct 30 20:37:08.044803 ip-10-0-138-85 kubenswrapper[2577]: E1030 20:37:08.044718    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mlctd" podUID="0f424633-11a5-49fa-a933-f9c6ec7ca97e"
Oct 30 20:37:08.044803 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:08.044797    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lqdtq"
Oct 30 20:37:08.044933 ip-10-0-138-85 kubenswrapper[2577]: E1030 20:37:08.044874    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lqdtq" podUID="50e37bd4-e46f-4577-b7b2-1ac7695637ea"
Oct 30 20:37:08.044933 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:08.044925    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tvvd9"
Oct 30 20:37:08.045077 ip-10-0-138-85 kubenswrapper[2577]: E1030 20:37:08.045002    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tvvd9" podUID="a4cdc725-3dd0-4917-b8a0-c8ff77a40abb"
Oct 30 20:37:10.044866 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:10.044598    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mlctd"
Oct 30 20:37:10.045388 ip-10-0-138-85 kubenswrapper[2577]: E1030 20:37:10.044990    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mlctd" podUID="0f424633-11a5-49fa-a933-f9c6ec7ca97e"
Oct 30 20:37:10.045388 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:10.045067    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lqdtq"
Oct 30 20:37:10.045388 ip-10-0-138-85 kubenswrapper[2577]: E1030 20:37:10.045176    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lqdtq" podUID="50e37bd4-e46f-4577-b7b2-1ac7695637ea"
Oct 30 20:37:10.045388 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:10.045246    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tvvd9"
Oct 30 20:37:10.045388 ip-10-0-138-85 kubenswrapper[2577]: E1030 20:37:10.045322    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tvvd9" podUID="a4cdc725-3dd0-4917-b8a0-c8ff77a40abb"
Oct 30 20:37:10.108109 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:10.108019    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-85.us-west-1.compute.internal" event={"ID":"9d0b6e5dd2bbef8c0c7895485f0fdbd3","Type":"ContainerStarted","Data":"c6ccd2f9553467ccd1133df809340b330acb33462497e0da19eaccb6cbcec801"}
Oct 30 20:37:10.125172 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:10.124378    2577 generic.go:356] "Generic (PLEG): container finished" podID="6d131c2bf86bd4364de095ada64f40ce" containerID="e8ad48ff7218f2aa51c17dca1a57032d5a2832a3c3abb3dc3466b0c58c7a4c22" exitCode=0
Oct 30 20:37:10.125172 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:10.124466    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-85.us-west-1.compute.internal" event={"ID":"6d131c2bf86bd4364de095ada64f40ce","Type":"ContainerDied","Data":"e8ad48ff7218f2aa51c17dca1a57032d5a2832a3c3abb3dc3466b0c58c7a4c22"}
Oct 30 20:37:10.135563 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:10.135388    2577 generic.go:356] "Generic (PLEG): container finished" podID="2f9dd030-281c-473e-b441-9ee972019413" containerID="8fed799fb3e33a8df7fb78987d97a68251079eeb83eff171e6884efdd93e09db" exitCode=0
Oct 30 20:37:10.136533 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:10.136458    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hmdcd" event={"ID":"2f9dd030-281c-473e-b441-9ee972019413","Type":"ContainerDied","Data":"8fed799fb3e33a8df7fb78987d97a68251079eeb83eff171e6884efdd93e09db"}
Oct 30 20:37:10.243021 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:10.242950    2577 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-85.us-west-1.compute.internal" podStartSLOduration=7.242929106 podStartE2EDuration="7.242929106s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 20:37:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:37:10.241756415 +0000 UTC m=+7.688551881" watchObservedRunningTime="2026-10-30 20:37:10.242929106 +0000 UTC m=+7.689724561"
Oct 30 20:37:11.143190 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:11.142597    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-85.us-west-1.compute.internal" event={"ID":"6d131c2bf86bd4364de095ada64f40ce","Type":"ContainerStarted","Data":"51fbfee9ea577070c09bb70f1a0ba8c98892e5eaac6b2c413fdfed693f3dea5a"}
Oct 30 20:37:11.148032 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:11.147870    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-x6f58" event={"ID":"ef128f2b-0a66-4c2d-a969-6197e0f82c58","Type":"ContainerStarted","Data":"71ee510713c5d1d378c27c064bfe758e137dc481358eddcc9bcd01c79d9d3e57"}
Oct 30 20:37:11.392366 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:11.392308    2577 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-85.us-west-1.compute.internal" podStartSLOduration=7.39228382 podStartE2EDuration="7.39228382s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 20:37:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:37:11.266623167 +0000 UTC m=+8.713418622" watchObservedRunningTime="2026-10-30 20:37:11.39228382 +0000 UTC m=+8.839079306"
Oct 30 20:37:11.906367 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:11.906288    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a4cdc725-3dd0-4917-b8a0-c8ff77a40abb-original-pull-secret\") pod \"global-pull-secret-syncer-tvvd9\" (UID: \"a4cdc725-3dd0-4917-b8a0-c8ff77a40abb\") " pod="kube-system/global-pull-secret-syncer-tvvd9"
Oct 30 20:37:11.906367 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:11.906347    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0f424633-11a5-49fa-a933-f9c6ec7ca97e-metrics-certs\") pod \"network-metrics-daemon-mlctd\" (UID: \"0f424633-11a5-49fa-a933-f9c6ec7ca97e\") " pod="openshift-multus/network-metrics-daemon-mlctd"
Oct 30 20:37:11.906609 ip-10-0-138-85 kubenswrapper[2577]: E1030 20:37:11.906474    2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 30 20:37:11.906609 ip-10-0-138-85 kubenswrapper[2577]: E1030 20:37:11.906532    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0f424633-11a5-49fa-a933-f9c6ec7ca97e-metrics-certs podName:0f424633-11a5-49fa-a933-f9c6ec7ca97e nodeName:}" failed. No retries permitted until 2026-10-30 20:37:19.906514973 +0000 UTC m=+17.353310400 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0f424633-11a5-49fa-a933-f9c6ec7ca97e-metrics-certs") pod "network-metrics-daemon-mlctd" (UID: "0f424633-11a5-49fa-a933-f9c6ec7ca97e") : object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 30 20:37:11.906609 ip-10-0-138-85 kubenswrapper[2577]: E1030 20:37:11.906599    2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Oct 30 20:37:11.906768 ip-10-0-138-85 kubenswrapper[2577]: E1030 20:37:11.906632    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a4cdc725-3dd0-4917-b8a0-c8ff77a40abb-original-pull-secret podName:a4cdc725-3dd0-4917-b8a0-c8ff77a40abb nodeName:}" failed. No retries permitted until 2026-10-30 20:37:19.906621305 +0000 UTC m=+17.353416747 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a4cdc725-3dd0-4917-b8a0-c8ff77a40abb-original-pull-secret") pod "global-pull-secret-syncer-tvvd9" (UID: "a4cdc725-3dd0-4917-b8a0-c8ff77a40abb") : object "kube-system"/"original-pull-secret" not registered
Oct 30 20:37:12.006780 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:12.006744    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7qzv8\" (UniqueName: \"kubernetes.io/projected/50e37bd4-e46f-4577-b7b2-1ac7695637ea-kube-api-access-7qzv8\") pod \"network-check-target-lqdtq\" (UID: \"50e37bd4-e46f-4577-b7b2-1ac7695637ea\") " pod="openshift-network-diagnostics/network-check-target-lqdtq"
Oct 30 20:37:12.006944 ip-10-0-138-85 kubenswrapper[2577]: E1030 20:37:12.006920    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Oct 30 20:37:12.006944 ip-10-0-138-85 kubenswrapper[2577]: E1030 20:37:12.006939    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Oct 30 20:37:12.007085 ip-10-0-138-85 kubenswrapper[2577]: E1030 20:37:12.006952    2577 projected.go:196] Error preparing data for projected volume kube-api-access-7qzv8 for pod openshift-network-diagnostics/network-check-target-lqdtq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 30 20:37:12.007085 ip-10-0-138-85 kubenswrapper[2577]: E1030 20:37:12.007010    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/50e37bd4-e46f-4577-b7b2-1ac7695637ea-kube-api-access-7qzv8 podName:50e37bd4-e46f-4577-b7b2-1ac7695637ea nodeName:}" failed. No retries permitted until 2026-10-30 20:37:20.006991241 +0000 UTC m=+17.453786672 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-7qzv8" (UniqueName: "kubernetes.io/projected/50e37bd4-e46f-4577-b7b2-1ac7695637ea-kube-api-access-7qzv8") pod "network-check-target-lqdtq" (UID: "50e37bd4-e46f-4577-b7b2-1ac7695637ea") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 30 20:37:12.044630 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:12.044596    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lqdtq"
Oct 30 20:37:12.044802 ip-10-0-138-85 kubenswrapper[2577]: E1030 20:37:12.044741    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lqdtq" podUID="50e37bd4-e46f-4577-b7b2-1ac7695637ea"
Oct 30 20:37:12.044867 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:12.044814    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tvvd9"
Oct 30 20:37:12.044919 ip-10-0-138-85 kubenswrapper[2577]: E1030 20:37:12.044887    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tvvd9" podUID="a4cdc725-3dd0-4917-b8a0-c8ff77a40abb"
Oct 30 20:37:12.044979 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:12.044945    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mlctd"
Oct 30 20:37:12.045088 ip-10-0-138-85 kubenswrapper[2577]: E1030 20:37:12.045024    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mlctd" podUID="0f424633-11a5-49fa-a933-f9c6ec7ca97e"
Oct 30 20:37:12.151654 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:12.151619    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-jnn4r" event={"ID":"4179c36b-8003-46e5-82b0-67f6edea7553","Type":"ContainerStarted","Data":"92295f49e57a28a7a0abfef14bb7468bf04a2ea3c8653207b2005869adbe1b4e"}
Oct 30 20:37:12.264406 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:12.264349    2577 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-image-registry/node-ca-jnn4r" podStartSLOduration=3.086729203 podStartE2EDuration="9.264329986s" totalImagesPullingTime="6.177600783s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 20:37:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:37:12.263752429 +0000 UTC m=+9.710547879" watchObservedRunningTime="2026-10-30 20:37:12.264329986 +0000 UTC m=+9.711125440"
Oct 30 20:37:12.264683 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:12.264575    2577 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kube-system/konnectivity-agent-x6f58" podStartSLOduration=4.088722715 podStartE2EDuration="9.264565917s" totalImagesPullingTime="5.175843202s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:37:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:37:11.392787008 +0000 UTC m=+8.839582509" watchObservedRunningTime="2026-10-30 20:37:12.264565917 +0000 UTC m=+9.711361367"
Oct 30 20:37:12.916033 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:12.915997    2577 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-x6f58"
Oct 30 20:37:12.916796 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:12.916563    2577 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-x6f58"
Oct 30 20:37:13.158937 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:13.158495    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qbnnn" event={"ID":"780e67fb-196e-485a-8aa4-e11cecdc4b63","Type":"ContainerStarted","Data":"d00b46d59bd7817a690b48b95ee101818679ca8952f7366f079553e3b018247d"}
Oct 30 20:37:14.045120 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:14.045084    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lqdtq"
Oct 30 20:37:14.045289 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:14.045096    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mlctd"
Oct 30 20:37:14.045289 ip-10-0-138-85 kubenswrapper[2577]: E1030 20:37:14.045227    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lqdtq" podUID="50e37bd4-e46f-4577-b7b2-1ac7695637ea"
Oct 30 20:37:14.045289 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:14.045108    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tvvd9"
Oct 30 20:37:14.045443 ip-10-0-138-85 kubenswrapper[2577]: E1030 20:37:14.045306    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mlctd" podUID="0f424633-11a5-49fa-a933-f9c6ec7ca97e"
Oct 30 20:37:14.045443 ip-10-0-138-85 kubenswrapper[2577]: E1030 20:37:14.045366    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tvvd9" podUID="a4cdc725-3dd0-4917-b8a0-c8ff77a40abb"
Oct 30 20:37:14.164002 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:14.163964    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-sxqtp" event={"ID":"ac7adab4-061f-4371-bc6c-96260eb988d8","Type":"ContainerStarted","Data":"ff8fba1444f26a3fb9ec29f27166579bf5f63cad4d9a8b41e0355492e9856553"}
Oct 30 20:37:14.164002 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:14.163991    2577 prober_manager.go:356] "Failed to trigger a manual run" probe="Readiness"
Oct 30 20:37:14.323702 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:14.323635    2577 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-multus/multus-sxqtp" podStartSLOduration=1.8243328970000001 podStartE2EDuration="10.32361302s" totalImagesPullingTime="8.499280123s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 20:37:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:37:14.322846552 +0000 UTC m=+11.769642022" watchObservedRunningTime="2026-10-30 20:37:14.32361302 +0000 UTC m=+11.770408471"
Oct 30 20:37:14.421344 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:14.421299    2577 plugin_watcher.go:201] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Oct 30 20:37:15.056011 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:15.055885    2577 reconciler.go:167] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-10-30T20:37:14.421319292Z","UUID":"e82fc57c-b80a-4481-9c7c-ee1450dbe5a9","Handler":null,"Name":"","Endpoint":""}
Oct 30 20:37:15.057520 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:15.057498    2577 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Oct 30 20:37:15.057640 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:15.057531    2577 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Oct 30 20:37:15.171659 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:15.171580    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qbnnn" event={"ID":"780e67fb-196e-485a-8aa4-e11cecdc4b63","Type":"ContainerStarted","Data":"57eeda4f9df25e8430f2b340bddf0b1fd43e3d1ed9776b776377b47a2966c443"}
Oct 30 20:37:15.174180 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:15.174149    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-t4227" event={"ID":"16e71e18-453a-41bf-a3f8-9618482c9a50","Type":"ContainerStarted","Data":"4fc01b1af9af17a13f4f9aa956bf7e4e0b1dbcfc0331095c0c56bd5733037928"}
Oct 30 20:37:15.178102 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:15.177596    2577 generic.go:356] "Generic (PLEG): container finished" podID="2f9dd030-281c-473e-b441-9ee972019413" containerID="78be589f4c5839c29ad09ffffec86606e4c918149623b04e7fea17fa19017f83" exitCode=0
Oct 30 20:37:15.178102 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:15.178062    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hmdcd" event={"ID":"2f9dd030-281c-473e-b441-9ee972019413","Type":"ContainerDied","Data":"78be589f4c5839c29ad09ffffec86606e4c918149623b04e7fea17fa19017f83"}
Oct 30 20:37:15.288516 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:15.288466    2577 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-dns/node-resolver-t4227" podStartSLOduration=2.162142208 podStartE2EDuration="11.28845245s" totalImagesPullingTime="9.126310242s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 20:37:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:37:15.288396776 +0000 UTC m=+12.735192226" watchObservedRunningTime="2026-10-30 20:37:15.28845245 +0000 UTC m=+12.735247899"
Oct 30 20:37:15.695563 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:15.695531    2577 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-x6f58"
Oct 30 20:37:15.695745 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:15.695675    2577 prober_manager.go:356] "Failed to trigger a manual run" probe="Readiness"
Oct 30 20:37:15.697021 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:15.696831    2577 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-x6f58"
Oct 30 20:37:16.044963 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:16.044737    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lqdtq"
Oct 30 20:37:16.045145 ip-10-0-138-85 kubenswrapper[2577]: E1030 20:37:16.045071    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lqdtq" podUID="50e37bd4-e46f-4577-b7b2-1ac7695637ea"
Oct 30 20:37:16.045145 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:16.044802    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tvvd9"
Oct 30 20:37:16.045145 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:16.044755    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mlctd"
Oct 30 20:37:16.045312 ip-10-0-138-85 kubenswrapper[2577]: E1030 20:37:16.045214    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tvvd9" podUID="a4cdc725-3dd0-4917-b8a0-c8ff77a40abb"
Oct 30 20:37:16.045312 ip-10-0-138-85 kubenswrapper[2577]: E1030 20:37:16.045278    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mlctd" podUID="0f424633-11a5-49fa-a933-f9c6ec7ca97e"
Oct 30 20:37:16.182073 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:16.181800    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-cll8f" event={"ID":"b2dae567-b378-41ed-9f7e-881153b7d03b","Type":"ContainerStarted","Data":"64eba8a734be3081b0aa8e0e39f9b192451ad77d7ed8fc8375d6606a73dbac29"}
Oct 30 20:37:16.184247 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:16.184218    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qbnnn" event={"ID":"780e67fb-196e-485a-8aa4-e11cecdc4b63","Type":"ContainerStarted","Data":"6c68ade704d1fb252b89cae11a5ab0033c3c68d751e11bd05484c461fd501671"}
Oct 30 20:37:16.293553 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:16.293501    2577 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-cll8f" podStartSLOduration=3.517911484 podStartE2EDuration="12.293486777s" totalImagesPullingTime="8.775575293s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 20:37:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:37:16.293206737 +0000 UTC m=+13.740002187" watchObservedRunningTime="2026-10-30 20:37:16.293486777 +0000 UTC m=+13.740282225"
Oct 30 20:37:16.408548 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:16.408497    2577 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qbnnn" podStartSLOduration=2.526096358 podStartE2EDuration="12.408481875s" totalImagesPullingTime="9.882385517s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 20:37:04 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:37:16.408175507 +0000 UTC m=+13.854970968" watchObservedRunningTime="2026-10-30 20:37:16.408481875 +0000 UTC m=+13.855277323"
Oct 30 20:37:17.188949 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:17.188916    2577 generic.go:356] "Generic (PLEG): container finished" podID="2f9dd030-281c-473e-b441-9ee972019413" containerID="205870f3632a68a93dbc03f52f212444ce47e0f51ca4ecebbdec4102249da1d7" exitCode=0
Oct 30 20:37:17.189551 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:17.189012    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hmdcd" event={"ID":"2f9dd030-281c-473e-b441-9ee972019413","Type":"ContainerDied","Data":"205870f3632a68a93dbc03f52f212444ce47e0f51ca4ecebbdec4102249da1d7"}
Oct 30 20:37:17.190828 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:17.190797    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-zpr5c" event={"ID":"1dc89e41-1e32-476f-b5fc-e45945a45efd","Type":"ContainerStarted","Data":"d9d107137dc03fa0be1553acbdf3f20b0012f1d1e9460485aa85816b33118cb0"}
Oct 30 20:37:17.423693 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:17.423631    2577 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-zpr5c" podStartSLOduration=3.39242222 podStartE2EDuration="14.423611951s" totalImagesPullingTime="11.031189731s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 20:37:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:37:17.423491899 +0000 UTC m=+14.870287348" watchObservedRunningTime="2026-10-30 20:37:17.423611951 +0000 UTC m=+14.870407402"
Oct 30 20:37:18.044893 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:18.044859    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lqdtq"
Oct 30 20:37:18.045090 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:18.044944    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mlctd"
Oct 30 20:37:18.045090 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:18.044969    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tvvd9"
Oct 30 20:37:18.045202 ip-10-0-138-85 kubenswrapper[2577]: E1030 20:37:18.045082    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lqdtq" podUID="50e37bd4-e46f-4577-b7b2-1ac7695637ea"
Oct 30 20:37:18.045248 ip-10-0-138-85 kubenswrapper[2577]: E1030 20:37:18.045219    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mlctd" podUID="0f424633-11a5-49fa-a933-f9c6ec7ca97e"
Oct 30 20:37:18.045326 ip-10-0-138-85 kubenswrapper[2577]: E1030 20:37:18.045304    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tvvd9" podUID="a4cdc725-3dd0-4917-b8a0-c8ff77a40abb"
Oct 30 20:37:19.197971 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:19.197931    2577 generic.go:356] "Generic (PLEG): container finished" podID="2f9dd030-281c-473e-b441-9ee972019413" containerID="6846bfad40a692e47a14e8a1a6a67df792dd1b7dffc778004962e314b1b8dcec" exitCode=0
Oct 30 20:37:19.198665 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:19.198012    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hmdcd" event={"ID":"2f9dd030-281c-473e-b441-9ee972019413","Type":"ContainerDied","Data":"6846bfad40a692e47a14e8a1a6a67df792dd1b7dffc778004962e314b1b8dcec"}
Oct 30 20:37:19.969492 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:19.969459    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a4cdc725-3dd0-4917-b8a0-c8ff77a40abb-original-pull-secret\") pod \"global-pull-secret-syncer-tvvd9\" (UID: \"a4cdc725-3dd0-4917-b8a0-c8ff77a40abb\") " pod="kube-system/global-pull-secret-syncer-tvvd9"
Oct 30 20:37:19.969690 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:19.969514    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0f424633-11a5-49fa-a933-f9c6ec7ca97e-metrics-certs\") pod \"network-metrics-daemon-mlctd\" (UID: \"0f424633-11a5-49fa-a933-f9c6ec7ca97e\") " pod="openshift-multus/network-metrics-daemon-mlctd"
Oct 30 20:37:19.969690 ip-10-0-138-85 kubenswrapper[2577]: E1030 20:37:19.969635    2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 30 20:37:19.969690 ip-10-0-138-85 kubenswrapper[2577]: E1030 20:37:19.969687    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0f424633-11a5-49fa-a933-f9c6ec7ca97e-metrics-certs podName:0f424633-11a5-49fa-a933-f9c6ec7ca97e nodeName:}" failed. No retries permitted until 2026-10-30 20:37:35.969669421 +0000 UTC m=+33.416464849 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0f424633-11a5-49fa-a933-f9c6ec7ca97e-metrics-certs") pod "network-metrics-daemon-mlctd" (UID: "0f424633-11a5-49fa-a933-f9c6ec7ca97e") : object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 30 20:37:19.970082 ip-10-0-138-85 kubenswrapper[2577]: E1030 20:37:19.970064    2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Oct 30 20:37:19.970140 ip-10-0-138-85 kubenswrapper[2577]: E1030 20:37:19.970115    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a4cdc725-3dd0-4917-b8a0-c8ff77a40abb-original-pull-secret podName:a4cdc725-3dd0-4917-b8a0-c8ff77a40abb nodeName:}" failed. No retries permitted until 2026-10-30 20:37:35.970105034 +0000 UTC m=+33.416900461 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a4cdc725-3dd0-4917-b8a0-c8ff77a40abb-original-pull-secret") pod "global-pull-secret-syncer-tvvd9" (UID: "a4cdc725-3dd0-4917-b8a0-c8ff77a40abb") : object "kube-system"/"original-pull-secret" not registered
Oct 30 20:37:20.045081 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:20.045036    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lqdtq"
Oct 30 20:37:20.045252 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:20.045061    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tvvd9"
Oct 30 20:37:20.045252 ip-10-0-138-85 kubenswrapper[2577]: E1030 20:37:20.045181    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lqdtq" podUID="50e37bd4-e46f-4577-b7b2-1ac7695637ea"
Oct 30 20:37:20.045252 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:20.045065    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mlctd"
Oct 30 20:37:20.045252 ip-10-0-138-85 kubenswrapper[2577]: E1030 20:37:20.045240    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tvvd9" podUID="a4cdc725-3dd0-4917-b8a0-c8ff77a40abb"
Oct 30 20:37:20.045385 ip-10-0-138-85 kubenswrapper[2577]: E1030 20:37:20.045296    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mlctd" podUID="0f424633-11a5-49fa-a933-f9c6ec7ca97e"
Oct 30 20:37:20.070378 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:20.070348    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7qzv8\" (UniqueName: \"kubernetes.io/projected/50e37bd4-e46f-4577-b7b2-1ac7695637ea-kube-api-access-7qzv8\") pod \"network-check-target-lqdtq\" (UID: \"50e37bd4-e46f-4577-b7b2-1ac7695637ea\") " pod="openshift-network-diagnostics/network-check-target-lqdtq"
Oct 30 20:37:20.070493 ip-10-0-138-85 kubenswrapper[2577]: E1030 20:37:20.070460    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Oct 30 20:37:20.070493 ip-10-0-138-85 kubenswrapper[2577]: E1030 20:37:20.070473    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Oct 30 20:37:20.070493 ip-10-0-138-85 kubenswrapper[2577]: E1030 20:37:20.070483    2577 projected.go:196] Error preparing data for projected volume kube-api-access-7qzv8 for pod openshift-network-diagnostics/network-check-target-lqdtq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 30 20:37:20.070589 ip-10-0-138-85 kubenswrapper[2577]: E1030 20:37:20.070522    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/50e37bd4-e46f-4577-b7b2-1ac7695637ea-kube-api-access-7qzv8 podName:50e37bd4-e46f-4577-b7b2-1ac7695637ea nodeName:}" failed. No retries permitted until 2026-10-30 20:37:36.070509994 +0000 UTC m=+33.517305421 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-7qzv8" (UniqueName: "kubernetes.io/projected/50e37bd4-e46f-4577-b7b2-1ac7695637ea-kube-api-access-7qzv8") pod "network-check-target-lqdtq" (UID: "50e37bd4-e46f-4577-b7b2-1ac7695637ea") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 30 20:37:21.206965 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:21.206718    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mw7xm" event={"ID":"0b7ae038-91bf-40f1-9930-8a6158706a3e","Type":"ContainerStarted","Data":"248b8d8b8772663b52532772c5d0e07194951d714bd260e2c0f492df1b7c43db"}
Oct 30 20:37:21.207454 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:21.207033    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mw7xm" event={"ID":"0b7ae038-91bf-40f1-9930-8a6158706a3e","Type":"ContainerStarted","Data":"480cd02ec8bc9378cb5703e3f92daaeb6f6f68eda3207f4dc9b517dd25f0e8ce"}
Oct 30 20:37:21.207454 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:21.207118    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mw7xm" event={"ID":"0b7ae038-91bf-40f1-9930-8a6158706a3e","Type":"ContainerStarted","Data":"8af8d074497d9b8ecfc7b444a2e0266261ee03c9a62608c7c6c120e997516483"}
Oct 30 20:37:21.207454 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:21.207161    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mw7xm" event={"ID":"0b7ae038-91bf-40f1-9930-8a6158706a3e","Type":"ContainerStarted","Data":"bf4705007971365f4eb7d59ee1e18b4cd4016a38d005ac945b06482bb0fc397b"}
Oct 30 20:37:21.207454 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:21.207194    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mw7xm" event={"ID":"0b7ae038-91bf-40f1-9930-8a6158706a3e","Type":"ContainerStarted","Data":"8259e09d8306e2db3ccb77196217d9e5adccba8104fd2b96c61808b71823c4d4"}
Oct 30 20:37:21.207454 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:21.207221    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mw7xm" event={"ID":"0b7ae038-91bf-40f1-9930-8a6158706a3e","Type":"ContainerStarted","Data":"d1bc33802b7b001a778ee6eba6a4495c25f4f1c731494f306ad5139a3795c55b"}
Oct 30 20:37:22.044792 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:22.044603    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mlctd"
Oct 30 20:37:22.044792 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:22.044638    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tvvd9"
Oct 30 20:37:22.044995 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:22.044689    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lqdtq"
Oct 30 20:37:22.044995 ip-10-0-138-85 kubenswrapper[2577]: E1030 20:37:22.044867    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tvvd9" podUID="a4cdc725-3dd0-4917-b8a0-c8ff77a40abb"
Oct 30 20:37:22.044995 ip-10-0-138-85 kubenswrapper[2577]: E1030 20:37:22.044956    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mlctd" podUID="0f424633-11a5-49fa-a933-f9c6ec7ca97e"
Oct 30 20:37:22.045115 ip-10-0-138-85 kubenswrapper[2577]: E1030 20:37:22.045025    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lqdtq" podUID="50e37bd4-e46f-4577-b7b2-1ac7695637ea"
Oct 30 20:37:22.211168 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:22.211132    2577 generic.go:356] "Generic (PLEG): container finished" podID="2f9dd030-281c-473e-b441-9ee972019413" containerID="05d8adff28950689ccd51498d3bd8f98256639235ca7839379fc7ff75f1e3066" exitCode=0
Oct 30 20:37:22.211632 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:22.211191    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hmdcd" event={"ID":"2f9dd030-281c-473e-b441-9ee972019413","Type":"ContainerDied","Data":"05d8adff28950689ccd51498d3bd8f98256639235ca7839379fc7ff75f1e3066"}
Oct 30 20:37:23.215956 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:23.215914    2577 generic.go:356] "Generic (PLEG): container finished" podID="2f9dd030-281c-473e-b441-9ee972019413" containerID="b4fe46da60d74c6e1a5806c03b9590a55b08598422b2847975ea94df956a91c3" exitCode=0
Oct 30 20:37:23.216408 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:23.215982    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hmdcd" event={"ID":"2f9dd030-281c-473e-b441-9ee972019413","Type":"ContainerDied","Data":"b4fe46da60d74c6e1a5806c03b9590a55b08598422b2847975ea94df956a91c3"}
Oct 30 20:37:24.044561 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:24.044528    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tvvd9"
Oct 30 20:37:24.044729 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:24.044532    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mlctd"
Oct 30 20:37:24.044729 ip-10-0-138-85 kubenswrapper[2577]: E1030 20:37:24.044624    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tvvd9" podUID="a4cdc725-3dd0-4917-b8a0-c8ff77a40abb"
Oct 30 20:37:24.044729 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:24.044648    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lqdtq"
Oct 30 20:37:24.044825 ip-10-0-138-85 kubenswrapper[2577]: E1030 20:37:24.044737    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mlctd" podUID="0f424633-11a5-49fa-a933-f9c6ec7ca97e"
Oct 30 20:37:24.044825 ip-10-0-138-85 kubenswrapper[2577]: E1030 20:37:24.044800    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lqdtq" podUID="50e37bd4-e46f-4577-b7b2-1ac7695637ea"
Oct 30 20:37:24.221133 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:24.221100    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mw7xm" event={"ID":"0b7ae038-91bf-40f1-9930-8a6158706a3e","Type":"ContainerStarted","Data":"7df627d1d6c2f6be50511c02b71567882bb2ff2953c417803efe6d4459cec57b"}
Oct 30 20:37:24.224186 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:24.224160    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hmdcd" event={"ID":"2f9dd030-281c-473e-b441-9ee972019413","Type":"ContainerStarted","Data":"0a3e2a75a947822ea10eb27da2e172d0cdf257b31647fed4ce1dbb8c91057f5c"}
Oct 30 20:37:24.393161 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:24.393067    2577 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-hmdcd" podStartSLOduration=6.986934904 podStartE2EDuration="20.393037414s" totalImagesPullingTime="13.40610251s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 20:37:04 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:37:24.392704002 +0000 UTC m=+21.839499452" watchObservedRunningTime="2026-10-30 20:37:24.393037414 +0000 UTC m=+21.839832862"
Oct 30 20:37:26.044511 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:26.044326    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tvvd9"
Oct 30 20:37:26.045376 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:26.044326    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mlctd"
Oct 30 20:37:26.045376 ip-10-0-138-85 kubenswrapper[2577]: E1030 20:37:26.044581    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tvvd9" podUID="a4cdc725-3dd0-4917-b8a0-c8ff77a40abb"
Oct 30 20:37:26.045376 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:26.044326    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lqdtq"
Oct 30 20:37:26.045376 ip-10-0-138-85 kubenswrapper[2577]: E1030 20:37:26.044654    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mlctd" podUID="0f424633-11a5-49fa-a933-f9c6ec7ca97e"
Oct 30 20:37:26.045376 ip-10-0-138-85 kubenswrapper[2577]: E1030 20:37:26.044709    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lqdtq" podUID="50e37bd4-e46f-4577-b7b2-1ac7695637ea"
Oct 30 20:37:26.232102 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:26.232068    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mw7xm" event={"ID":"0b7ae038-91bf-40f1-9930-8a6158706a3e","Type":"ContainerStarted","Data":"abb4eec652db2a0f11337afb56b675b8cd9469b1791d30b5fcbb902195d0ede2"}
Oct 30 20:37:26.232375 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:26.232351    2577 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-mw7xm"
Oct 30 20:37:26.247787 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:26.247757    2577 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-mw7xm"
Oct 30 20:37:26.535523 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:26.535475    2577 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-mw7xm" podStartSLOduration=6.391614543 podStartE2EDuration="22.535462854s" totalImagesPullingTime="16.143848311s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 20:37:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:37:26.485817791 +0000 UTC m=+23.932613253" watchObservedRunningTime="2026-10-30 20:37:26.535462854 +0000 UTC m=+23.982258303"
Oct 30 20:37:27.234353 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:27.234319    2577 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-mw7xm"
Oct 30 20:37:27.234761 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:27.234400    2577 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-mw7xm"
Oct 30 20:37:27.249003 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:27.248981    2577 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-mw7xm"
Oct 30 20:37:27.987284 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:27.987243    2577 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-lqdtq"]
Oct 30 20:37:27.987472 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:27.987431    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lqdtq"
Oct 30 20:37:27.987539 ip-10-0-138-85 kubenswrapper[2577]: E1030 20:37:27.987520    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lqdtq" podUID="50e37bd4-e46f-4577-b7b2-1ac7695637ea"
Oct 30 20:37:27.991351 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:27.991324    2577 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-tvvd9"]
Oct 30 20:37:27.991456 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:27.991424    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tvvd9"
Oct 30 20:37:27.991512 ip-10-0-138-85 kubenswrapper[2577]: E1030 20:37:27.991497    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tvvd9" podUID="a4cdc725-3dd0-4917-b8a0-c8ff77a40abb"
Oct 30 20:37:27.994639 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:27.994615    2577 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-mlctd"]
Oct 30 20:37:27.994745 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:27.994731    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mlctd"
Oct 30 20:37:27.994860 ip-10-0-138-85 kubenswrapper[2577]: E1030 20:37:27.994839    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mlctd" podUID="0f424633-11a5-49fa-a933-f9c6ec7ca97e"
Oct 30 20:37:30.044612 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:30.044582    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mlctd"
Oct 30 20:37:30.044984 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:30.044594    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lqdtq"
Oct 30 20:37:30.044984 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:30.044605    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tvvd9"
Oct 30 20:37:30.044984 ip-10-0-138-85 kubenswrapper[2577]: E1030 20:37:30.044747    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mlctd" podUID="0f424633-11a5-49fa-a933-f9c6ec7ca97e"
Oct 30 20:37:30.044984 ip-10-0-138-85 kubenswrapper[2577]: E1030 20:37:30.044843    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lqdtq" podUID="50e37bd4-e46f-4577-b7b2-1ac7695637ea"
Oct 30 20:37:30.044984 ip-10-0-138-85 kubenswrapper[2577]: E1030 20:37:30.044908    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tvvd9" podUID="a4cdc725-3dd0-4917-b8a0-c8ff77a40abb"
Oct 30 20:37:32.044688 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:32.044649    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tvvd9"
Oct 30 20:37:32.044688 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:32.044678    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mlctd"
Oct 30 20:37:32.045234 ip-10-0-138-85 kubenswrapper[2577]: E1030 20:37:32.044819    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tvvd9" podUID="a4cdc725-3dd0-4917-b8a0-c8ff77a40abb"
Oct 30 20:37:32.045234 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:32.044860    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lqdtq"
Oct 30 20:37:32.045234 ip-10-0-138-85 kubenswrapper[2577]: E1030 20:37:32.044942    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mlctd" podUID="0f424633-11a5-49fa-a933-f9c6ec7ca97e"
Oct 30 20:37:32.045234 ip-10-0-138-85 kubenswrapper[2577]: E1030 20:37:32.045011    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lqdtq" podUID="50e37bd4-e46f-4577-b7b2-1ac7695637ea"
Oct 30 20:37:34.044540 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:34.044472    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lqdtq"
Oct 30 20:37:34.044881 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:34.044570    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tvvd9"
Oct 30 20:37:34.044881 ip-10-0-138-85 kubenswrapper[2577]: E1030 20:37:34.044582    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lqdtq" podUID="50e37bd4-e46f-4577-b7b2-1ac7695637ea"
Oct 30 20:37:34.044881 ip-10-0-138-85 kubenswrapper[2577]: E1030 20:37:34.044643    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tvvd9" podUID="a4cdc725-3dd0-4917-b8a0-c8ff77a40abb"
Oct 30 20:37:34.044881 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:34.044664    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mlctd"
Oct 30 20:37:34.044881 ip-10-0-138-85 kubenswrapper[2577]: E1030 20:37:34.044762    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mlctd" podUID="0f424633-11a5-49fa-a933-f9c6ec7ca97e"
Oct 30 20:37:34.337664 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:34.337587    2577 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-138-85.us-west-1.compute.internal" event="NodeReady"
Oct 30 20:37:34.337795 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:34.337703    2577 kubelet_node_status.go:477] "Fast updating node status as it just became ready"
Oct 30 20:37:34.435875 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:34.435840    2577 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kube-system/kas-connection-checker-685895c7c9-tvmvh"]
Oct 30 20:37:34.438232 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:34.438211    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kas-connection-checker-685895c7c9-tvmvh"
Oct 30 20:37:34.445473 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:34.445454    2577 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kube-system/kas-connection-checker-685895c7c9-x8fpd"]
Oct 30 20:37:34.447543 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:34.447526    2577 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-86c478bb88-fl89x"]
Oct 30 20:37:34.447655 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:34.447640    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kas-connection-checker-685895c7c9-x8fpd"
Oct 30 20:37:34.449761 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:34.449747    2577 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kube-system/kas-connection-checker-685895c7c9-tpsd4"]
Oct 30 20:37:34.449882 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:34.449866    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-86c478bb88-fl89x"
Oct 30 20:37:34.452327 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:34.452308    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kas-connection-checker-685895c7c9-tpsd4"
Oct 30 20:37:34.456171 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:34.456153    2577 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-5b9d6cdd59-4g6mx"]
Oct 30 20:37:34.458746 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:34.458727    2577 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-mwm8h"]
Oct 30 20:37:34.458902 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:34.458887    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-5b9d6cdd59-4g6mx"
Oct 30 20:37:34.461221 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:34.461201    2577 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-7c4986d449-tvsdw"]
Oct 30 20:37:34.461314 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:34.461297    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-mwm8h"
Oct 30 20:37:34.463688 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:34.463647    2577 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-7d57c"]
Oct 30 20:37:34.463758 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:34.463736    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-7c4986d449-tvsdw"
Oct 30 20:37:34.466561 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:34.466541    2577 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-884576c57-fl7nf"]
Oct 30 20:37:34.466981 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:34.466968    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-7d57c"
Oct 30 20:37:34.469038 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:34.469017    2577 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-556f5c99cd-v6q76"]
Oct 30 20:37:34.469133 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:34.469102    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-884576c57-fl7nf"
Oct 30 20:37:34.471500 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:34.471481    2577 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-544d749c8c-gnfbh"]
Oct 30 20:37:34.471620 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:34.471605    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-556f5c99cd-v6q76"
Oct 30 20:37:34.474148 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:34.474133    2577 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-6c5684fdcf-l5m76"]
Oct 30 20:37:34.474252 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:34.474238    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-gnfbh"
Oct 30 20:37:34.479663 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:34.479642    2577 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-6f78d59f99-gqbfm"]
Oct 30 20:37:34.479762 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:34.479748    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6c5684fdcf-l5m76"
Oct 30 20:37:34.482438 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:34.482422    2577 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-7cd56b8dbc-sb7ds"]
Oct 30 20:37:34.482558 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:34.482543    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-6f78d59f99-gqbfm"
Oct 30 20:37:34.484787 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:34.484771    2577 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-j7q2s"]
Oct 30 20:37:34.484923 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:34.484905    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-7cd56b8dbc-sb7ds"
Oct 30 20:37:34.487517 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:34.487498    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-j7q2s"
Oct 30 20:37:34.496972 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:34.496952    2577 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-265zm"]
Oct 30 20:37:34.500746 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:34.500731    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-265zm"
Oct 30 20:37:34.503853 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:34.503837    2577 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-dhfg8"]
Oct 30 20:37:34.506893 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:34.506871    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-dhfg8"
Oct 30 20:37:34.515785 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:34.515767    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"openshift-service-ca.crt\""
Oct 30 20:37:34.516984 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:34.516964    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"kube-root-ca.crt\""
Oct 30 20:37:34.518646 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:34.518625    2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\""
Oct 30 20:37:34.518801 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:34.518787    2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\""
Oct 30 20:37:34.518887 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:34.518843    2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-dockercfg-9qsb8\""
Oct 30 20:37:34.518887 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:34.518872    2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\""
Oct 30 20:37:34.520872 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:34.520855    2577 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kube-system/kas-connection-checker-685895c7c9-tvmvh"]
Oct 30 20:37:34.528888 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:34.528868    2577 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kube-system/kas-connection-checker-685895c7c9-x8fpd"]
Oct 30 20:37:34.531813 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:34.531792    2577 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-86c478bb88-fl89x"]
Oct 30 20:37:34.567443 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:34.567415    2577 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-mwm8h"]
Oct 30 20:37:34.573299 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:34.573268    2577 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-7c4986d449-tvsdw"]
Oct 30 20:37:34.578681 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:34.578650    2577 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-884576c57-fl7nf"]
Oct 30 20:37:34.579899 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:34.579875    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9hnz8\" (UniqueName: \"kubernetes.io/projected/537a9c41-5ed1-4ff5-bf9a-9d0bcb853f80-kube-api-access-9hnz8\") pod \"volume-data-source-validator-58c9f5f46d-mwm8h\" (UID: \"537a9c41-5ed1-4ff5-bf9a-9d0bcb853f80\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-mwm8h"
Oct 30 20:37:34.580004 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:34.579912    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/aaadd8de-58cb-45af-a477-384fbf1cf317-metrics-tls\") pod \"dns-default-265zm\" (UID: \"aaadd8de-58cb-45af-a477-384fbf1cf317\") " pod="openshift-dns/dns-default-265zm"
Oct 30 20:37:34.580004 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:34.579947    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/cd59fef4-66a5-471b-a8ef-18df25e44d5c-default-certificate\") pod \"router-default-5b9d6cdd59-4g6mx\" (UID: \"cd59fef4-66a5-471b-a8ef-18df25e44d5c\") " pod="openshift-ingress/router-default-5b9d6cdd59-4g6mx"
Oct 30 20:37:34.580004 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:34.579972    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cd59fef4-66a5-471b-a8ef-18df25e44d5c-metrics-certs\") pod \"router-default-5b9d6cdd59-4g6mx\" (UID: \"cd59fef4-66a5-471b-a8ef-18df25e44d5c\") " pod="openshift-ingress/router-default-5b9d6cdd59-4g6mx"
Oct 30 20:37:34.580004 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:34.579995    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-trh2f\" (UniqueName: \"kubernetes.io/projected/6cd9770e-ea54-4c33-ac1e-5643f3d8839d-kube-api-access-trh2f\") pod \"cluster-samples-operator-6ddb6c8b94-7d57c\" (UID: \"6cd9770e-ea54-4c33-ac1e-5643f3d8839d\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-7d57c"
Oct 30 20:37:34.580243 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:34.580019    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/148ef018-4a87-49f3-8e89-839543748e77-image-registry-private-configuration\") pod \"image-registry-556f5c99cd-v6q76\" (UID: \"148ef018-4a87-49f3-8e89-839543748e77\") " pod="openshift-image-registry/image-registry-556f5c99cd-v6q76"
Oct 30 20:37:34.580243 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:34.580067    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xp792\" (UniqueName: \"kubernetes.io/projected/4dde41e2-34fe-429b-bf23-35bdb99d894e-kube-api-access-xp792\") pod \"insights-operator-7c4986d449-tvsdw\" (UID: \"4dde41e2-34fe-429b-bf23-35bdb99d894e\") " pod="openshift-insights/insights-operator-7c4986d449-tvsdw"
Oct 30 20:37:34.580243 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:34.580097    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/b3bff4d5-f9a8-4302-b63d-136ed3c6be35-ca-trust-extracted\") pod \"image-registry-6c5684fdcf-l5m76\" (UID: \"b3bff4d5-f9a8-4302-b63d-136ed3c6be35\") " pod="openshift-image-registry/image-registry-6c5684fdcf-l5m76"
Oct 30 20:37:34.580243 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:34.580152    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/90cd3de0-c573-41c2-bf3e-cf0e46a41d50-trusted-ca\") pod \"console-operator-7cd56b8dbc-sb7ds\" (UID: \"90cd3de0-c573-41c2-bf3e-cf0e46a41d50\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-sb7ds"
Oct 30 20:37:34.580243 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:34.580206    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tz88w\" (UniqueName: \"kubernetes.io/projected/90cd3de0-c573-41c2-bf3e-cf0e46a41d50-kube-api-access-tz88w\") pod \"console-operator-7cd56b8dbc-sb7ds\" (UID: \"90cd3de0-c573-41c2-bf3e-cf0e46a41d50\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-sb7ds"
Oct 30 20:37:34.580563 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:34.580254    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/ee37dd25-4ac1-474f-80b8-d04da8da560c-serving-cert\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-j7q2s\" (UID: \"ee37dd25-4ac1-474f-80b8-d04da8da560c\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-j7q2s"
Oct 30 20:37:34.580563 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:34.580283    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-config\" (UniqueName: \"kubernetes.io/configmap/6cd9770e-ea54-4c33-ac1e-5643f3d8839d-samples-operator-config\") pod \"cluster-samples-operator-6ddb6c8b94-7d57c\" (UID: \"6cd9770e-ea54-4c33-ac1e-5643f3d8839d\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-7d57c"
Oct 30 20:37:34.580563 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:34.580332    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/d1fd1b0a-3831-4cb8-b6f3-ad2e67685188-telemetry-config\") pod \"cluster-monitoring-operator-884576c57-fl7nf\" (UID: \"d1fd1b0a-3831-4cb8-b6f3-ad2e67685188\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-fl7nf"
Oct 30 20:37:34.580563 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:34.580426    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/4dde41e2-34fe-429b-bf23-35bdb99d894e-snapshots\") pod \"insights-operator-7c4986d449-tvsdw\" (UID: \"4dde41e2-34fe-429b-bf23-35bdb99d894e\") " pod="openshift-insights/insights-operator-7c4986d449-tvsdw"
Oct 30 20:37:34.580563 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:34.580463    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/90cd3de0-c573-41c2-bf3e-cf0e46a41d50-config\") pod \"console-operator-7cd56b8dbc-sb7ds\" (UID: \"90cd3de0-c573-41c2-bf3e-cf0e46a41d50\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-sb7ds"
Oct 30 20:37:34.580563 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:34.580542    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e33ef368-1f7c-4455-beb9-a2b2c5106792-serving-cert\") pod \"service-ca-operator-544d749c8c-gnfbh\" (UID: \"e33ef368-1f7c-4455-beb9-a2b2c5106792\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-gnfbh"
Oct 30 20:37:34.580837 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:34.580580    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/148ef018-4a87-49f3-8e89-839543748e77-ca-trust-extracted\") pod \"image-registry-556f5c99cd-v6q76\" (UID: \"148ef018-4a87-49f3-8e89-839543748e77\") " pod="openshift-image-registry/image-registry-556f5c99cd-v6q76"
Oct 30 20:37:34.580837 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:34.580632    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/aaadd8de-58cb-45af-a477-384fbf1cf317-tmp-dir\") pod \"dns-default-265zm\" (UID: \"aaadd8de-58cb-45af-a477-384fbf1cf317\") " pod="openshift-dns/dns-default-265zm"
Oct 30 20:37:34.580837 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:34.580657    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cd59fef4-66a5-471b-a8ef-18df25e44d5c-service-ca-bundle\") pod \"router-default-5b9d6cdd59-4g6mx\" (UID: \"cd59fef4-66a5-471b-a8ef-18df25e44d5c\") " pod="openshift-ingress/router-default-5b9d6cdd59-4g6mx"
Oct 30 20:37:34.580837 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:34.580681    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4dde41e2-34fe-429b-bf23-35bdb99d894e-trusted-ca-bundle\") pod \"insights-operator-7c4986d449-tvsdw\" (UID: \"4dde41e2-34fe-429b-bf23-35bdb99d894e\") " pod="openshift-insights/insights-operator-7c4986d449-tvsdw"
Oct 30 20:37:34.580837 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:34.580706    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/4dde41e2-34fe-429b-bf23-35bdb99d894e-serving-cert\") pod \"insights-operator-7c4986d449-tvsdw\" (UID: \"4dde41e2-34fe-429b-bf23-35bdb99d894e\") " pod="openshift-insights/insights-operator-7c4986d449-tvsdw"
Oct 30 20:37:34.580837 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:34.580730    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4r7tw\" (UniqueName: \"kubernetes.io/projected/e33ef368-1f7c-4455-beb9-a2b2c5106792-kube-api-access-4r7tw\") pod \"service-ca-operator-544d749c8c-gnfbh\" (UID: \"e33ef368-1f7c-4455-beb9-a2b2c5106792\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-gnfbh"
Oct 30 20:37:34.580837 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:34.580759    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/ee37dd25-4ac1-474f-80b8-d04da8da560c-config\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-j7q2s\" (UID: \"ee37dd25-4ac1-474f-80b8-d04da8da560c\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-j7q2s"
Oct 30 20:37:34.580837 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:34.580802    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/b3bff4d5-f9a8-4302-b63d-136ed3c6be35-image-registry-private-configuration\") pod \"image-registry-6c5684fdcf-l5m76\" (UID: \"b3bff4d5-f9a8-4302-b63d-136ed3c6be35\") " pod="openshift-image-registry/image-registry-6c5684fdcf-l5m76"
Oct 30 20:37:34.580837 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:34.580826    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4dde41e2-34fe-429b-bf23-35bdb99d894e-service-ca-bundle\") pod \"insights-operator-7c4986d449-tvsdw\" (UID: \"4dde41e2-34fe-429b-bf23-35bdb99d894e\") " pod="openshift-insights/insights-operator-7c4986d449-tvsdw"
Oct 30 20:37:34.581277 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:34.580849    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cjbpj\" (UniqueName: \"kubernetes.io/projected/d1fd1b0a-3831-4cb8-b6f3-ad2e67685188-kube-api-access-cjbpj\") pod \"cluster-monitoring-operator-884576c57-fl7nf\" (UID: \"d1fd1b0a-3831-4cb8-b6f3-ad2e67685188\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-fl7nf"
Oct 30 20:37:34.581277 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:34.580876    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b3bff4d5-f9a8-4302-b63d-136ed3c6be35-bound-sa-token\") pod \"image-registry-6c5684fdcf-l5m76\" (UID: \"b3bff4d5-f9a8-4302-b63d-136ed3c6be35\") " pod="openshift-image-registry/image-registry-6c5684fdcf-l5m76"
Oct 30 20:37:34.581277 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:34.580915    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/148ef018-4a87-49f3-8e89-839543748e77-trusted-ca\") pod \"image-registry-556f5c99cd-v6q76\" (UID: \"148ef018-4a87-49f3-8e89-839543748e77\") " pod="openshift-image-registry/image-registry-556f5c99cd-v6q76"
Oct 30 20:37:34.581277 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:34.580972    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j6vtn\" (UniqueName: \"kubernetes.io/projected/ee37dd25-4ac1-474f-80b8-d04da8da560c-kube-api-access-j6vtn\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-j7q2s\" (UID: \"ee37dd25-4ac1-474f-80b8-d04da8da560c\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-j7q2s"
Oct 30 20:37:34.581277 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:34.581000    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b3bff4d5-f9a8-4302-b63d-136ed3c6be35-registry-tls\") pod \"image-registry-6c5684fdcf-l5m76\" (UID: \"b3bff4d5-f9a8-4302-b63d-136ed3c6be35\") " pod="openshift-image-registry/image-registry-6c5684fdcf-l5m76"
Oct 30 20:37:34.581277 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:34.581026    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b3bff4d5-f9a8-4302-b63d-136ed3c6be35-trusted-ca\") pod \"image-registry-6c5684fdcf-l5m76\" (UID: \"b3bff4d5-f9a8-4302-b63d-136ed3c6be35\") " pod="openshift-image-registry/image-registry-6c5684fdcf-l5m76"
Oct 30 20:37:34.581277 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:34.581067    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4dde41e2-34fe-429b-bf23-35bdb99d894e-tmp\") pod \"insights-operator-7c4986d449-tvsdw\" (UID: \"4dde41e2-34fe-429b-bf23-35bdb99d894e\") " pod="openshift-insights/insights-operator-7c4986d449-tvsdw"
Oct 30 20:37:34.581277 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:34.581095    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/148ef018-4a87-49f3-8e89-839543748e77-bound-sa-token\") pod \"image-registry-556f5c99cd-v6q76\" (UID: \"148ef018-4a87-49f3-8e89-839543748e77\") " pod="openshift-image-registry/image-registry-556f5c99cd-v6q76"
Oct 30 20:37:34.581277 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:34.581128    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/148ef018-4a87-49f3-8e89-839543748e77-installation-pull-secrets\") pod \"image-registry-556f5c99cd-v6q76\" (UID: \"148ef018-4a87-49f3-8e89-839543748e77\") " pod="openshift-image-registry/image-registry-556f5c99cd-v6q76"
Oct 30 20:37:34.581277 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:34.581158    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/73676585-4ea4-43cb-af99-b4716472fb15-nginx-conf\") pod \"networking-console-plugin-86c478bb88-fl89x\" (UID: \"73676585-4ea4-43cb-af99-b4716472fb15\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-fl89x"
Oct 30 20:37:34.581277 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:34.581185    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n5rjs\" (UniqueName: \"kubernetes.io/projected/148ef018-4a87-49f3-8e89-839543748e77-kube-api-access-n5rjs\") pod \"image-registry-556f5c99cd-v6q76\" (UID: \"148ef018-4a87-49f3-8e89-839543748e77\") " pod="openshift-image-registry/image-registry-556f5c99cd-v6q76"
Oct 30 20:37:34.581277 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:34.581210    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5tcf2\" (UniqueName: \"kubernetes.io/projected/e5ac6e6d-4ea4-4874-b2eb-285977a285f7-kube-api-access-5tcf2\") pod \"network-check-source-6f78d59f99-gqbfm\" (UID: \"e5ac6e6d-4ea4-4874-b2eb-285977a285f7\") " pod="openshift-network-diagnostics/network-check-source-6f78d59f99-gqbfm"
Oct 30 20:37:34.581277 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:34.581237    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/b3bff4d5-f9a8-4302-b63d-136ed3c6be35-registry-certificates\") pod \"image-registry-6c5684fdcf-l5m76\" (UID: \"b3bff4d5-f9a8-4302-b63d-136ed3c6be35\") " pod="openshift-image-registry/image-registry-6c5684fdcf-l5m76"
Oct 30 20:37:34.581277 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:34.581266    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-75wkc\" (UniqueName: \"kubernetes.io/projected/b3bff4d5-f9a8-4302-b63d-136ed3c6be35-kube-api-access-75wkc\") pod \"image-registry-6c5684fdcf-l5m76\" (UID: \"b3bff4d5-f9a8-4302-b63d-136ed3c6be35\") " pod="openshift-image-registry/image-registry-6c5684fdcf-l5m76"
Oct 30 20:37:34.581970 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:34.581290    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hzklm\" (UniqueName: \"kubernetes.io/projected/aaadd8de-58cb-45af-a477-384fbf1cf317-kube-api-access-hzklm\") pod \"dns-default-265zm\" (UID: \"aaadd8de-58cb-45af-a477-384fbf1cf317\") " pod="openshift-dns/dns-default-265zm"
Oct 30 20:37:34.581970 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:34.581317    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nnz7p\" (UniqueName: \"kubernetes.io/projected/db64c15b-58b0-4829-b702-de7b6c846ab4-kube-api-access-nnz7p\") pod \"kas-connection-checker-685895c7c9-tpsd4\" (UID: \"db64c15b-58b0-4829-b702-de7b6c846ab4\") " pod="kube-system/kas-connection-checker-685895c7c9-tpsd4"
Oct 30 20:37:34.581970 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:34.581341    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/d1fd1b0a-3831-4cb8-b6f3-ad2e67685188-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-884576c57-fl7nf\" (UID: \"d1fd1b0a-3831-4cb8-b6f3-ad2e67685188\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-fl7nf"
Oct 30 20:37:34.581970 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:34.581368    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/e33ef368-1f7c-4455-beb9-a2b2c5106792-config\") pod \"service-ca-operator-544d749c8c-gnfbh\" (UID: \"e33ef368-1f7c-4455-beb9-a2b2c5106792\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-gnfbh"
Oct 30 20:37:34.581970 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:34.581393    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/148ef018-4a87-49f3-8e89-839543748e77-registry-certificates\") pod \"image-registry-556f5c99cd-v6q76\" (UID: \"148ef018-4a87-49f3-8e89-839543748e77\") " pod="openshift-image-registry/image-registry-556f5c99cd-v6q76"
Oct 30 20:37:34.581970 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:34.581421    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-72b4g\" (UniqueName: \"kubernetes.io/projected/793cb601-841f-4511-9b8f-ff30262611c2-kube-api-access-72b4g\") pod \"kas-connection-checker-685895c7c9-x8fpd\" (UID: \"793cb601-841f-4511-9b8f-ff30262611c2\") " pod="kube-system/kas-connection-checker-685895c7c9-x8fpd"
Oct 30 20:37:34.581970 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:34.581449    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rvdqt\" (UniqueName: \"kubernetes.io/projected/cd59fef4-66a5-471b-a8ef-18df25e44d5c-kube-api-access-rvdqt\") pod \"router-default-5b9d6cdd59-4g6mx\" (UID: \"cd59fef4-66a5-471b-a8ef-18df25e44d5c\") " pod="openshift-ingress/router-default-5b9d6cdd59-4g6mx"
Oct 30 20:37:34.581970 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:34.581474    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/148ef018-4a87-49f3-8e89-839543748e77-registry-tls\") pod \"image-registry-556f5c99cd-v6q76\" (UID: \"148ef018-4a87-49f3-8e89-839543748e77\") " pod="openshift-image-registry/image-registry-556f5c99cd-v6q76"
Oct 30 20:37:34.581970 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:34.581501    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/b3bff4d5-f9a8-4302-b63d-136ed3c6be35-installation-pull-secrets\") pod \"image-registry-6c5684fdcf-l5m76\" (UID: \"b3bff4d5-f9a8-4302-b63d-136ed3c6be35\") " pod="openshift-image-registry/image-registry-6c5684fdcf-l5m76"
Oct 30 20:37:34.581970 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:34.581524    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/cd59fef4-66a5-471b-a8ef-18df25e44d5c-stats-auth\") pod \"router-default-5b9d6cdd59-4g6mx\" (UID: \"cd59fef4-66a5-471b-a8ef-18df25e44d5c\") " pod="openshift-ingress/router-default-5b9d6cdd59-4g6mx"
Oct 30 20:37:34.581970 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:34.581547    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/6cd9770e-ea54-4c33-ac1e-5643f3d8839d-samples-operator-tls\") pod \"cluster-samples-operator-6ddb6c8b94-7d57c\" (UID: \"6cd9770e-ea54-4c33-ac1e-5643f3d8839d\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-7d57c"
Oct 30 20:37:34.581970 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:34.581576    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/73676585-4ea4-43cb-af99-b4716472fb15-networking-console-plugin-cert\") pod \"networking-console-plugin-86c478bb88-fl89x\" (UID: \"73676585-4ea4-43cb-af99-b4716472fb15\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-fl89x"
Oct 30 20:37:34.581970 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:34.581601    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lc26k\" (UniqueName: \"kubernetes.io/projected/f1a05736-0bc6-4914-981e-5524121561e4-kube-api-access-lc26k\") pod \"kas-connection-checker-685895c7c9-tvmvh\" (UID: \"f1a05736-0bc6-4914-981e-5524121561e4\") " pod="kube-system/kas-connection-checker-685895c7c9-tvmvh"
Oct 30 20:37:34.581970 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:34.581628    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/aaadd8de-58cb-45af-a477-384fbf1cf317-config-volume\") pod \"dns-default-265zm\" (UID: \"aaadd8de-58cb-45af-a477-384fbf1cf317\") " pod="openshift-dns/dns-default-265zm"
Oct 30 20:37:34.581970 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:34.581652    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/90cd3de0-c573-41c2-bf3e-cf0e46a41d50-serving-cert\") pod \"console-operator-7cd56b8dbc-sb7ds\" (UID: \"90cd3de0-c573-41c2-bf3e-cf0e46a41d50\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-sb7ds"
Oct 30 20:37:34.582686 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:34.582463    2577 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-7d57c"]
Oct 30 20:37:34.583230 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:34.583211    2577 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-556f5c99cd-v6q76"]
Oct 30 20:37:34.593106 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:34.593045    2577 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6c5684fdcf-l5m76"]
Oct 30 20:37:34.596917 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:34.596901    2577 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-544d749c8c-gnfbh"]
Oct 30 20:37:34.604012 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:34.603387    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Oct 30 20:37:34.604012 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:34.603406    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\""
Oct 30 20:37:34.604012 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:34.603449    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Oct 30 20:37:34.604012 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:34.603453    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Oct 30 20:37:34.604012 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:34.603471    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\""
Oct 30 20:37:34.604012 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:34.603511    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\""
Oct 30 20:37:34.604012 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:34.603407    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\""
Oct 30 20:37:34.604012 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:34.603603    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Oct 30 20:37:34.604012 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:34.603674    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\""
Oct 30 20:37:34.604012 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:34.603930    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\""
Oct 30 20:37:34.604012 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:34.603968    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\""
Oct 30 20:37:34.604539 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:34.604101    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Oct 30 20:37:34.604539 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:34.604127    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Oct 30 20:37:34.604629 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:34.604542    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\""
Oct 30 20:37:34.604629 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:34.604563    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Oct 30 20:37:34.604629 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:34.604583    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\""
Oct 30 20:37:34.604629 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:34.604622    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\""
Oct 30 20:37:34.604815 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:34.604634    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-config\""
Oct 30 20:37:34.604815 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:34.604666    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\""
Oct 30 20:37:34.604815 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:34.604712    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\""
Oct 30 20:37:34.604815 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:34.604723    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Oct 30 20:37:34.604815 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:34.604736    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\""
Oct 30 20:37:34.604815 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:34.604771    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\""
Oct 30 20:37:34.604815 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:34.604775    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Oct 30 20:37:34.605062 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:34.604873    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\""
Oct 30 20:37:34.615626 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:34.615600    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Oct 30 20:37:34.615728 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:34.615600    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Oct 30 20:37:34.615979 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:34.615938    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\""
Oct 30 20:37:34.652833 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:34.652810    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\""
Oct 30 20:37:34.678591 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:34.678564    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Oct 30 20:37:34.679925 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:34.679892    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\""
Oct 30 20:37:34.680030 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:34.679995    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\""
Oct 30 20:37:34.680030 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:34.680016    2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\""
Oct 30 20:37:34.680165 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:34.680031    2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\""
Oct 30 20:37:34.680165 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:34.680040    2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Oct 30 20:37:34.680165 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:34.680067    2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\""
Oct 30 20:37:34.680165 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:34.680077    2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\""
Oct 30 20:37:34.680165 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:34.680094    2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\""
Oct 30 20:37:34.680165 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:34.680096    2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Oct 30 20:37:34.680165 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:34.680037    2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Oct 30 20:37:34.680165 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:34.680129    2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\""
Oct 30 20:37:34.680165 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:34.680132    2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Oct 30 20:37:34.680165 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:34.680139    2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\""
Oct 30 20:37:34.680450 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:34.680171    2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"ingress-canary-dockercfg-h8n42\""
Oct 30 20:37:34.680450 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:34.680176    2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-wsjv8\""
Oct 30 20:37:34.680450 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:34.680204    2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Oct 30 20:37:34.680450 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:34.680304    2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-bhpnj\""
Oct 30 20:37:34.680826 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:34.680809    2577 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-7cd56b8dbc-sb7ds"]
Oct 30 20:37:34.682686 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:34.682671    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nnz7p\" (UniqueName: \"kubernetes.io/projected/db64c15b-58b0-4829-b702-de7b6c846ab4-kube-api-access-nnz7p\") pod \"kas-connection-checker-685895c7c9-tpsd4\" (UID: \"db64c15b-58b0-4829-b702-de7b6c846ab4\") " pod="kube-system/kas-connection-checker-685895c7c9-tpsd4"
Oct 30 20:37:34.682732 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:34.682695    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/d1fd1b0a-3831-4cb8-b6f3-ad2e67685188-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-884576c57-fl7nf\" (UID: \"d1fd1b0a-3831-4cb8-b6f3-ad2e67685188\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-fl7nf"
Oct 30 20:37:34.682732 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:34.682713    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/e33ef368-1f7c-4455-beb9-a2b2c5106792-config\") pod \"service-ca-operator-544d749c8c-gnfbh\" (UID: \"e33ef368-1f7c-4455-beb9-a2b2c5106792\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-gnfbh"
Oct 30 20:37:34.682823 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:34.682731    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/148ef018-4a87-49f3-8e89-839543748e77-registry-certificates\") pod \"image-registry-556f5c99cd-v6q76\" (UID: \"148ef018-4a87-49f3-8e89-839543748e77\") " pod="openshift-image-registry/image-registry-556f5c99cd-v6q76"
Oct 30 20:37:34.682823 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:34.682749    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-72b4g\" (UniqueName: \"kubernetes.io/projected/793cb601-841f-4511-9b8f-ff30262611c2-kube-api-access-72b4g\") pod \"kas-connection-checker-685895c7c9-x8fpd\" (UID: \"793cb601-841f-4511-9b8f-ff30262611c2\") " pod="kube-system/kas-connection-checker-685895c7c9-x8fpd"
Oct 30 20:37:34.682914 ip-10-0-138-85 kubenswrapper[2577]: E1030 20:37:34.682820    2577 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Oct 30 20:37:34.682914 ip-10-0-138-85 kubenswrapper[2577]: E1030 20:37:34.682878    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d1fd1b0a-3831-4cb8-b6f3-ad2e67685188-cluster-monitoring-operator-tls podName:d1fd1b0a-3831-4cb8-b6f3-ad2e67685188 nodeName:}" failed. No retries permitted until 2026-10-30 20:37:35.182859704 +0000 UTC m=+32.629655144 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/d1fd1b0a-3831-4cb8-b6f3-ad2e67685188-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-884576c57-fl7nf" (UID: "d1fd1b0a-3831-4cb8-b6f3-ad2e67685188") : secret "cluster-monitoring-operator-tls" not found
Oct 30 20:37:34.682914 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:34.682894    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rvdqt\" (UniqueName: \"kubernetes.io/projected/cd59fef4-66a5-471b-a8ef-18df25e44d5c-kube-api-access-rvdqt\") pod \"router-default-5b9d6cdd59-4g6mx\" (UID: \"cd59fef4-66a5-471b-a8ef-18df25e44d5c\") " pod="openshift-ingress/router-default-5b9d6cdd59-4g6mx"
Oct 30 20:37:34.683084 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:34.682921    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/148ef018-4a87-49f3-8e89-839543748e77-registry-tls\") pod \"image-registry-556f5c99cd-v6q76\" (UID: \"148ef018-4a87-49f3-8e89-839543748e77\") " pod="openshift-image-registry/image-registry-556f5c99cd-v6q76"
Oct 30 20:37:34.683084 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:34.682949    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/b3bff4d5-f9a8-4302-b63d-136ed3c6be35-installation-pull-secrets\") pod \"image-registry-6c5684fdcf-l5m76\" (UID: \"b3bff4d5-f9a8-4302-b63d-136ed3c6be35\") " pod="openshift-image-registry/image-registry-6c5684fdcf-l5m76"
Oct 30 20:37:34.683084 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:34.682973    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/cd59fef4-66a5-471b-a8ef-18df25e44d5c-stats-auth\") pod \"router-default-5b9d6cdd59-4g6mx\" (UID: \"cd59fef4-66a5-471b-a8ef-18df25e44d5c\") " pod="openshift-ingress/router-default-5b9d6cdd59-4g6mx"
Oct 30 20:37:34.683084 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:34.682996    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/6cd9770e-ea54-4c33-ac1e-5643f3d8839d-samples-operator-tls\") pod \"cluster-samples-operator-6ddb6c8b94-7d57c\" (UID: \"6cd9770e-ea54-4c33-ac1e-5643f3d8839d\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-7d57c"
Oct 30 20:37:34.683084 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:34.683023    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/73676585-4ea4-43cb-af99-b4716472fb15-networking-console-plugin-cert\") pod \"networking-console-plugin-86c478bb88-fl89x\" (UID: \"73676585-4ea4-43cb-af99-b4716472fb15\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-fl89x"
Oct 30 20:37:34.683084 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:34.683064    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lc26k\" (UniqueName: \"kubernetes.io/projected/f1a05736-0bc6-4914-981e-5524121561e4-kube-api-access-lc26k\") pod \"kas-connection-checker-685895c7c9-tvmvh\" (UID: \"f1a05736-0bc6-4914-981e-5524121561e4\") " pod="kube-system/kas-connection-checker-685895c7c9-tvmvh"
Oct 30 20:37:34.683372 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:34.683092    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/aaadd8de-58cb-45af-a477-384fbf1cf317-config-volume\") pod \"dns-default-265zm\" (UID: \"aaadd8de-58cb-45af-a477-384fbf1cf317\") " pod="openshift-dns/dns-default-265zm"
Oct 30 20:37:34.683372 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:34.683116    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/90cd3de0-c573-41c2-bf3e-cf0e46a41d50-serving-cert\") pod \"console-operator-7cd56b8dbc-sb7ds\" (UID: \"90cd3de0-c573-41c2-bf3e-cf0e46a41d50\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-sb7ds"
Oct 30 20:37:34.683372 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:34.683144    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9hnz8\" (UniqueName: \"kubernetes.io/projected/537a9c41-5ed1-4ff5-bf9a-9d0bcb853f80-kube-api-access-9hnz8\") pod \"volume-data-source-validator-58c9f5f46d-mwm8h\" (UID: \"537a9c41-5ed1-4ff5-bf9a-9d0bcb853f80\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-mwm8h"
Oct 30 20:37:34.683372 ip-10-0-138-85 kubenswrapper[2577]: E1030 20:37:34.683160    2577 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Oct 30 20:37:34.683372 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:34.683170    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/aaadd8de-58cb-45af-a477-384fbf1cf317-metrics-tls\") pod \"dns-default-265zm\" (UID: \"aaadd8de-58cb-45af-a477-384fbf1cf317\") " pod="openshift-dns/dns-default-265zm"
Oct 30 20:37:34.683372 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:34.683207    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/cd59fef4-66a5-471b-a8ef-18df25e44d5c-default-certificate\") pod \"router-default-5b9d6cdd59-4g6mx\" (UID: \"cd59fef4-66a5-471b-a8ef-18df25e44d5c\") " pod="openshift-ingress/router-default-5b9d6cdd59-4g6mx"
Oct 30 20:37:34.683372 ip-10-0-138-85 kubenswrapper[2577]: E1030 20:37:34.683218    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/73676585-4ea4-43cb-af99-b4716472fb15-networking-console-plugin-cert podName:73676585-4ea4-43cb-af99-b4716472fb15 nodeName:}" failed. No retries permitted until 2026-10-30 20:37:35.183202708 +0000 UTC m=+32.629998149 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/73676585-4ea4-43cb-af99-b4716472fb15-networking-console-plugin-cert") pod "networking-console-plugin-86c478bb88-fl89x" (UID: "73676585-4ea4-43cb-af99-b4716472fb15") : secret "networking-console-plugin-cert" not found
Oct 30 20:37:34.683372 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:34.683244    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cd59fef4-66a5-471b-a8ef-18df25e44d5c-metrics-certs\") pod \"router-default-5b9d6cdd59-4g6mx\" (UID: \"cd59fef4-66a5-471b-a8ef-18df25e44d5c\") " pod="openshift-ingress/router-default-5b9d6cdd59-4g6mx"
Oct 30 20:37:34.683372 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:34.683272    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-trh2f\" (UniqueName: \"kubernetes.io/projected/6cd9770e-ea54-4c33-ac1e-5643f3d8839d-kube-api-access-trh2f\") pod \"cluster-samples-operator-6ddb6c8b94-7d57c\" (UID: \"6cd9770e-ea54-4c33-ac1e-5643f3d8839d\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-7d57c"
Oct 30 20:37:34.683372 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:34.683307    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/148ef018-4a87-49f3-8e89-839543748e77-image-registry-private-configuration\") pod \"image-registry-556f5c99cd-v6q76\" (UID: \"148ef018-4a87-49f3-8e89-839543748e77\") " pod="openshift-image-registry/image-registry-556f5c99cd-v6q76"
Oct 30 20:37:34.683372 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:34.683324    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/e33ef368-1f7c-4455-beb9-a2b2c5106792-config\") pod \"service-ca-operator-544d749c8c-gnfbh\" (UID: \"e33ef368-1f7c-4455-beb9-a2b2c5106792\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-gnfbh"
Oct 30 20:37:34.683372 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:34.683332    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xp792\" (UniqueName: \"kubernetes.io/projected/4dde41e2-34fe-429b-bf23-35bdb99d894e-kube-api-access-xp792\") pod \"insights-operator-7c4986d449-tvsdw\" (UID: \"4dde41e2-34fe-429b-bf23-35bdb99d894e\") " pod="openshift-insights/insights-operator-7c4986d449-tvsdw"
Oct 30 20:37:34.683372 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:34.683360    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mgww7\" (UniqueName: \"kubernetes.io/projected/caca5f60-f777-4672-b570-faa422073cb9-kube-api-access-mgww7\") pod \"ingress-canary-dhfg8\" (UID: \"caca5f60-f777-4672-b570-faa422073cb9\") " pod="openshift-ingress-canary/ingress-canary-dhfg8"
Oct 30 20:37:34.683928 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:34.683385    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/b3bff4d5-f9a8-4302-b63d-136ed3c6be35-ca-trust-extracted\") pod \"image-registry-6c5684fdcf-l5m76\" (UID: \"b3bff4d5-f9a8-4302-b63d-136ed3c6be35\") " pod="openshift-image-registry/image-registry-6c5684fdcf-l5m76"
Oct 30 20:37:34.683928 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:34.683409    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/90cd3de0-c573-41c2-bf3e-cf0e46a41d50-trusted-ca\") pod \"console-operator-7cd56b8dbc-sb7ds\" (UID: \"90cd3de0-c573-41c2-bf3e-cf0e46a41d50\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-sb7ds"
Oct 30 20:37:34.683928 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:34.683432    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tz88w\" (UniqueName: \"kubernetes.io/projected/90cd3de0-c573-41c2-bf3e-cf0e46a41d50-kube-api-access-tz88w\") pod \"console-operator-7cd56b8dbc-sb7ds\" (UID: \"90cd3de0-c573-41c2-bf3e-cf0e46a41d50\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-sb7ds"
Oct 30 20:37:34.683928 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:34.683450    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/148ef018-4a87-49f3-8e89-839543748e77-registry-certificates\") pod \"image-registry-556f5c99cd-v6q76\" (UID: \"148ef018-4a87-49f3-8e89-839543748e77\") " pod="openshift-image-registry/image-registry-556f5c99cd-v6q76"
Oct 30 20:37:34.683928 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:34.683457    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/ee37dd25-4ac1-474f-80b8-d04da8da560c-serving-cert\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-j7q2s\" (UID: \"ee37dd25-4ac1-474f-80b8-d04da8da560c\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-j7q2s"
Oct 30 20:37:34.683928 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:34.683512    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-config\" (UniqueName: \"kubernetes.io/configmap/6cd9770e-ea54-4c33-ac1e-5643f3d8839d-samples-operator-config\") pod \"cluster-samples-operator-6ddb6c8b94-7d57c\" (UID: \"6cd9770e-ea54-4c33-ac1e-5643f3d8839d\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-7d57c"
Oct 30 20:37:34.683928 ip-10-0-138-85 kubenswrapper[2577]: E1030 20:37:34.683525    2577 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Oct 30 20:37:34.683928 ip-10-0-138-85 kubenswrapper[2577]: E1030 20:37:34.683565    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cd59fef4-66a5-471b-a8ef-18df25e44d5c-metrics-certs podName:cd59fef4-66a5-471b-a8ef-18df25e44d5c nodeName:}" failed. No retries permitted until 2026-10-30 20:37:35.183550035 +0000 UTC m=+32.630345461 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/cd59fef4-66a5-471b-a8ef-18df25e44d5c-metrics-certs") pod "router-default-5b9d6cdd59-4g6mx" (UID: "cd59fef4-66a5-471b-a8ef-18df25e44d5c") : secret "router-metrics-certs-default" not found
Oct 30 20:37:34.683928 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:34.683581    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/d1fd1b0a-3831-4cb8-b6f3-ad2e67685188-telemetry-config\") pod \"cluster-monitoring-operator-884576c57-fl7nf\" (UID: \"d1fd1b0a-3831-4cb8-b6f3-ad2e67685188\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-fl7nf"
Oct 30 20:37:34.683928 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:34.683618    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/4dde41e2-34fe-429b-bf23-35bdb99d894e-snapshots\") pod \"insights-operator-7c4986d449-tvsdw\" (UID: \"4dde41e2-34fe-429b-bf23-35bdb99d894e\") " pod="openshift-insights/insights-operator-7c4986d449-tvsdw"
Oct 30 20:37:34.683928 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:34.683643    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/90cd3de0-c573-41c2-bf3e-cf0e46a41d50-config\") pod \"console-operator-7cd56b8dbc-sb7ds\" (UID: \"90cd3de0-c573-41c2-bf3e-cf0e46a41d50\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-sb7ds"
Oct 30 20:37:34.683928 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:34.683677    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e33ef368-1f7c-4455-beb9-a2b2c5106792-serving-cert\") pod \"service-ca-operator-544d749c8c-gnfbh\" (UID: \"e33ef368-1f7c-4455-beb9-a2b2c5106792\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-gnfbh"
Oct 30 20:37:34.683928 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:34.683708    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/148ef018-4a87-49f3-8e89-839543748e77-ca-trust-extracted\") pod \"image-registry-556f5c99cd-v6q76\" (UID: \"148ef018-4a87-49f3-8e89-839543748e77\") " pod="openshift-image-registry/image-registry-556f5c99cd-v6q76"
Oct 30 20:37:34.683928 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:34.683744    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/aaadd8de-58cb-45af-a477-384fbf1cf317-tmp-dir\") pod \"dns-default-265zm\" (UID: \"aaadd8de-58cb-45af-a477-384fbf1cf317\") " pod="openshift-dns/dns-default-265zm"
Oct 30 20:37:34.683928 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:34.683765    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cd59fef4-66a5-471b-a8ef-18df25e44d5c-service-ca-bundle\") pod \"router-default-5b9d6cdd59-4g6mx\" (UID: \"cd59fef4-66a5-471b-a8ef-18df25e44d5c\") " pod="openshift-ingress/router-default-5b9d6cdd59-4g6mx"
Oct 30 20:37:34.683928 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:34.683785    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4dde41e2-34fe-429b-bf23-35bdb99d894e-trusted-ca-bundle\") pod \"insights-operator-7c4986d449-tvsdw\" (UID: \"4dde41e2-34fe-429b-bf23-35bdb99d894e\") " pod="openshift-insights/insights-operator-7c4986d449-tvsdw"
Oct 30 20:37:34.684675 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:34.683807    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/4dde41e2-34fe-429b-bf23-35bdb99d894e-serving-cert\") pod \"insights-operator-7c4986d449-tvsdw\" (UID: \"4dde41e2-34fe-429b-bf23-35bdb99d894e\") " pod="openshift-insights/insights-operator-7c4986d449-tvsdw"
Oct 30 20:37:34.684675 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:34.683828    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4r7tw\" (UniqueName: \"kubernetes.io/projected/e33ef368-1f7c-4455-beb9-a2b2c5106792-kube-api-access-4r7tw\") pod \"service-ca-operator-544d749c8c-gnfbh\" (UID: \"e33ef368-1f7c-4455-beb9-a2b2c5106792\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-gnfbh"
Oct 30 20:37:34.684675 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:34.683856    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/ee37dd25-4ac1-474f-80b8-d04da8da560c-config\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-j7q2s\" (UID: \"ee37dd25-4ac1-474f-80b8-d04da8da560c\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-j7q2s"
Oct 30 20:37:34.684675 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:34.683896    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/b3bff4d5-f9a8-4302-b63d-136ed3c6be35-image-registry-private-configuration\") pod \"image-registry-6c5684fdcf-l5m76\" (UID: \"b3bff4d5-f9a8-4302-b63d-136ed3c6be35\") " pod="openshift-image-registry/image-registry-6c5684fdcf-l5m76"
Oct 30 20:37:34.684675 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:34.683918    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4dde41e2-34fe-429b-bf23-35bdb99d894e-service-ca-bundle\") pod \"insights-operator-7c4986d449-tvsdw\" (UID: \"4dde41e2-34fe-429b-bf23-35bdb99d894e\") " pod="openshift-insights/insights-operator-7c4986d449-tvsdw"
Oct 30 20:37:34.684675 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:34.683940    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cjbpj\" (UniqueName: \"kubernetes.io/projected/d1fd1b0a-3831-4cb8-b6f3-ad2e67685188-kube-api-access-cjbpj\") pod \"cluster-monitoring-operator-884576c57-fl7nf\" (UID: \"d1fd1b0a-3831-4cb8-b6f3-ad2e67685188\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-fl7nf"
Oct 30 20:37:34.684675 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:34.683965    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b3bff4d5-f9a8-4302-b63d-136ed3c6be35-bound-sa-token\") pod \"image-registry-6c5684fdcf-l5m76\" (UID: \"b3bff4d5-f9a8-4302-b63d-136ed3c6be35\") " pod="openshift-image-registry/image-registry-6c5684fdcf-l5m76"
Oct 30 20:37:34.684675 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:34.683997    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/148ef018-4a87-49f3-8e89-839543748e77-trusted-ca\") pod \"image-registry-556f5c99cd-v6q76\" (UID: \"148ef018-4a87-49f3-8e89-839543748e77\") " pod="openshift-image-registry/image-registry-556f5c99cd-v6q76"
Oct 30 20:37:34.684675 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:34.684020    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j6vtn\" (UniqueName: \"kubernetes.io/projected/ee37dd25-4ac1-474f-80b8-d04da8da560c-kube-api-access-j6vtn\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-j7q2s\" (UID: \"ee37dd25-4ac1-474f-80b8-d04da8da560c\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-j7q2s"
Oct 30 20:37:34.684675 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:34.684063    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b3bff4d5-f9a8-4302-b63d-136ed3c6be35-registry-tls\") pod \"image-registry-6c5684fdcf-l5m76\" (UID: \"b3bff4d5-f9a8-4302-b63d-136ed3c6be35\") " pod="openshift-image-registry/image-registry-6c5684fdcf-l5m76"
Oct 30 20:37:34.684675 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:34.683679    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/aaadd8de-58cb-45af-a477-384fbf1cf317-config-volume\") pod \"dns-default-265zm\" (UID: \"aaadd8de-58cb-45af-a477-384fbf1cf317\") " pod="openshift-dns/dns-default-265zm"
Oct 30 20:37:34.684675 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:34.684086    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b3bff4d5-f9a8-4302-b63d-136ed3c6be35-trusted-ca\") pod \"image-registry-6c5684fdcf-l5m76\" (UID: \"b3bff4d5-f9a8-4302-b63d-136ed3c6be35\") " pod="openshift-image-registry/image-registry-6c5684fdcf-l5m76"
Oct 30 20:37:34.684675 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:34.684139    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4dde41e2-34fe-429b-bf23-35bdb99d894e-tmp\") pod \"insights-operator-7c4986d449-tvsdw\" (UID: \"4dde41e2-34fe-429b-bf23-35bdb99d894e\") " pod="openshift-insights/insights-operator-7c4986d449-tvsdw"
Oct 30 20:37:34.684675 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:34.684172    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/caca5f60-f777-4672-b570-faa422073cb9-cert\") pod \"ingress-canary-dhfg8\" (UID: \"caca5f60-f777-4672-b570-faa422073cb9\") " pod="openshift-ingress-canary/ingress-canary-dhfg8"
Oct 30 20:37:34.684675 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:34.684184    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-config\" (UniqueName: \"kubernetes.io/configmap/6cd9770e-ea54-4c33-ac1e-5643f3d8839d-samples-operator-config\") pod \"cluster-samples-operator-6ddb6c8b94-7d57c\" (UID: \"6cd9770e-ea54-4c33-ac1e-5643f3d8839d\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-7d57c"
Oct 30 20:37:34.684675 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:34.684206    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/148ef018-4a87-49f3-8e89-839543748e77-bound-sa-token\") pod \"image-registry-556f5c99cd-v6q76\" (UID: \"148ef018-4a87-49f3-8e89-839543748e77\") " pod="openshift-image-registry/image-registry-556f5c99cd-v6q76"
Oct 30 20:37:34.688409 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:34.684246    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/148ef018-4a87-49f3-8e89-839543748e77-installation-pull-secrets\") pod \"image-registry-556f5c99cd-v6q76\" (UID: \"148ef018-4a87-49f3-8e89-839543748e77\") " pod="openshift-image-registry/image-registry-556f5c99cd-v6q76"
Oct 30 20:37:34.688409 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:34.684280    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/73676585-4ea4-43cb-af99-b4716472fb15-nginx-conf\") pod \"networking-console-plugin-86c478bb88-fl89x\" (UID: \"73676585-4ea4-43cb-af99-b4716472fb15\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-fl89x"
Oct 30 20:37:34.688409 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:34.684306    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n5rjs\" (UniqueName: \"kubernetes.io/projected/148ef018-4a87-49f3-8e89-839543748e77-kube-api-access-n5rjs\") pod \"image-registry-556f5c99cd-v6q76\" (UID: \"148ef018-4a87-49f3-8e89-839543748e77\") " pod="openshift-image-registry/image-registry-556f5c99cd-v6q76"
Oct 30 20:37:34.688409 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:34.684333    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5tcf2\" (UniqueName: \"kubernetes.io/projected/e5ac6e6d-4ea4-4874-b2eb-285977a285f7-kube-api-access-5tcf2\") pod \"network-check-source-6f78d59f99-gqbfm\" (UID: \"e5ac6e6d-4ea4-4874-b2eb-285977a285f7\") " pod="openshift-network-diagnostics/network-check-source-6f78d59f99-gqbfm"
Oct 30 20:37:34.688409 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:34.684364    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/b3bff4d5-f9a8-4302-b63d-136ed3c6be35-registry-certificates\") pod \"image-registry-6c5684fdcf-l5m76\" (UID: \"b3bff4d5-f9a8-4302-b63d-136ed3c6be35\") " pod="openshift-image-registry/image-registry-6c5684fdcf-l5m76"
Oct 30 20:37:34.688409 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:34.684397    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-75wkc\" (UniqueName: \"kubernetes.io/projected/b3bff4d5-f9a8-4302-b63d-136ed3c6be35-kube-api-access-75wkc\") pod \"image-registry-6c5684fdcf-l5m76\" (UID: \"b3bff4d5-f9a8-4302-b63d-136ed3c6be35\") " pod="openshift-image-registry/image-registry-6c5684fdcf-l5m76"
Oct 30 20:37:34.688409 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:34.684427    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hzklm\" (UniqueName: \"kubernetes.io/projected/aaadd8de-58cb-45af-a477-384fbf1cf317-kube-api-access-hzklm\") pod \"dns-default-265zm\" (UID: \"aaadd8de-58cb-45af-a477-384fbf1cf317\") " pod="openshift-dns/dns-default-265zm"
Oct 30 20:37:34.688409 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:34.684818    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b3bff4d5-f9a8-4302-b63d-136ed3c6be35-trusted-ca\") pod \"image-registry-6c5684fdcf-l5m76\" (UID: \"b3bff4d5-f9a8-4302-b63d-136ed3c6be35\") " pod="openshift-image-registry/image-registry-6c5684fdcf-l5m76"
Oct 30 20:37:34.688409 ip-10-0-138-85 kubenswrapper[2577]: E1030 20:37:34.684835    2577 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Oct 30 20:37:34.688409 ip-10-0-138-85 kubenswrapper[2577]: E1030 20:37:34.684902    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6cd9770e-ea54-4c33-ac1e-5643f3d8839d-samples-operator-tls podName:6cd9770e-ea54-4c33-ac1e-5643f3d8839d nodeName:}" failed. No retries permitted until 2026-10-30 20:37:35.184886091 +0000 UTC m=+32.631681530 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/6cd9770e-ea54-4c33-ac1e-5643f3d8839d-samples-operator-tls") pod "cluster-samples-operator-6ddb6c8b94-7d57c" (UID: "6cd9770e-ea54-4c33-ac1e-5643f3d8839d") : secret "samples-operator-tls" not found
Oct 30 20:37:34.688409 ip-10-0-138-85 kubenswrapper[2577]: E1030 20:37:34.684933    2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Oct 30 20:37:34.688409 ip-10-0-138-85 kubenswrapper[2577]: E1030 20:37:34.684980    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aaadd8de-58cb-45af-a477-384fbf1cf317-metrics-tls podName:aaadd8de-58cb-45af-a477-384fbf1cf317 nodeName:}" failed. No retries permitted until 2026-10-30 20:37:35.184965501 +0000 UTC m=+32.631760946 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/aaadd8de-58cb-45af-a477-384fbf1cf317-metrics-tls") pod "dns-default-265zm" (UID: "aaadd8de-58cb-45af-a477-384fbf1cf317") : secret "dns-default-metrics-tls" not found
Oct 30 20:37:34.688409 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:34.685114    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/148ef018-4a87-49f3-8e89-839543748e77-ca-trust-extracted\") pod \"image-registry-556f5c99cd-v6q76\" (UID: \"148ef018-4a87-49f3-8e89-839543748e77\") " pod="openshift-image-registry/image-registry-556f5c99cd-v6q76"
Oct 30 20:37:34.688409 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:34.685342    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/aaadd8de-58cb-45af-a477-384fbf1cf317-tmp-dir\") pod \"dns-default-265zm\" (UID: \"aaadd8de-58cb-45af-a477-384fbf1cf317\") " pod="openshift-dns/dns-default-265zm"
Oct 30 20:37:34.688409 ip-10-0-138-85 kubenswrapper[2577]: E1030 20:37:34.685445    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/cd59fef4-66a5-471b-a8ef-18df25e44d5c-service-ca-bundle podName:cd59fef4-66a5-471b-a8ef-18df25e44d5c nodeName:}" failed. No retries permitted until 2026-10-30 20:37:35.185431684 +0000 UTC m=+32.632227131 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/cd59fef4-66a5-471b-a8ef-18df25e44d5c-service-ca-bundle") pod "router-default-5b9d6cdd59-4g6mx" (UID: "cd59fef4-66a5-471b-a8ef-18df25e44d5c") : configmap references non-existent config key: service-ca.crt
Oct 30 20:37:34.689117 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:34.685489    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/d1fd1b0a-3831-4cb8-b6f3-ad2e67685188-telemetry-config\") pod \"cluster-monitoring-operator-884576c57-fl7nf\" (UID: \"d1fd1b0a-3831-4cb8-b6f3-ad2e67685188\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-fl7nf"
Oct 30 20:37:34.689117 ip-10-0-138-85 kubenswrapper[2577]: E1030 20:37:34.685800    2577 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Oct 30 20:37:34.689117 ip-10-0-138-85 kubenswrapper[2577]: E1030 20:37:34.685814    2577 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-556f5c99cd-v6q76: secret "image-registry-tls" not found
Oct 30 20:37:34.689117 ip-10-0-138-85 kubenswrapper[2577]: E1030 20:37:34.685867    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/148ef018-4a87-49f3-8e89-839543748e77-registry-tls podName:148ef018-4a87-49f3-8e89-839543748e77 nodeName:}" failed. No retries permitted until 2026-10-30 20:37:35.18585394 +0000 UTC m=+32.632649390 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/148ef018-4a87-49f3-8e89-839543748e77-registry-tls") pod "image-registry-556f5c99cd-v6q76" (UID: "148ef018-4a87-49f3-8e89-839543748e77") : secret "image-registry-tls" not found
Oct 30 20:37:34.689117 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:34.685875    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/b3bff4d5-f9a8-4302-b63d-136ed3c6be35-ca-trust-extracted\") pod \"image-registry-6c5684fdcf-l5m76\" (UID: \"b3bff4d5-f9a8-4302-b63d-136ed3c6be35\") " pod="openshift-image-registry/image-registry-6c5684fdcf-l5m76"
Oct 30 20:37:34.689117 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:34.686292    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/4dde41e2-34fe-429b-bf23-35bdb99d894e-snapshots\") pod \"insights-operator-7c4986d449-tvsdw\" (UID: \"4dde41e2-34fe-429b-bf23-35bdb99d894e\") " pod="openshift-insights/insights-operator-7c4986d449-tvsdw"
Oct 30 20:37:34.689117 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:34.686322    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/90cd3de0-c573-41c2-bf3e-cf0e46a41d50-trusted-ca\") pod \"console-operator-7cd56b8dbc-sb7ds\" (UID: \"90cd3de0-c573-41c2-bf3e-cf0e46a41d50\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-sb7ds"
Oct 30 20:37:34.689117 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:34.686547    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4dde41e2-34fe-429b-bf23-35bdb99d894e-tmp\") pod \"insights-operator-7c4986d449-tvsdw\" (UID: \"4dde41e2-34fe-429b-bf23-35bdb99d894e\") " pod="openshift-insights/insights-operator-7c4986d449-tvsdw"
Oct 30 20:37:34.689117 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:34.687173    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/90cd3de0-c573-41c2-bf3e-cf0e46a41d50-config\") pod \"console-operator-7cd56b8dbc-sb7ds\" (UID: \"90cd3de0-c573-41c2-bf3e-cf0e46a41d50\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-sb7ds"
Oct 30 20:37:34.689117 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:34.687497    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/148ef018-4a87-49f3-8e89-839543748e77-trusted-ca\") pod \"image-registry-556f5c99cd-v6q76\" (UID: \"148ef018-4a87-49f3-8e89-839543748e77\") " pod="openshift-image-registry/image-registry-556f5c99cd-v6q76"
Oct 30 20:37:34.689117 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:34.687618    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/73676585-4ea4-43cb-af99-b4716472fb15-nginx-conf\") pod \"networking-console-plugin-86c478bb88-fl89x\" (UID: \"73676585-4ea4-43cb-af99-b4716472fb15\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-fl89x"
Oct 30 20:37:34.689117 ip-10-0-138-85 kubenswrapper[2577]: E1030 20:37:34.687876    2577 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Oct 30 20:37:34.689117 ip-10-0-138-85 kubenswrapper[2577]: E1030 20:37:34.687893    2577 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6c5684fdcf-l5m76: secret "image-registry-tls" not found
Oct 30 20:37:34.689117 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:34.687976    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/b3bff4d5-f9a8-4302-b63d-136ed3c6be35-installation-pull-secrets\") pod \"image-registry-6c5684fdcf-l5m76\" (UID: \"b3bff4d5-f9a8-4302-b63d-136ed3c6be35\") " pod="openshift-image-registry/image-registry-6c5684fdcf-l5m76"
Oct 30 20:37:34.689117 ip-10-0-138-85 kubenswrapper[2577]: E1030 20:37:34.688034    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b3bff4d5-f9a8-4302-b63d-136ed3c6be35-registry-tls podName:b3bff4d5-f9a8-4302-b63d-136ed3c6be35 nodeName:}" failed. No retries permitted until 2026-10-30 20:37:35.187920249 +0000 UTC m=+32.634715701 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/b3bff4d5-f9a8-4302-b63d-136ed3c6be35-registry-tls") pod "image-registry-6c5684fdcf-l5m76" (UID: "b3bff4d5-f9a8-4302-b63d-136ed3c6be35") : secret "image-registry-tls" not found
Oct 30 20:37:34.689117 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:34.688451    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/cd59fef4-66a5-471b-a8ef-18df25e44d5c-stats-auth\") pod \"router-default-5b9d6cdd59-4g6mx\" (UID: \"cd59fef4-66a5-471b-a8ef-18df25e44d5c\") " pod="openshift-ingress/router-default-5b9d6cdd59-4g6mx"
Oct 30 20:37:34.689117 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:34.688572    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/b3bff4d5-f9a8-4302-b63d-136ed3c6be35-registry-certificates\") pod \"image-registry-6c5684fdcf-l5m76\" (UID: \"b3bff4d5-f9a8-4302-b63d-136ed3c6be35\") " pod="openshift-image-registry/image-registry-6c5684fdcf-l5m76"
Oct 30 20:37:34.689873 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:34.688695    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/90cd3de0-c573-41c2-bf3e-cf0e46a41d50-serving-cert\") pod \"console-operator-7cd56b8dbc-sb7ds\" (UID: \"90cd3de0-c573-41c2-bf3e-cf0e46a41d50\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-sb7ds"
Oct 30 20:37:34.689873 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:34.688772    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e33ef368-1f7c-4455-beb9-a2b2c5106792-serving-cert\") pod \"service-ca-operator-544d749c8c-gnfbh\" (UID: \"e33ef368-1f7c-4455-beb9-a2b2c5106792\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-gnfbh"
Oct 30 20:37:34.689873 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:34.688780    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/ee37dd25-4ac1-474f-80b8-d04da8da560c-config\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-j7q2s\" (UID: \"ee37dd25-4ac1-474f-80b8-d04da8da560c\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-j7q2s"
Oct 30 20:37:34.689873 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:34.688901    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/ee37dd25-4ac1-474f-80b8-d04da8da560c-serving-cert\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-j7q2s\" (UID: \"ee37dd25-4ac1-474f-80b8-d04da8da560c\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-j7q2s"
Oct 30 20:37:34.689873 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:34.688944    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4dde41e2-34fe-429b-bf23-35bdb99d894e-service-ca-bundle\") pod \"insights-operator-7c4986d449-tvsdw\" (UID: \"4dde41e2-34fe-429b-bf23-35bdb99d894e\") " pod="openshift-insights/insights-operator-7c4986d449-tvsdw"
Oct 30 20:37:34.689873 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:34.689170    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4dde41e2-34fe-429b-bf23-35bdb99d894e-trusted-ca-bundle\") pod \"insights-operator-7c4986d449-tvsdw\" (UID: \"4dde41e2-34fe-429b-bf23-35bdb99d894e\") " pod="openshift-insights/insights-operator-7c4986d449-tvsdw"
Oct 30 20:37:34.689873 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:34.689795    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/148ef018-4a87-49f3-8e89-839543748e77-image-registry-private-configuration\") pod \"image-registry-556f5c99cd-v6q76\" (UID: \"148ef018-4a87-49f3-8e89-839543748e77\") " pod="openshift-image-registry/image-registry-556f5c99cd-v6q76"
Oct 30 20:37:34.689873 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:34.689816    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/cd59fef4-66a5-471b-a8ef-18df25e44d5c-default-certificate\") pod \"router-default-5b9d6cdd59-4g6mx\" (UID: \"cd59fef4-66a5-471b-a8ef-18df25e44d5c\") " pod="openshift-ingress/router-default-5b9d6cdd59-4g6mx"
Oct 30 20:37:34.690583 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:34.690559    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/148ef018-4a87-49f3-8e89-839543748e77-installation-pull-secrets\") pod \"image-registry-556f5c99cd-v6q76\" (UID: \"148ef018-4a87-49f3-8e89-839543748e77\") " pod="openshift-image-registry/image-registry-556f5c99cd-v6q76"
Oct 30 20:37:34.691118 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:34.691099    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/4dde41e2-34fe-429b-bf23-35bdb99d894e-serving-cert\") pod \"insights-operator-7c4986d449-tvsdw\" (UID: \"4dde41e2-34fe-429b-bf23-35bdb99d894e\") " pod="openshift-insights/insights-operator-7c4986d449-tvsdw"
Oct 30 20:37:34.691276 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:34.691255    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/b3bff4d5-f9a8-4302-b63d-136ed3c6be35-image-registry-private-configuration\") pod \"image-registry-6c5684fdcf-l5m76\" (UID: \"b3bff4d5-f9a8-4302-b63d-136ed3c6be35\") " pod="openshift-image-registry/image-registry-6c5684fdcf-l5m76"
Oct 30 20:37:34.692921 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:34.692902    2577 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kube-system/kas-connection-checker-685895c7c9-tpsd4"]
Oct 30 20:37:34.693570 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:34.693555    2577 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-5b9d6cdd59-4g6mx"]
Oct 30 20:37:34.694177 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:34.694161    2577 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-dhfg8"]
Oct 30 20:37:34.694746 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:34.694734    2577 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-j7q2s"]
Oct 30 20:37:34.695388 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:34.695346    2577 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-265zm"]
Oct 30 20:37:34.696213 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:34.696192    2577 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-6f78d59f99-gqbfm"]
Oct 30 20:37:34.741578 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:34.741535    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rvdqt\" (UniqueName: \"kubernetes.io/projected/cd59fef4-66a5-471b-a8ef-18df25e44d5c-kube-api-access-rvdqt\") pod \"router-default-5b9d6cdd59-4g6mx\" (UID: \"cd59fef4-66a5-471b-a8ef-18df25e44d5c\") " pod="openshift-ingress/router-default-5b9d6cdd59-4g6mx"
Oct 30 20:37:34.742079 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:34.742030    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-72b4g\" (UniqueName: \"kubernetes.io/projected/793cb601-841f-4511-9b8f-ff30262611c2-kube-api-access-72b4g\") pod \"kas-connection-checker-685895c7c9-x8fpd\" (UID: \"793cb601-841f-4511-9b8f-ff30262611c2\") " pod="kube-system/kas-connection-checker-685895c7c9-x8fpd"
Oct 30 20:37:34.742245 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:34.742131    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-trh2f\" (UniqueName: \"kubernetes.io/projected/6cd9770e-ea54-4c33-ac1e-5643f3d8839d-kube-api-access-trh2f\") pod \"cluster-samples-operator-6ddb6c8b94-7d57c\" (UID: \"6cd9770e-ea54-4c33-ac1e-5643f3d8839d\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-7d57c"
Oct 30 20:37:34.742721 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:34.742376    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xp792\" (UniqueName: \"kubernetes.io/projected/4dde41e2-34fe-429b-bf23-35bdb99d894e-kube-api-access-xp792\") pod \"insights-operator-7c4986d449-tvsdw\" (UID: \"4dde41e2-34fe-429b-bf23-35bdb99d894e\") " pod="openshift-insights/insights-operator-7c4986d449-tvsdw"
Oct 30 20:37:34.742721 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:34.742570    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nnz7p\" (UniqueName: \"kubernetes.io/projected/db64c15b-58b0-4829-b702-de7b6c846ab4-kube-api-access-nnz7p\") pod \"kas-connection-checker-685895c7c9-tpsd4\" (UID: \"db64c15b-58b0-4829-b702-de7b6c846ab4\") " pod="kube-system/kas-connection-checker-685895c7c9-tpsd4"
Oct 30 20:37:34.742721 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:34.742571    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lc26k\" (UniqueName: \"kubernetes.io/projected/f1a05736-0bc6-4914-981e-5524121561e4-kube-api-access-lc26k\") pod \"kas-connection-checker-685895c7c9-tvmvh\" (UID: \"f1a05736-0bc6-4914-981e-5524121561e4\") " pod="kube-system/kas-connection-checker-685895c7c9-tvmvh"
Oct 30 20:37:34.743016 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:34.742763    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hzklm\" (UniqueName: \"kubernetes.io/projected/aaadd8de-58cb-45af-a477-384fbf1cf317-kube-api-access-hzklm\") pod \"dns-default-265zm\" (UID: \"aaadd8de-58cb-45af-a477-384fbf1cf317\") " pod="openshift-dns/dns-default-265zm"
Oct 30 20:37:34.743672 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:34.743640    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tz88w\" (UniqueName: \"kubernetes.io/projected/90cd3de0-c573-41c2-bf3e-cf0e46a41d50-kube-api-access-tz88w\") pod \"console-operator-7cd56b8dbc-sb7ds\" (UID: \"90cd3de0-c573-41c2-bf3e-cf0e46a41d50\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-sb7ds"
Oct 30 20:37:34.744030 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:34.744011    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9hnz8\" (UniqueName: \"kubernetes.io/projected/537a9c41-5ed1-4ff5-bf9a-9d0bcb853f80-kube-api-access-9hnz8\") pod \"volume-data-source-validator-58c9f5f46d-mwm8h\" (UID: \"537a9c41-5ed1-4ff5-bf9a-9d0bcb853f80\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-mwm8h"
Oct 30 20:37:34.744161 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:34.744136    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j6vtn\" (UniqueName: \"kubernetes.io/projected/ee37dd25-4ac1-474f-80b8-d04da8da560c-kube-api-access-j6vtn\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-j7q2s\" (UID: \"ee37dd25-4ac1-474f-80b8-d04da8da560c\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-j7q2s"
Oct 30 20:37:34.744382 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:34.744363    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/148ef018-4a87-49f3-8e89-839543748e77-bound-sa-token\") pod \"image-registry-556f5c99cd-v6q76\" (UID: \"148ef018-4a87-49f3-8e89-839543748e77\") " pod="openshift-image-registry/image-registry-556f5c99cd-v6q76"
Oct 30 20:37:34.744637 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:34.744619    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n5rjs\" (UniqueName: \"kubernetes.io/projected/148ef018-4a87-49f3-8e89-839543748e77-kube-api-access-n5rjs\") pod \"image-registry-556f5c99cd-v6q76\" (UID: \"148ef018-4a87-49f3-8e89-839543748e77\") " pod="openshift-image-registry/image-registry-556f5c99cd-v6q76"
Oct 30 20:37:34.745236 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:34.745216    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5tcf2\" (UniqueName: \"kubernetes.io/projected/e5ac6e6d-4ea4-4874-b2eb-285977a285f7-kube-api-access-5tcf2\") pod \"network-check-source-6f78d59f99-gqbfm\" (UID: \"e5ac6e6d-4ea4-4874-b2eb-285977a285f7\") " pod="openshift-network-diagnostics/network-check-source-6f78d59f99-gqbfm"
Oct 30 20:37:34.746467 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:34.746449    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4r7tw\" (UniqueName: \"kubernetes.io/projected/e33ef368-1f7c-4455-beb9-a2b2c5106792-kube-api-access-4r7tw\") pod \"service-ca-operator-544d749c8c-gnfbh\" (UID: \"e33ef368-1f7c-4455-beb9-a2b2c5106792\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-gnfbh"
Oct 30 20:37:34.748789 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:34.748766    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b3bff4d5-f9a8-4302-b63d-136ed3c6be35-bound-sa-token\") pod \"image-registry-6c5684fdcf-l5m76\" (UID: \"b3bff4d5-f9a8-4302-b63d-136ed3c6be35\") " pod="openshift-image-registry/image-registry-6c5684fdcf-l5m76"
Oct 30 20:37:34.749059 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:34.749026    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-75wkc\" (UniqueName: \"kubernetes.io/projected/b3bff4d5-f9a8-4302-b63d-136ed3c6be35-kube-api-access-75wkc\") pod \"image-registry-6c5684fdcf-l5m76\" (UID: \"b3bff4d5-f9a8-4302-b63d-136ed3c6be35\") " pod="openshift-image-registry/image-registry-6c5684fdcf-l5m76"
Oct 30 20:37:34.749342 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:34.749320    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cjbpj\" (UniqueName: \"kubernetes.io/projected/d1fd1b0a-3831-4cb8-b6f3-ad2e67685188-kube-api-access-cjbpj\") pod \"cluster-monitoring-operator-884576c57-fl7nf\" (UID: \"d1fd1b0a-3831-4cb8-b6f3-ad2e67685188\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-fl7nf"
Oct 30 20:37:34.749438 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:34.749425    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kas-connection-checker-685895c7c9-tvmvh"
Oct 30 20:37:34.758648 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:34.758631    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kas-connection-checker-685895c7c9-x8fpd"
Oct 30 20:37:34.770922 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:34.770899    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kas-connection-checker-685895c7c9-tpsd4"
Oct 30 20:37:34.785488 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:34.785465    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-mwm8h"
Oct 30 20:37:34.785748 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:34.785728    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/caca5f60-f777-4672-b570-faa422073cb9-cert\") pod \"ingress-canary-dhfg8\" (UID: \"caca5f60-f777-4672-b570-faa422073cb9\") " pod="openshift-ingress-canary/ingress-canary-dhfg8"
Oct 30 20:37:34.785870 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:34.785856    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mgww7\" (UniqueName: \"kubernetes.io/projected/caca5f60-f777-4672-b570-faa422073cb9-kube-api-access-mgww7\") pod \"ingress-canary-dhfg8\" (UID: \"caca5f60-f777-4672-b570-faa422073cb9\") " pod="openshift-ingress-canary/ingress-canary-dhfg8"
Oct 30 20:37:34.788014 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:34.787995    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/caca5f60-f777-4672-b570-faa422073cb9-cert\") pod \"ingress-canary-dhfg8\" (UID: \"caca5f60-f777-4672-b570-faa422073cb9\") " pod="openshift-ingress-canary/ingress-canary-dhfg8"
Oct 30 20:37:34.792197 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:34.791518    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-7c4986d449-tvsdw"
Oct 30 20:37:34.818550 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:34.817834    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-gnfbh"
Oct 30 20:37:34.833645 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:34.833191    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-6f78d59f99-gqbfm"
Oct 30 20:37:34.839525 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:34.839194    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-7cd56b8dbc-sb7ds"
Oct 30 20:37:34.839525 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:34.839471    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-j7q2s"
Oct 30 20:37:34.853685 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:34.853657    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mgww7\" (UniqueName: \"kubernetes.io/projected/caca5f60-f777-4672-b570-faa422073cb9-kube-api-access-mgww7\") pod \"ingress-canary-dhfg8\" (UID: \"caca5f60-f777-4672-b570-faa422073cb9\") " pod="openshift-ingress-canary/ingress-canary-dhfg8"
Oct 30 20:37:35.138815 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:35.138738    2577 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kube-system/kas-connection-checker-685895c7c9-x8fpd"]
Oct 30 20:37:35.141346 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:35.141236    2577 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kube-system/kas-connection-checker-685895c7c9-tvmvh"]
Oct 30 20:37:35.142985 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:35.142956    2577 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod793cb601_841f_4511_9b8f_ff30262611c2.slice/crio-6c96cef7fbddfcbae2c787759d6f82c874b85287eb58630616057cdc4a1d30e8 WatchSource:0}: Error finding container 6c96cef7fbddfcbae2c787759d6f82c874b85287eb58630616057cdc4a1d30e8: Status 404 returned error can't find the container with id 6c96cef7fbddfcbae2c787759d6f82c874b85287eb58630616057cdc4a1d30e8
Oct 30 20:37:35.143649 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:35.143628    2577 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf1a05736_0bc6_4914_981e_5524121561e4.slice/crio-27bf82e38841ca1e4c5e87738b53e9b60debb5bcc4d39e42c16e5fa32783cce3 WatchSource:0}: Error finding container 27bf82e38841ca1e4c5e87738b53e9b60debb5bcc4d39e42c16e5fa32783cce3: Status 404 returned error can't find the container with id 27bf82e38841ca1e4c5e87738b53e9b60debb5bcc4d39e42c16e5fa32783cce3
Oct 30 20:37:35.150060 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:35.150031    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-dhfg8"
Oct 30 20:37:35.163544 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:35.163518    2577 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kube-system/kas-connection-checker-685895c7c9-tpsd4"]
Oct 30 20:37:35.168111 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:35.167147    2577 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddb64c15b_58b0_4829_b702_de7b6c846ab4.slice/crio-b0b15f491b8385bf9ee746cbd3985f832579b42a340c1dc6e3443af6f61f25e5 WatchSource:0}: Error finding container b0b15f491b8385bf9ee746cbd3985f832579b42a340c1dc6e3443af6f61f25e5: Status 404 returned error can't find the container with id b0b15f491b8385bf9ee746cbd3985f832579b42a340c1dc6e3443af6f61f25e5
Oct 30 20:37:35.190465 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:35.190043    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b3bff4d5-f9a8-4302-b63d-136ed3c6be35-registry-tls\") pod \"image-registry-6c5684fdcf-l5m76\" (UID: \"b3bff4d5-f9a8-4302-b63d-136ed3c6be35\") " pod="openshift-image-registry/image-registry-6c5684fdcf-l5m76"
Oct 30 20:37:35.190465 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:35.190130    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/d1fd1b0a-3831-4cb8-b6f3-ad2e67685188-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-884576c57-fl7nf\" (UID: \"d1fd1b0a-3831-4cb8-b6f3-ad2e67685188\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-fl7nf"
Oct 30 20:37:35.190465 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:35.190167    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/148ef018-4a87-49f3-8e89-839543748e77-registry-tls\") pod \"image-registry-556f5c99cd-v6q76\" (UID: \"148ef018-4a87-49f3-8e89-839543748e77\") " pod="openshift-image-registry/image-registry-556f5c99cd-v6q76"
Oct 30 20:37:35.190465 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:35.190195    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/6cd9770e-ea54-4c33-ac1e-5643f3d8839d-samples-operator-tls\") pod \"cluster-samples-operator-6ddb6c8b94-7d57c\" (UID: \"6cd9770e-ea54-4c33-ac1e-5643f3d8839d\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-7d57c"
Oct 30 20:37:35.190465 ip-10-0-138-85 kubenswrapper[2577]: E1030 20:37:35.190370    2577 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Oct 30 20:37:35.190465 ip-10-0-138-85 kubenswrapper[2577]: E1030 20:37:35.190388    2577 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Oct 30 20:37:35.190465 ip-10-0-138-85 kubenswrapper[2577]: E1030 20:37:35.190411    2577 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6c5684fdcf-l5m76: secret "image-registry-tls" not found
Oct 30 20:37:35.190465 ip-10-0-138-85 kubenswrapper[2577]: E1030 20:37:35.190434    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d1fd1b0a-3831-4cb8-b6f3-ad2e67685188-cluster-monitoring-operator-tls podName:d1fd1b0a-3831-4cb8-b6f3-ad2e67685188 nodeName:}" failed. No retries permitted until 2026-10-30 20:37:36.190415032 +0000 UTC m=+33.637210475 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/d1fd1b0a-3831-4cb8-b6f3-ad2e67685188-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-884576c57-fl7nf" (UID: "d1fd1b0a-3831-4cb8-b6f3-ad2e67685188") : secret "cluster-monitoring-operator-tls" not found
Oct 30 20:37:35.190465 ip-10-0-138-85 kubenswrapper[2577]: E1030 20:37:35.190455    2577 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Oct 30 20:37:35.190465 ip-10-0-138-85 kubenswrapper[2577]: E1030 20:37:35.190465    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b3bff4d5-f9a8-4302-b63d-136ed3c6be35-registry-tls podName:b3bff4d5-f9a8-4302-b63d-136ed3c6be35 nodeName:}" failed. No retries permitted until 2026-10-30 20:37:36.190447908 +0000 UTC m=+33.637243355 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/b3bff4d5-f9a8-4302-b63d-136ed3c6be35-registry-tls") pod "image-registry-6c5684fdcf-l5m76" (UID: "b3bff4d5-f9a8-4302-b63d-136ed3c6be35") : secret "image-registry-tls" not found
Oct 30 20:37:35.190465 ip-10-0-138-85 kubenswrapper[2577]: E1030 20:37:35.190388    2577 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Oct 30 20:37:35.190465 ip-10-0-138-85 kubenswrapper[2577]: E1030 20:37:35.190481    2577 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-556f5c99cd-v6q76: secret "image-registry-tls" not found
Oct 30 20:37:35.191837 ip-10-0-138-85 kubenswrapper[2577]: E1030 20:37:35.190509    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6cd9770e-ea54-4c33-ac1e-5643f3d8839d-samples-operator-tls podName:6cd9770e-ea54-4c33-ac1e-5643f3d8839d nodeName:}" failed. No retries permitted until 2026-10-30 20:37:36.190493618 +0000 UTC m=+33.637289061 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/6cd9770e-ea54-4c33-ac1e-5643f3d8839d-samples-operator-tls") pod "cluster-samples-operator-6ddb6c8b94-7d57c" (UID: "6cd9770e-ea54-4c33-ac1e-5643f3d8839d") : secret "samples-operator-tls" not found
Oct 30 20:37:35.191837 ip-10-0-138-85 kubenswrapper[2577]: E1030 20:37:35.190531    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/148ef018-4a87-49f3-8e89-839543748e77-registry-tls podName:148ef018-4a87-49f3-8e89-839543748e77 nodeName:}" failed. No retries permitted until 2026-10-30 20:37:36.190520407 +0000 UTC m=+33.637315837 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/148ef018-4a87-49f3-8e89-839543748e77-registry-tls") pod "image-registry-556f5c99cd-v6q76" (UID: "148ef018-4a87-49f3-8e89-839543748e77") : secret "image-registry-tls" not found
Oct 30 20:37:35.191837 ip-10-0-138-85 kubenswrapper[2577]: E1030 20:37:35.190648    2577 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Oct 30 20:37:35.191837 ip-10-0-138-85 kubenswrapper[2577]: E1030 20:37:35.190704    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/73676585-4ea4-43cb-af99-b4716472fb15-networking-console-plugin-cert podName:73676585-4ea4-43cb-af99-b4716472fb15 nodeName:}" failed. No retries permitted until 2026-10-30 20:37:36.19069035 +0000 UTC m=+33.637485801 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/73676585-4ea4-43cb-af99-b4716472fb15-networking-console-plugin-cert") pod "networking-console-plugin-86c478bb88-fl89x" (UID: "73676585-4ea4-43cb-af99-b4716472fb15") : secret "networking-console-plugin-cert" not found
Oct 30 20:37:35.192629 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:35.192090    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/73676585-4ea4-43cb-af99-b4716472fb15-networking-console-plugin-cert\") pod \"networking-console-plugin-86c478bb88-fl89x\" (UID: \"73676585-4ea4-43cb-af99-b4716472fb15\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-fl89x"
Oct 30 20:37:35.192629 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:35.192151    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/aaadd8de-58cb-45af-a477-384fbf1cf317-metrics-tls\") pod \"dns-default-265zm\" (UID: \"aaadd8de-58cb-45af-a477-384fbf1cf317\") " pod="openshift-dns/dns-default-265zm"
Oct 30 20:37:35.192629 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:35.192193    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cd59fef4-66a5-471b-a8ef-18df25e44d5c-metrics-certs\") pod \"router-default-5b9d6cdd59-4g6mx\" (UID: \"cd59fef4-66a5-471b-a8ef-18df25e44d5c\") " pod="openshift-ingress/router-default-5b9d6cdd59-4g6mx"
Oct 30 20:37:35.192629 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:35.192263    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cd59fef4-66a5-471b-a8ef-18df25e44d5c-service-ca-bundle\") pod \"router-default-5b9d6cdd59-4g6mx\" (UID: \"cd59fef4-66a5-471b-a8ef-18df25e44d5c\") " pod="openshift-ingress/router-default-5b9d6cdd59-4g6mx"
Oct 30 20:37:35.192629 ip-10-0-138-85 kubenswrapper[2577]: E1030 20:37:35.192414    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/cd59fef4-66a5-471b-a8ef-18df25e44d5c-service-ca-bundle podName:cd59fef4-66a5-471b-a8ef-18df25e44d5c nodeName:}" failed. No retries permitted until 2026-10-30 20:37:36.192400477 +0000 UTC m=+33.639195924 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/cd59fef4-66a5-471b-a8ef-18df25e44d5c-service-ca-bundle") pod "router-default-5b9d6cdd59-4g6mx" (UID: "cd59fef4-66a5-471b-a8ef-18df25e44d5c") : configmap references non-existent config key: service-ca.crt
Oct 30 20:37:35.192629 ip-10-0-138-85 kubenswrapper[2577]: E1030 20:37:35.192484    2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Oct 30 20:37:35.192629 ip-10-0-138-85 kubenswrapper[2577]: E1030 20:37:35.192518    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aaadd8de-58cb-45af-a477-384fbf1cf317-metrics-tls podName:aaadd8de-58cb-45af-a477-384fbf1cf317 nodeName:}" failed. No retries permitted until 2026-10-30 20:37:36.19250684 +0000 UTC m=+33.639302281 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/aaadd8de-58cb-45af-a477-384fbf1cf317-metrics-tls") pod "dns-default-265zm" (UID: "aaadd8de-58cb-45af-a477-384fbf1cf317") : secret "dns-default-metrics-tls" not found
Oct 30 20:37:35.192629 ip-10-0-138-85 kubenswrapper[2577]: E1030 20:37:35.192576    2577 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Oct 30 20:37:35.192629 ip-10-0-138-85 kubenswrapper[2577]: E1030 20:37:35.192607    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cd59fef4-66a5-471b-a8ef-18df25e44d5c-metrics-certs podName:cd59fef4-66a5-471b-a8ef-18df25e44d5c nodeName:}" failed. No retries permitted until 2026-10-30 20:37:36.192596738 +0000 UTC m=+33.639392180 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/cd59fef4-66a5-471b-a8ef-18df25e44d5c-metrics-certs") pod "router-default-5b9d6cdd59-4g6mx" (UID: "cd59fef4-66a5-471b-a8ef-18df25e44d5c") : secret "router-metrics-certs-default" not found
Oct 30 20:37:35.201507 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:35.201388    2577 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-7c4986d449-tvsdw"]
Oct 30 20:37:35.207004 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:35.203329    2577 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-mwm8h"]
Oct 30 20:37:35.220608 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:35.210594    2577 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod537a9c41_5ed1_4ff5_bf9a_9d0bcb853f80.slice/crio-1a172c2763bdb8dfac94e4dfe195534aca58c8414f72576402b6d15d9301741f WatchSource:0}: Error finding container 1a172c2763bdb8dfac94e4dfe195534aca58c8414f72576402b6d15d9301741f: Status 404 returned error can't find the container with id 1a172c2763bdb8dfac94e4dfe195534aca58c8414f72576402b6d15d9301741f
Oct 30 20:37:35.256134 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:35.256104    2577 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-6f78d59f99-gqbfm"]
Oct 30 20:37:35.256238 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:35.256174    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kas-connection-checker-685895c7c9-tpsd4" event={"ID":"db64c15b-58b0-4829-b702-de7b6c846ab4","Type":"ContainerStarted","Data":"b0b15f491b8385bf9ee746cbd3985f832579b42a340c1dc6e3443af6f61f25e5"}
Oct 30 20:37:35.260893 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:35.260116    2577 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-544d749c8c-gnfbh"]
Oct 30 20:37:35.262286 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:35.262217    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kas-connection-checker-685895c7c9-x8fpd" event={"ID":"793cb601-841f-4511-9b8f-ff30262611c2","Type":"ContainerStarted","Data":"6c96cef7fbddfcbae2c787759d6f82c874b85287eb58630616057cdc4a1d30e8"}
Oct 30 20:37:35.263840 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:35.263818    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-mwm8h" event={"ID":"537a9c41-5ed1-4ff5-bf9a-9d0bcb853f80","Type":"ContainerStarted","Data":"1a172c2763bdb8dfac94e4dfe195534aca58c8414f72576402b6d15d9301741f"}
Oct 30 20:37:35.264941 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:35.264920    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-7c4986d449-tvsdw" event={"ID":"4dde41e2-34fe-429b-bf23-35bdb99d894e","Type":"ContainerStarted","Data":"bc0f209bfe0d8144bd3957cdb82896a69e098ce4b1ada0009dc90854b036073c"}
Oct 30 20:37:35.274768 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:35.271846    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kas-connection-checker-685895c7c9-tvmvh" event={"ID":"f1a05736-0bc6-4914-981e-5524121561e4","Type":"ContainerStarted","Data":"27bf82e38841ca1e4c5e87738b53e9b60debb5bcc4d39e42c16e5fa32783cce3"}
Oct 30 20:37:35.274768 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:35.274457    2577 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-7cd56b8dbc-sb7ds"]
Oct 30 20:37:35.276299 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:35.276240    2577 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-j7q2s"]
Oct 30 20:37:35.531556 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:35.531525    2577 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-dhfg8"]
Oct 30 20:37:35.534150 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:35.534124    2577 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcaca5f60_f777_4672_b570_faa422073cb9.slice/crio-4088da9d4706d1180c27fbdd893b9e7895365e1298191651e59b97cd0ae5dc29 WatchSource:0}: Error finding container 4088da9d4706d1180c27fbdd893b9e7895365e1298191651e59b97cd0ae5dc29: Status 404 returned error can't find the container with id 4088da9d4706d1180c27fbdd893b9e7895365e1298191651e59b97cd0ae5dc29
Oct 30 20:37:35.998143 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:35.998114    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a4cdc725-3dd0-4917-b8a0-c8ff77a40abb-original-pull-secret\") pod \"global-pull-secret-syncer-tvvd9\" (UID: \"a4cdc725-3dd0-4917-b8a0-c8ff77a40abb\") " pod="kube-system/global-pull-secret-syncer-tvvd9"
Oct 30 20:37:35.998295 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:35.998152    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0f424633-11a5-49fa-a933-f9c6ec7ca97e-metrics-certs\") pod \"network-metrics-daemon-mlctd\" (UID: \"0f424633-11a5-49fa-a933-f9c6ec7ca97e\") " pod="openshift-multus/network-metrics-daemon-mlctd"
Oct 30 20:37:35.998295 ip-10-0-138-85 kubenswrapper[2577]: E1030 20:37:35.998251    2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 30 20:37:35.998295 ip-10-0-138-85 kubenswrapper[2577]: E1030 20:37:35.998266    2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Oct 30 20:37:35.998295 ip-10-0-138-85 kubenswrapper[2577]: E1030 20:37:35.998297    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0f424633-11a5-49fa-a933-f9c6ec7ca97e-metrics-certs podName:0f424633-11a5-49fa-a933-f9c6ec7ca97e nodeName:}" failed. No retries permitted until 2026-10-30 20:38:07.998285927 +0000 UTC m=+65.445081354 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0f424633-11a5-49fa-a933-f9c6ec7ca97e-metrics-certs") pod "network-metrics-daemon-mlctd" (UID: "0f424633-11a5-49fa-a933-f9c6ec7ca97e") : object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 30 20:37:35.998506 ip-10-0-138-85 kubenswrapper[2577]: E1030 20:37:35.998324    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a4cdc725-3dd0-4917-b8a0-c8ff77a40abb-original-pull-secret podName:a4cdc725-3dd0-4917-b8a0-c8ff77a40abb nodeName:}" failed. No retries permitted until 2026-10-30 20:38:07.998308269 +0000 UTC m=+65.445103710 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a4cdc725-3dd0-4917-b8a0-c8ff77a40abb-original-pull-secret") pod "global-pull-secret-syncer-tvvd9" (UID: "a4cdc725-3dd0-4917-b8a0-c8ff77a40abb") : object "kube-system"/"original-pull-secret" not registered
Oct 30 20:37:36.044420 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:36.044387    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lqdtq"
Oct 30 20:37:36.044540 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:36.044492    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mlctd"
Oct 30 20:37:36.044712 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:36.044593    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tvvd9"
Oct 30 20:37:36.099161 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:36.099129    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7qzv8\" (UniqueName: \"kubernetes.io/projected/50e37bd4-e46f-4577-b7b2-1ac7695637ea-kube-api-access-7qzv8\") pod \"network-check-target-lqdtq\" (UID: \"50e37bd4-e46f-4577-b7b2-1ac7695637ea\") " pod="openshift-network-diagnostics/network-check-target-lqdtq"
Oct 30 20:37:36.100921 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:36.100901    2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Oct 30 20:37:36.101074 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:36.101023    2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"global-pull-secret-syncer-dockercfg-49f2v\""
Oct 30 20:37:36.101125 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:36.101076    2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-check-target-dockercfg-hjmcj\""
Oct 30 20:37:36.102063 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:36.102032    2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-4lpn7\""
Oct 30 20:37:36.102293 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:36.102277    2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Oct 30 20:37:36.102549 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:36.102528    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7qzv8\" (UniqueName: \"kubernetes.io/projected/50e37bd4-e46f-4577-b7b2-1ac7695637ea-kube-api-access-7qzv8\") pod \"network-check-target-lqdtq\" (UID: \"50e37bd4-e46f-4577-b7b2-1ac7695637ea\") " pod="openshift-network-diagnostics/network-check-target-lqdtq"
Oct 30 20:37:36.200181 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:36.200137    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cd59fef4-66a5-471b-a8ef-18df25e44d5c-service-ca-bundle\") pod \"router-default-5b9d6cdd59-4g6mx\" (UID: \"cd59fef4-66a5-471b-a8ef-18df25e44d5c\") " pod="openshift-ingress/router-default-5b9d6cdd59-4g6mx"
Oct 30 20:37:36.200572 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:36.200231    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b3bff4d5-f9a8-4302-b63d-136ed3c6be35-registry-tls\") pod \"image-registry-6c5684fdcf-l5m76\" (UID: \"b3bff4d5-f9a8-4302-b63d-136ed3c6be35\") " pod="openshift-image-registry/image-registry-6c5684fdcf-l5m76"
Oct 30 20:37:36.200572 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:36.200296    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/d1fd1b0a-3831-4cb8-b6f3-ad2e67685188-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-884576c57-fl7nf\" (UID: \"d1fd1b0a-3831-4cb8-b6f3-ad2e67685188\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-fl7nf"
Oct 30 20:37:36.200572 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:36.200331    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/148ef018-4a87-49f3-8e89-839543748e77-registry-tls\") pod \"image-registry-556f5c99cd-v6q76\" (UID: \"148ef018-4a87-49f3-8e89-839543748e77\") " pod="openshift-image-registry/image-registry-556f5c99cd-v6q76"
Oct 30 20:37:36.200572 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:36.200358    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/6cd9770e-ea54-4c33-ac1e-5643f3d8839d-samples-operator-tls\") pod \"cluster-samples-operator-6ddb6c8b94-7d57c\" (UID: \"6cd9770e-ea54-4c33-ac1e-5643f3d8839d\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-7d57c"
Oct 30 20:37:36.200572 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:36.200385    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/73676585-4ea4-43cb-af99-b4716472fb15-networking-console-plugin-cert\") pod \"networking-console-plugin-86c478bb88-fl89x\" (UID: \"73676585-4ea4-43cb-af99-b4716472fb15\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-fl89x"
Oct 30 20:37:36.200572 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:36.200431    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/aaadd8de-58cb-45af-a477-384fbf1cf317-metrics-tls\") pod \"dns-default-265zm\" (UID: \"aaadd8de-58cb-45af-a477-384fbf1cf317\") " pod="openshift-dns/dns-default-265zm"
Oct 30 20:37:36.200572 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:36.200467    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cd59fef4-66a5-471b-a8ef-18df25e44d5c-metrics-certs\") pod \"router-default-5b9d6cdd59-4g6mx\" (UID: \"cd59fef4-66a5-471b-a8ef-18df25e44d5c\") " pod="openshift-ingress/router-default-5b9d6cdd59-4g6mx"
Oct 30 20:37:36.200572 ip-10-0-138-85 kubenswrapper[2577]: E1030 20:37:36.200529    2577 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Oct 30 20:37:36.200572 ip-10-0-138-85 kubenswrapper[2577]: E1030 20:37:36.200545    2577 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-556f5c99cd-v6q76: secret "image-registry-tls" not found
Oct 30 20:37:36.200894 ip-10-0-138-85 kubenswrapper[2577]: E1030 20:37:36.200589    2577 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Oct 30 20:37:36.200894 ip-10-0-138-85 kubenswrapper[2577]: E1030 20:37:36.200596    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/148ef018-4a87-49f3-8e89-839543748e77-registry-tls podName:148ef018-4a87-49f3-8e89-839543748e77 nodeName:}" failed. No retries permitted until 2026-10-30 20:37:38.200578025 +0000 UTC m=+35.647373473 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/148ef018-4a87-49f3-8e89-839543748e77-registry-tls") pod "image-registry-556f5c99cd-v6q76" (UID: "148ef018-4a87-49f3-8e89-839543748e77") : secret "image-registry-tls" not found
Oct 30 20:37:36.200894 ip-10-0-138-85 kubenswrapper[2577]: E1030 20:37:36.200652    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cd59fef4-66a5-471b-a8ef-18df25e44d5c-metrics-certs podName:cd59fef4-66a5-471b-a8ef-18df25e44d5c nodeName:}" failed. No retries permitted until 2026-10-30 20:37:38.200637459 +0000 UTC m=+35.647432891 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/cd59fef4-66a5-471b-a8ef-18df25e44d5c-metrics-certs") pod "router-default-5b9d6cdd59-4g6mx" (UID: "cd59fef4-66a5-471b-a8ef-18df25e44d5c") : secret "router-metrics-certs-default" not found
Oct 30 20:37:36.200894 ip-10-0-138-85 kubenswrapper[2577]: E1030 20:37:36.200685    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/cd59fef4-66a5-471b-a8ef-18df25e44d5c-service-ca-bundle podName:cd59fef4-66a5-471b-a8ef-18df25e44d5c nodeName:}" failed. No retries permitted until 2026-10-30 20:37:38.200672977 +0000 UTC m=+35.647468419 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/cd59fef4-66a5-471b-a8ef-18df25e44d5c-service-ca-bundle") pod "router-default-5b9d6cdd59-4g6mx" (UID: "cd59fef4-66a5-471b-a8ef-18df25e44d5c") : configmap references non-existent config key: service-ca.crt
Oct 30 20:37:36.200894 ip-10-0-138-85 kubenswrapper[2577]: E1030 20:37:36.200718    2577 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Oct 30 20:37:36.200894 ip-10-0-138-85 kubenswrapper[2577]: E1030 20:37:36.200745    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6cd9770e-ea54-4c33-ac1e-5643f3d8839d-samples-operator-tls podName:6cd9770e-ea54-4c33-ac1e-5643f3d8839d nodeName:}" failed. No retries permitted until 2026-10-30 20:37:38.200735824 +0000 UTC m=+35.647531251 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/6cd9770e-ea54-4c33-ac1e-5643f3d8839d-samples-operator-tls") pod "cluster-samples-operator-6ddb6c8b94-7d57c" (UID: "6cd9770e-ea54-4c33-ac1e-5643f3d8839d") : secret "samples-operator-tls" not found
Oct 30 20:37:36.200894 ip-10-0-138-85 kubenswrapper[2577]: E1030 20:37:36.200745    2577 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Oct 30 20:37:36.200894 ip-10-0-138-85 kubenswrapper[2577]: E1030 20:37:36.200760    2577 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6c5684fdcf-l5m76: secret "image-registry-tls" not found
Oct 30 20:37:36.200894 ip-10-0-138-85 kubenswrapper[2577]: E1030 20:37:36.200789    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b3bff4d5-f9a8-4302-b63d-136ed3c6be35-registry-tls podName:b3bff4d5-f9a8-4302-b63d-136ed3c6be35 nodeName:}" failed. No retries permitted until 2026-10-30 20:37:38.20078009 +0000 UTC m=+35.647575517 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/b3bff4d5-f9a8-4302-b63d-136ed3c6be35-registry-tls") pod "image-registry-6c5684fdcf-l5m76" (UID: "b3bff4d5-f9a8-4302-b63d-136ed3c6be35") : secret "image-registry-tls" not found
Oct 30 20:37:36.200894 ip-10-0-138-85 kubenswrapper[2577]: E1030 20:37:36.200797    2577 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Oct 30 20:37:36.200894 ip-10-0-138-85 kubenswrapper[2577]: E1030 20:37:36.200828    2577 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Oct 30 20:37:36.200894 ip-10-0-138-85 kubenswrapper[2577]: E1030 20:37:36.200832    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d1fd1b0a-3831-4cb8-b6f3-ad2e67685188-cluster-monitoring-operator-tls podName:d1fd1b0a-3831-4cb8-b6f3-ad2e67685188 nodeName:}" failed. No retries permitted until 2026-10-30 20:37:38.200820858 +0000 UTC m=+35.647616323 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/d1fd1b0a-3831-4cb8-b6f3-ad2e67685188-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-884576c57-fl7nf" (UID: "d1fd1b0a-3831-4cb8-b6f3-ad2e67685188") : secret "cluster-monitoring-operator-tls" not found
Oct 30 20:37:36.200894 ip-10-0-138-85 kubenswrapper[2577]: E1030 20:37:36.200860    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/73676585-4ea4-43cb-af99-b4716472fb15-networking-console-plugin-cert podName:73676585-4ea4-43cb-af99-b4716472fb15 nodeName:}" failed. No retries permitted until 2026-10-30 20:37:38.200848896 +0000 UTC m=+35.647644352 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/73676585-4ea4-43cb-af99-b4716472fb15-networking-console-plugin-cert") pod "networking-console-plugin-86c478bb88-fl89x" (UID: "73676585-4ea4-43cb-af99-b4716472fb15") : secret "networking-console-plugin-cert" not found
Oct 30 20:37:36.200894 ip-10-0-138-85 kubenswrapper[2577]: E1030 20:37:36.200881    2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Oct 30 20:37:36.201483 ip-10-0-138-85 kubenswrapper[2577]: E1030 20:37:36.200911    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aaadd8de-58cb-45af-a477-384fbf1cf317-metrics-tls podName:aaadd8de-58cb-45af-a477-384fbf1cf317 nodeName:}" failed. No retries permitted until 2026-10-30 20:37:38.200901109 +0000 UTC m=+35.647696552 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/aaadd8de-58cb-45af-a477-384fbf1cf317-metrics-tls") pod "dns-default-265zm" (UID: "aaadd8de-58cb-45af-a477-384fbf1cf317") : secret "dns-default-metrics-tls" not found
Oct 30 20:37:36.283681 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:36.283598    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kas-connection-checker-685895c7c9-tpsd4" event={"ID":"db64c15b-58b0-4829-b702-de7b6c846ab4","Type":"ContainerStarted","Data":"6137704f973aeb47a5ab36396b85a495976736a56d0dec15929fdff205f32acf"}
Oct 30 20:37:36.290927 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:36.290894    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kas-connection-checker-685895c7c9-x8fpd" event={"ID":"793cb601-841f-4511-9b8f-ff30262611c2","Type":"ContainerStarted","Data":"ffaffff50fb06552078b89ba92062d65bfe913801281dfb4adb8e59452d8974f"}
Oct 30 20:37:36.293460 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:36.293431    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kas-connection-checker-685895c7c9-tvmvh" event={"ID":"f1a05736-0bc6-4914-981e-5524121561e4","Type":"ContainerStarted","Data":"ec85c2f4d302881d8c2b6bf4913cdeb7163f0b9d40c168140791b17d8f6eb69a"}
Oct 30 20:37:36.298381 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:36.298351    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-j7q2s" event={"ID":"ee37dd25-4ac1-474f-80b8-d04da8da560c","Type":"ContainerStarted","Data":"09410978095d72951cc272dae5be2979d26a77b38714d8e43fbcbffb974196a1"}
Oct 30 20:37:36.301232 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:36.301171    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-dhfg8" event={"ID":"caca5f60-f777-4672-b570-faa422073cb9","Type":"ContainerStarted","Data":"4088da9d4706d1180c27fbdd893b9e7895365e1298191651e59b97cd0ae5dc29"}
Oct 30 20:37:36.302958 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:36.302898    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-6f78d59f99-gqbfm" event={"ID":"e5ac6e6d-4ea4-4874-b2eb-285977a285f7","Type":"ContainerStarted","Data":"f9d5194c08d6e2f26953231b76211dcdf3a77c719149ff159692ef748005380f"}
Oct 30 20:37:36.305959 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:36.305900    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-gnfbh" event={"ID":"e33ef368-1f7c-4455-beb9-a2b2c5106792","Type":"ContainerStarted","Data":"fcb69e9039ff6b8835f54db87a5c29114b148ed76f6ce48a9933d8bba63a3b4d"}
Oct 30 20:37:36.308254 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:36.308204    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7cd56b8dbc-sb7ds" event={"ID":"90cd3de0-c573-41c2-bf3e-cf0e46a41d50","Type":"ContainerStarted","Data":"02a557dab75dfe0f6ed35c6634e8a3488f54d0eb99085daa7b5deb877d2e1ba7"}
Oct 30 20:37:36.358315 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:36.358063    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lqdtq"
Oct 30 20:37:36.605562 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:36.605469    2577 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kube-system/kas-connection-checker-685895c7c9-tpsd4" podStartSLOduration=433.605449891 podStartE2EDuration="7m13.605449891s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:30:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:37:36.604521228 +0000 UTC m=+34.051316677" watchObservedRunningTime="2026-10-30 20:37:36.605449891 +0000 UTC m=+34.052245340"
Oct 30 20:37:36.756150 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:36.756087    2577 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kube-system/kas-connection-checker-685895c7c9-x8fpd" podStartSLOduration=433.756066231 podStartE2EDuration="7m13.756066231s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:30:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:37:36.726122744 +0000 UTC m=+34.172918195" watchObservedRunningTime="2026-10-30 20:37:36.756066231 +0000 UTC m=+34.202861682"
Oct 30 20:37:36.756469 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:36.756441    2577 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-lqdtq"]
Oct 30 20:37:36.778827 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:36.778788    2577 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod50e37bd4_e46f_4577_b7b2_1ac7695637ea.slice/crio-e606140f9254872cbc379fb7b09b46df44fb15fed7d1375637c8d2ae8239f421 WatchSource:0}: Error finding container e606140f9254872cbc379fb7b09b46df44fb15fed7d1375637c8d2ae8239f421: Status 404 returned error can't find the container with id e606140f9254872cbc379fb7b09b46df44fb15fed7d1375637c8d2ae8239f421
Oct 30 20:37:37.318777 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:37.318742    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-lqdtq" event={"ID":"50e37bd4-e46f-4577-b7b2-1ac7695637ea","Type":"ContainerStarted","Data":"e606140f9254872cbc379fb7b09b46df44fb15fed7d1375637c8d2ae8239f421"}
Oct 30 20:37:38.220967 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:38.220924    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/d1fd1b0a-3831-4cb8-b6f3-ad2e67685188-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-884576c57-fl7nf\" (UID: \"d1fd1b0a-3831-4cb8-b6f3-ad2e67685188\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-fl7nf"
Oct 30 20:37:38.221138 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:38.220984    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/148ef018-4a87-49f3-8e89-839543748e77-registry-tls\") pod \"image-registry-556f5c99cd-v6q76\" (UID: \"148ef018-4a87-49f3-8e89-839543748e77\") " pod="openshift-image-registry/image-registry-556f5c99cd-v6q76"
Oct 30 20:37:38.221138 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:38.221018    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/6cd9770e-ea54-4c33-ac1e-5643f3d8839d-samples-operator-tls\") pod \"cluster-samples-operator-6ddb6c8b94-7d57c\" (UID: \"6cd9770e-ea54-4c33-ac1e-5643f3d8839d\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-7d57c"
Oct 30 20:37:38.221138 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:38.221061    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/73676585-4ea4-43cb-af99-b4716472fb15-networking-console-plugin-cert\") pod \"networking-console-plugin-86c478bb88-fl89x\" (UID: \"73676585-4ea4-43cb-af99-b4716472fb15\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-fl89x"
Oct 30 20:37:38.221138 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:38.221095    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/aaadd8de-58cb-45af-a477-384fbf1cf317-metrics-tls\") pod \"dns-default-265zm\" (UID: \"aaadd8de-58cb-45af-a477-384fbf1cf317\") " pod="openshift-dns/dns-default-265zm"
Oct 30 20:37:38.221305 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:38.221129    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cd59fef4-66a5-471b-a8ef-18df25e44d5c-metrics-certs\") pod \"router-default-5b9d6cdd59-4g6mx\" (UID: \"cd59fef4-66a5-471b-a8ef-18df25e44d5c\") " pod="openshift-ingress/router-default-5b9d6cdd59-4g6mx"
Oct 30 20:37:38.221305 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:38.221200    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cd59fef4-66a5-471b-a8ef-18df25e44d5c-service-ca-bundle\") pod \"router-default-5b9d6cdd59-4g6mx\" (UID: \"cd59fef4-66a5-471b-a8ef-18df25e44d5c\") " pod="openshift-ingress/router-default-5b9d6cdd59-4g6mx"
Oct 30 20:37:38.221305 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:38.221273    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b3bff4d5-f9a8-4302-b63d-136ed3c6be35-registry-tls\") pod \"image-registry-6c5684fdcf-l5m76\" (UID: \"b3bff4d5-f9a8-4302-b63d-136ed3c6be35\") " pod="openshift-image-registry/image-registry-6c5684fdcf-l5m76"
Oct 30 20:37:38.221446 ip-10-0-138-85 kubenswrapper[2577]: E1030 20:37:38.221428    2577 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Oct 30 20:37:38.221490 ip-10-0-138-85 kubenswrapper[2577]: E1030 20:37:38.221450    2577 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6c5684fdcf-l5m76: secret "image-registry-tls" not found
Oct 30 20:37:38.221537 ip-10-0-138-85 kubenswrapper[2577]: E1030 20:37:38.221507    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b3bff4d5-f9a8-4302-b63d-136ed3c6be35-registry-tls podName:b3bff4d5-f9a8-4302-b63d-136ed3c6be35 nodeName:}" failed. No retries permitted until 2026-10-30 20:37:42.221488881 +0000 UTC m=+39.668284320 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/b3bff4d5-f9a8-4302-b63d-136ed3c6be35-registry-tls") pod "image-registry-6c5684fdcf-l5m76" (UID: "b3bff4d5-f9a8-4302-b63d-136ed3c6be35") : secret "image-registry-tls" not found
Oct 30 20:37:38.221933 ip-10-0-138-85 kubenswrapper[2577]: E1030 20:37:38.221909    2577 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Oct 30 20:37:38.222024 ip-10-0-138-85 kubenswrapper[2577]: E1030 20:37:38.221969    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d1fd1b0a-3831-4cb8-b6f3-ad2e67685188-cluster-monitoring-operator-tls podName:d1fd1b0a-3831-4cb8-b6f3-ad2e67685188 nodeName:}" failed. No retries permitted until 2026-10-30 20:37:42.2219533 +0000 UTC m=+39.668748730 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/d1fd1b0a-3831-4cb8-b6f3-ad2e67685188-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-884576c57-fl7nf" (UID: "d1fd1b0a-3831-4cb8-b6f3-ad2e67685188") : secret "cluster-monitoring-operator-tls" not found
Oct 30 20:37:38.222100 ip-10-0-138-85 kubenswrapper[2577]: E1030 20:37:38.222034    2577 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Oct 30 20:37:38.222100 ip-10-0-138-85 kubenswrapper[2577]: E1030 20:37:38.222062    2577 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-556f5c99cd-v6q76: secret "image-registry-tls" not found
Oct 30 20:37:38.222100 ip-10-0-138-85 kubenswrapper[2577]: E1030 20:37:38.222097    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/148ef018-4a87-49f3-8e89-839543748e77-registry-tls podName:148ef018-4a87-49f3-8e89-839543748e77 nodeName:}" failed. No retries permitted until 2026-10-30 20:37:42.222085381 +0000 UTC m=+39.668880822 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/148ef018-4a87-49f3-8e89-839543748e77-registry-tls") pod "image-registry-556f5c99cd-v6q76" (UID: "148ef018-4a87-49f3-8e89-839543748e77") : secret "image-registry-tls" not found
Oct 30 20:37:38.222264 ip-10-0-138-85 kubenswrapper[2577]: E1030 20:37:38.222155    2577 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Oct 30 20:37:38.222264 ip-10-0-138-85 kubenswrapper[2577]: E1030 20:37:38.222189    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6cd9770e-ea54-4c33-ac1e-5643f3d8839d-samples-operator-tls podName:6cd9770e-ea54-4c33-ac1e-5643f3d8839d nodeName:}" failed. No retries permitted until 2026-10-30 20:37:42.222179409 +0000 UTC m=+39.668974851 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/6cd9770e-ea54-4c33-ac1e-5643f3d8839d-samples-operator-tls") pod "cluster-samples-operator-6ddb6c8b94-7d57c" (UID: "6cd9770e-ea54-4c33-ac1e-5643f3d8839d") : secret "samples-operator-tls" not found
Oct 30 20:37:38.222264 ip-10-0-138-85 kubenswrapper[2577]: E1030 20:37:38.222237    2577 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Oct 30 20:37:38.222399 ip-10-0-138-85 kubenswrapper[2577]: E1030 20:37:38.222267    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/73676585-4ea4-43cb-af99-b4716472fb15-networking-console-plugin-cert podName:73676585-4ea4-43cb-af99-b4716472fb15 nodeName:}" failed. No retries permitted until 2026-10-30 20:37:42.222257713 +0000 UTC m=+39.669053140 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/73676585-4ea4-43cb-af99-b4716472fb15-networking-console-plugin-cert") pod "networking-console-plugin-86c478bb88-fl89x" (UID: "73676585-4ea4-43cb-af99-b4716472fb15") : secret "networking-console-plugin-cert" not found
Oct 30 20:37:38.222399 ip-10-0-138-85 kubenswrapper[2577]: E1030 20:37:38.222318    2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Oct 30 20:37:38.222399 ip-10-0-138-85 kubenswrapper[2577]: E1030 20:37:38.222359    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aaadd8de-58cb-45af-a477-384fbf1cf317-metrics-tls podName:aaadd8de-58cb-45af-a477-384fbf1cf317 nodeName:}" failed. No retries permitted until 2026-10-30 20:37:42.22233671 +0000 UTC m=+39.669132141 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/aaadd8de-58cb-45af-a477-384fbf1cf317-metrics-tls") pod "dns-default-265zm" (UID: "aaadd8de-58cb-45af-a477-384fbf1cf317") : secret "dns-default-metrics-tls" not found
Oct 30 20:37:38.222499 ip-10-0-138-85 kubenswrapper[2577]: E1030 20:37:38.222408    2577 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Oct 30 20:37:38.222499 ip-10-0-138-85 kubenswrapper[2577]: E1030 20:37:38.222439    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cd59fef4-66a5-471b-a8ef-18df25e44d5c-metrics-certs podName:cd59fef4-66a5-471b-a8ef-18df25e44d5c nodeName:}" failed. No retries permitted until 2026-10-30 20:37:42.222428423 +0000 UTC m=+39.669223864 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/cd59fef4-66a5-471b-a8ef-18df25e44d5c-metrics-certs") pod "router-default-5b9d6cdd59-4g6mx" (UID: "cd59fef4-66a5-471b-a8ef-18df25e44d5c") : secret "router-metrics-certs-default" not found
Oct 30 20:37:38.222562 ip-10-0-138-85 kubenswrapper[2577]: E1030 20:37:38.222502    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/cd59fef4-66a5-471b-a8ef-18df25e44d5c-service-ca-bundle podName:cd59fef4-66a5-471b-a8ef-18df25e44d5c nodeName:}" failed. No retries permitted until 2026-10-30 20:37:42.22249255 +0000 UTC m=+39.669287991 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/cd59fef4-66a5-471b-a8ef-18df25e44d5c-service-ca-bundle") pod "router-default-5b9d6cdd59-4g6mx" (UID: "cd59fef4-66a5-471b-a8ef-18df25e44d5c") : configmap references non-existent config key: service-ca.crt
Oct 30 20:37:38.332594 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:38.331815    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-mwm8h" event={"ID":"537a9c41-5ed1-4ff5-bf9a-9d0bcb853f80","Type":"ContainerStarted","Data":"3bf1b9759925072a278115e2967611745fdd0158e43aa00528a01e64859a5d99"}
Oct 30 20:37:38.446365 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:38.446304    2577 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kube-system/kas-connection-checker-685895c7c9-tvmvh" podStartSLOduration=435.446284966 podStartE2EDuration="7m15.446284966s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:30:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:37:36.842943175 +0000 UTC m=+34.289738623" watchObservedRunningTime="2026-10-30 20:37:38.446284966 +0000 UTC m=+35.893080418"
Oct 30 20:37:38.447162 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:38.447117    2577 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-mwm8h" podStartSLOduration=401.401607271 podStartE2EDuration="6m43.447104076s" totalImagesPullingTime="2.045496805s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:30:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:37:38.446076583 +0000 UTC m=+35.892872033" watchObservedRunningTime="2026-10-30 20:37:38.447104076 +0000 UTC m=+35.893899525"
Oct 30 20:37:40.342738 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:40.342711    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-sb7ds_90cd3de0-c573-41c2-bf3e-cf0e46a41d50/console-operator/0.log"
Oct 30 20:37:40.343173 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:40.342753    2577 generic.go:356] "Generic (PLEG): container finished" podID="90cd3de0-c573-41c2-bf3e-cf0e46a41d50" containerID="c7446be0e629e8b9038412c1dbc78cca7562f43fe626c50c1733e1ce20322b69" exitCode=255
Oct 30 20:37:40.343173 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:40.342781    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7cd56b8dbc-sb7ds" event={"ID":"90cd3de0-c573-41c2-bf3e-cf0e46a41d50","Type":"ContainerDied","Data":"c7446be0e629e8b9038412c1dbc78cca7562f43fe626c50c1733e1ce20322b69"}
Oct 30 20:37:40.343173 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:40.343123    2577 scope.go:122] "RemoveContainer" containerID="c7446be0e629e8b9038412c1dbc78cca7562f43fe626c50c1733e1ce20322b69"
Oct 30 20:37:41.347927 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:41.347898    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-7c4986d449-tvsdw" event={"ID":"4dde41e2-34fe-429b-bf23-35bdb99d894e","Type":"ContainerStarted","Data":"87fb172d2018fb8af934e3e754c5b80e94d153407d1dec4defc3cb111f61afc2"}
Oct 30 20:37:41.351228 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:41.350088    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-j7q2s" event={"ID":"ee37dd25-4ac1-474f-80b8-d04da8da560c","Type":"ContainerStarted","Data":"7f847c009231ad38087375d9151e3fcaadac4d6a84c47211683dc5d0bebc0e02"}
Oct 30 20:37:41.353080 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:41.353035    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-gnfbh" event={"ID":"e33ef368-1f7c-4455-beb9-a2b2c5106792","Type":"ContainerStarted","Data":"7fc9ee7ed72e74b95eedce1763293fd97eaad1e1fd13a2febb3256895a23020b"}
Oct 30 20:37:41.355113 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:41.355088    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-sb7ds_90cd3de0-c573-41c2-bf3e-cf0e46a41d50/console-operator/1.log"
Oct 30 20:37:41.355703 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:41.355680    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-sb7ds_90cd3de0-c573-41c2-bf3e-cf0e46a41d50/console-operator/0.log"
Oct 30 20:37:41.355786 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:41.355721    2577 generic.go:356] "Generic (PLEG): container finished" podID="90cd3de0-c573-41c2-bf3e-cf0e46a41d50" containerID="9fe6599cf15d4157e951b11cb7fc3cb00a172c92956aca003b44194fb8d09fe5" exitCode=255
Oct 30 20:37:41.355786 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:41.355754    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7cd56b8dbc-sb7ds" event={"ID":"90cd3de0-c573-41c2-bf3e-cf0e46a41d50","Type":"ContainerDied","Data":"9fe6599cf15d4157e951b11cb7fc3cb00a172c92956aca003b44194fb8d09fe5"}
Oct 30 20:37:41.355864 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:41.355796    2577 scope.go:122] "RemoveContainer" containerID="c7446be0e629e8b9038412c1dbc78cca7562f43fe626c50c1733e1ce20322b69"
Oct 30 20:37:41.356157 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:41.356140    2577 scope.go:122] "RemoveContainer" containerID="9fe6599cf15d4157e951b11cb7fc3cb00a172c92956aca003b44194fb8d09fe5"
Oct 30 20:37:41.356347 ip-10-0-138-85 kubenswrapper[2577]: E1030 20:37:41.356327    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7cd56b8dbc-sb7ds_openshift-console-operator(90cd3de0-c573-41c2-bf3e-cf0e46a41d50)\"" pod="openshift-console-operator/console-operator-7cd56b8dbc-sb7ds" podUID="90cd3de0-c573-41c2-bf3e-cf0e46a41d50"
Oct 30 20:37:41.462799 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:41.462738    2577 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-insights/insights-operator-7c4986d449-tvsdw" podStartSLOduration=400.993825714 podStartE2EDuration="6m46.462722691s" totalImagesPullingTime="5.468896977s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:30:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:37:41.461488525 +0000 UTC m=+38.908283966" watchObservedRunningTime="2026-10-30 20:37:41.462722691 +0000 UTC m=+38.909518141"
Oct 30 20:37:41.692501 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:41.692437    2577 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-j7q2s" podStartSLOduration=401.645607067 podStartE2EDuration="6m46.692418704s" totalImagesPullingTime="5.046811637s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:30:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:37:41.578205272 +0000 UTC m=+39.025000722" watchObservedRunningTime="2026-10-30 20:37:41.692418704 +0000 UTC m=+39.139214155"
Oct 30 20:37:41.808466 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:41.808409    2577 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-gnfbh" podStartSLOduration=401.118399676 podStartE2EDuration="6m46.808391745s" totalImagesPullingTime="5.689992069s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:30:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:37:41.692874538 +0000 UTC m=+39.139669989" watchObservedRunningTime="2026-10-30 20:37:41.808391745 +0000 UTC m=+39.255187193"
Oct 30 20:37:42.055067 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:42.055022    2577 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-66df5d496b-dpsvp"]
Oct 30 20:37:42.072556 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:42.072531    2577 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-66df5d496b-lnmmq"]
Oct 30 20:37:42.072687 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:42.072662    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-dpsvp"
Oct 30 20:37:42.094808 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:42.094785    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-lnmmq"
Oct 30 20:37:42.130519 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:42.130492    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\""
Oct 30 20:37:42.130744 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:42.130726    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\""
Oct 30 20:37:42.130791 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:42.130744    2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-gdl6w\""
Oct 30 20:37:42.147135 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:42.147107    2577 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-66df5d496b-dpsvp"]
Oct 30 20:37:42.147696 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:42.147678    2577 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-66df5d496b-lnmmq"]
Oct 30 20:37:42.158381 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:42.158357    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h8vbt\" (UniqueName: \"kubernetes.io/projected/f7ba0792-faca-42fd-8d0d-3499c5b7278f-kube-api-access-h8vbt\") pod \"migrator-66df5d496b-dpsvp\" (UID: \"f7ba0792-faca-42fd-8d0d-3499c5b7278f\") " pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-dpsvp"
Oct 30 20:37:42.158510 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:42.158407    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7z886\" (UniqueName: \"kubernetes.io/projected/6080982d-ff7c-47b2-8a0c-5a2fff21722b-kube-api-access-7z886\") pod \"migrator-66df5d496b-lnmmq\" (UID: \"6080982d-ff7c-47b2-8a0c-5a2fff21722b\") " pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-lnmmq"
Oct 30 20:37:42.249318 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:42.249235    2577 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-zz4wr"]
Oct 30 20:37:42.258763 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:42.258736    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cd59fef4-66a5-471b-a8ef-18df25e44d5c-service-ca-bundle\") pod \"router-default-5b9d6cdd59-4g6mx\" (UID: \"cd59fef4-66a5-471b-a8ef-18df25e44d5c\") " pod="openshift-ingress/router-default-5b9d6cdd59-4g6mx"
Oct 30 20:37:42.258893 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:42.258797    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b3bff4d5-f9a8-4302-b63d-136ed3c6be35-registry-tls\") pod \"image-registry-6c5684fdcf-l5m76\" (UID: \"b3bff4d5-f9a8-4302-b63d-136ed3c6be35\") " pod="openshift-image-registry/image-registry-6c5684fdcf-l5m76"
Oct 30 20:37:42.258893 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:42.258829    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h8vbt\" (UniqueName: \"kubernetes.io/projected/f7ba0792-faca-42fd-8d0d-3499c5b7278f-kube-api-access-h8vbt\") pod \"migrator-66df5d496b-dpsvp\" (UID: \"f7ba0792-faca-42fd-8d0d-3499c5b7278f\") " pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-dpsvp"
Oct 30 20:37:42.258893 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:42.258870    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/d1fd1b0a-3831-4cb8-b6f3-ad2e67685188-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-884576c57-fl7nf\" (UID: \"d1fd1b0a-3831-4cb8-b6f3-ad2e67685188\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-fl7nf"
Oct 30 20:37:42.259035 ip-10-0-138-85 kubenswrapper[2577]: E1030 20:37:42.258901    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/cd59fef4-66a5-471b-a8ef-18df25e44d5c-service-ca-bundle podName:cd59fef4-66a5-471b-a8ef-18df25e44d5c nodeName:}" failed. No retries permitted until 2026-10-30 20:37:50.258884617 +0000 UTC m=+47.705680066 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/cd59fef4-66a5-471b-a8ef-18df25e44d5c-service-ca-bundle") pod "router-default-5b9d6cdd59-4g6mx" (UID: "cd59fef4-66a5-471b-a8ef-18df25e44d5c") : configmap references non-existent config key: service-ca.crt
Oct 30 20:37:42.259035 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:42.258935    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7z886\" (UniqueName: \"kubernetes.io/projected/6080982d-ff7c-47b2-8a0c-5a2fff21722b-kube-api-access-7z886\") pod \"migrator-66df5d496b-lnmmq\" (UID: \"6080982d-ff7c-47b2-8a0c-5a2fff21722b\") " pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-lnmmq"
Oct 30 20:37:42.259035 ip-10-0-138-85 kubenswrapper[2577]: E1030 20:37:42.258951    2577 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Oct 30 20:37:42.259035 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:42.258964    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/148ef018-4a87-49f3-8e89-839543748e77-registry-tls\") pod \"image-registry-556f5c99cd-v6q76\" (UID: \"148ef018-4a87-49f3-8e89-839543748e77\") " pod="openshift-image-registry/image-registry-556f5c99cd-v6q76"
Oct 30 20:37:42.259035 ip-10-0-138-85 kubenswrapper[2577]: E1030 20:37:42.258991    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d1fd1b0a-3831-4cb8-b6f3-ad2e67685188-cluster-monitoring-operator-tls podName:d1fd1b0a-3831-4cb8-b6f3-ad2e67685188 nodeName:}" failed. No retries permitted until 2026-10-30 20:37:50.258979396 +0000 UTC m=+47.705774841 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/d1fd1b0a-3831-4cb8-b6f3-ad2e67685188-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-884576c57-fl7nf" (UID: "d1fd1b0a-3831-4cb8-b6f3-ad2e67685188") : secret "cluster-monitoring-operator-tls" not found
Oct 30 20:37:42.259035 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:42.259010    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/6cd9770e-ea54-4c33-ac1e-5643f3d8839d-samples-operator-tls\") pod \"cluster-samples-operator-6ddb6c8b94-7d57c\" (UID: \"6cd9770e-ea54-4c33-ac1e-5643f3d8839d\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-7d57c"
Oct 30 20:37:42.259035 ip-10-0-138-85 kubenswrapper[2577]: E1030 20:37:42.259021    2577 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Oct 30 20:37:42.259035 ip-10-0-138-85 kubenswrapper[2577]: E1030 20:37:42.259037    2577 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Oct 30 20:37:42.259439 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:42.259039    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/73676585-4ea4-43cb-af99-b4716472fb15-networking-console-plugin-cert\") pod \"networking-console-plugin-86c478bb88-fl89x\" (UID: \"73676585-4ea4-43cb-af99-b4716472fb15\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-fl89x"
Oct 30 20:37:42.259439 ip-10-0-138-85 kubenswrapper[2577]: E1030 20:37:42.259043    2577 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6c5684fdcf-l5m76: secret "image-registry-tls" not found
Oct 30 20:37:42.259439 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:42.259098    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/aaadd8de-58cb-45af-a477-384fbf1cf317-metrics-tls\") pod \"dns-default-265zm\" (UID: \"aaadd8de-58cb-45af-a477-384fbf1cf317\") " pod="openshift-dns/dns-default-265zm"
Oct 30 20:37:42.259439 ip-10-0-138-85 kubenswrapper[2577]: E1030 20:37:42.259125    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b3bff4d5-f9a8-4302-b63d-136ed3c6be35-registry-tls podName:b3bff4d5-f9a8-4302-b63d-136ed3c6be35 nodeName:}" failed. No retries permitted until 2026-10-30 20:37:50.259107714 +0000 UTC m=+47.705903145 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/b3bff4d5-f9a8-4302-b63d-136ed3c6be35-registry-tls") pod "image-registry-6c5684fdcf-l5m76" (UID: "b3bff4d5-f9a8-4302-b63d-136ed3c6be35") : secret "image-registry-tls" not found
Oct 30 20:37:42.259439 ip-10-0-138-85 kubenswrapper[2577]: E1030 20:37:42.259155    2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Oct 30 20:37:42.259439 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:42.259174    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cd59fef4-66a5-471b-a8ef-18df25e44d5c-metrics-certs\") pod \"router-default-5b9d6cdd59-4g6mx\" (UID: \"cd59fef4-66a5-471b-a8ef-18df25e44d5c\") " pod="openshift-ingress/router-default-5b9d6cdd59-4g6mx"
Oct 30 20:37:42.259439 ip-10-0-138-85 kubenswrapper[2577]: E1030 20:37:42.259073    2577 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-556f5c99cd-v6q76: secret "image-registry-tls" not found
Oct 30 20:37:42.259439 ip-10-0-138-85 kubenswrapper[2577]: E1030 20:37:42.259187    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aaadd8de-58cb-45af-a477-384fbf1cf317-metrics-tls podName:aaadd8de-58cb-45af-a477-384fbf1cf317 nodeName:}" failed. No retries permitted until 2026-10-30 20:37:50.259176984 +0000 UTC m=+47.705972426 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/aaadd8de-58cb-45af-a477-384fbf1cf317-metrics-tls") pod "dns-default-265zm" (UID: "aaadd8de-58cb-45af-a477-384fbf1cf317") : secret "dns-default-metrics-tls" not found
Oct 30 20:37:42.259439 ip-10-0-138-85 kubenswrapper[2577]: E1030 20:37:42.259217    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/148ef018-4a87-49f3-8e89-839543748e77-registry-tls podName:148ef018-4a87-49f3-8e89-839543748e77 nodeName:}" failed. No retries permitted until 2026-10-30 20:37:50.25920707 +0000 UTC m=+47.706002503 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/148ef018-4a87-49f3-8e89-839543748e77-registry-tls") pod "image-registry-556f5c99cd-v6q76" (UID: "148ef018-4a87-49f3-8e89-839543748e77") : secret "image-registry-tls" not found
Oct 30 20:37:42.259439 ip-10-0-138-85 kubenswrapper[2577]: E1030 20:37:42.259228    2577 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Oct 30 20:37:42.259439 ip-10-0-138-85 kubenswrapper[2577]: E1030 20:37:42.259250    2577 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Oct 30 20:37:42.259439 ip-10-0-138-85 kubenswrapper[2577]: E1030 20:37:42.259263    2577 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Oct 30 20:37:42.259439 ip-10-0-138-85 kubenswrapper[2577]: E1030 20:37:42.259265    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/73676585-4ea4-43cb-af99-b4716472fb15-networking-console-plugin-cert podName:73676585-4ea4-43cb-af99-b4716472fb15 nodeName:}" failed. No retries permitted until 2026-10-30 20:37:50.259253685 +0000 UTC m=+47.706049127 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/73676585-4ea4-43cb-af99-b4716472fb15-networking-console-plugin-cert") pod "networking-console-plugin-86c478bb88-fl89x" (UID: "73676585-4ea4-43cb-af99-b4716472fb15") : secret "networking-console-plugin-cert" not found
Oct 30 20:37:42.259439 ip-10-0-138-85 kubenswrapper[2577]: E1030 20:37:42.259300    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cd59fef4-66a5-471b-a8ef-18df25e44d5c-metrics-certs podName:cd59fef4-66a5-471b-a8ef-18df25e44d5c nodeName:}" failed. No retries permitted until 2026-10-30 20:37:50.259293691 +0000 UTC m=+47.706089118 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/cd59fef4-66a5-471b-a8ef-18df25e44d5c-metrics-certs") pod "router-default-5b9d6cdd59-4g6mx" (UID: "cd59fef4-66a5-471b-a8ef-18df25e44d5c") : secret "router-metrics-certs-default" not found
Oct 30 20:37:42.259439 ip-10-0-138-85 kubenswrapper[2577]: E1030 20:37:42.259310    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6cd9770e-ea54-4c33-ac1e-5643f3d8839d-samples-operator-tls podName:6cd9770e-ea54-4c33-ac1e-5643f3d8839d nodeName:}" failed. No retries permitted until 2026-10-30 20:37:50.259304834 +0000 UTC m=+47.706100261 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/6cd9770e-ea54-4c33-ac1e-5643f3d8839d-samples-operator-tls") pod "cluster-samples-operator-6ddb6c8b94-7d57c" (UID: "6cd9770e-ea54-4c33-ac1e-5643f3d8839d") : secret "samples-operator-tls" not found
Oct 30 20:37:42.262625 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:42.262606    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-zz4wr"
Oct 30 20:37:42.310133 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:42.310109    2577 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-zz4wr"]
Oct 30 20:37:42.316060 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:42.316015    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7z886\" (UniqueName: \"kubernetes.io/projected/6080982d-ff7c-47b2-8a0c-5a2fff21722b-kube-api-access-7z886\") pod \"migrator-66df5d496b-lnmmq\" (UID: \"6080982d-ff7c-47b2-8a0c-5a2fff21722b\") " pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-lnmmq"
Oct 30 20:37:42.318110 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:42.318092    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h8vbt\" (UniqueName: \"kubernetes.io/projected/f7ba0792-faca-42fd-8d0d-3499c5b7278f-kube-api-access-h8vbt\") pod \"migrator-66df5d496b-dpsvp\" (UID: \"f7ba0792-faca-42fd-8d0d-3499c5b7278f\") " pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-dpsvp"
Oct 30 20:37:42.323649 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:42.323628    2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Oct 30 20:37:42.323734 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:42.323695    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Oct 30 20:37:42.323795 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:42.323735    2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-2srwc\""
Oct 30 20:37:42.359600 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:42.359574    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-htjnm\" (UniqueName: \"kubernetes.io/projected/0df457c5-5640-4c0d-9f71-94548c11397a-kube-api-access-htjnm\") pod \"insights-runtime-extractor-zz4wr\" (UID: \"0df457c5-5640-4c0d-9f71-94548c11397a\") " pod="openshift-insights/insights-runtime-extractor-zz4wr"
Oct 30 20:37:42.359970 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:42.359617    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/0df457c5-5640-4c0d-9f71-94548c11397a-data-volume\") pod \"insights-runtime-extractor-zz4wr\" (UID: \"0df457c5-5640-4c0d-9f71-94548c11397a\") " pod="openshift-insights/insights-runtime-extractor-zz4wr"
Oct 30 20:37:42.359970 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:42.359658    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/0df457c5-5640-4c0d-9f71-94548c11397a-crio-socket\") pod \"insights-runtime-extractor-zz4wr\" (UID: \"0df457c5-5640-4c0d-9f71-94548c11397a\") " pod="openshift-insights/insights-runtime-extractor-zz4wr"
Oct 30 20:37:42.359970 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:42.359747    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0df457c5-5640-4c0d-9f71-94548c11397a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-zz4wr\" (UID: \"0df457c5-5640-4c0d-9f71-94548c11397a\") " pod="openshift-insights/insights-runtime-extractor-zz4wr"
Oct 30 20:37:42.359970 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:42.359896    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0df457c5-5640-4c0d-9f71-94548c11397a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-zz4wr\" (UID: \"0df457c5-5640-4c0d-9f71-94548c11397a\") " pod="openshift-insights/insights-runtime-extractor-zz4wr"
Oct 30 20:37:42.360693 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:42.360678    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-sb7ds_90cd3de0-c573-41c2-bf3e-cf0e46a41d50/console-operator/1.log"
Oct 30 20:37:42.360994 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:42.360975    2577 scope.go:122] "RemoveContainer" containerID="9fe6599cf15d4157e951b11cb7fc3cb00a172c92956aca003b44194fb8d09fe5"
Oct 30 20:37:42.361220 ip-10-0-138-85 kubenswrapper[2577]: E1030 20:37:42.361196    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7cd56b8dbc-sb7ds_openshift-console-operator(90cd3de0-c573-41c2-bf3e-cf0e46a41d50)\"" pod="openshift-console-operator/console-operator-7cd56b8dbc-sb7ds" podUID="90cd3de0-c573-41c2-bf3e-cf0e46a41d50"
Oct 30 20:37:42.362215 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:42.362191    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-lqdtq" event={"ID":"50e37bd4-e46f-4577-b7b2-1ac7695637ea","Type":"ContainerStarted","Data":"9f707fd4a773ce1133210dba282e331fd0937a7ad1b8cdf72b6ffff061b75df1"}
Oct 30 20:37:42.362309 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:42.362252    2577 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-lqdtq"
Oct 30 20:37:42.363560 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:42.363539    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-dhfg8" event={"ID":"caca5f60-f777-4672-b570-faa422073cb9","Type":"ContainerStarted","Data":"2c84a34e1ae5541364ffe97f7db24bd040f6ca0131293977c3f59cd9cf2121dd"}
Oct 30 20:37:42.364950 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:42.364919    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-6f78d59f99-gqbfm" event={"ID":"e5ac6e6d-4ea4-4874-b2eb-285977a285f7","Type":"ContainerStarted","Data":"ce048b6b8f3d780b22ea3f3cb5a06eba6aeb5dac84223768161bbde753b8cdff"}
Oct 30 20:37:42.408093 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:42.408070    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-dpsvp"
Oct 30 20:37:42.427607 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:42.427585    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-lnmmq"
Oct 30 20:37:42.461034 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:42.460780    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0df457c5-5640-4c0d-9f71-94548c11397a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-zz4wr\" (UID: \"0df457c5-5640-4c0d-9f71-94548c11397a\") " pod="openshift-insights/insights-runtime-extractor-zz4wr"
Oct 30 20:37:42.461034 ip-10-0-138-85 kubenswrapper[2577]: E1030 20:37:42.460895    2577 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Oct 30 20:37:42.461990 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:42.461458    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-htjnm\" (UniqueName: \"kubernetes.io/projected/0df457c5-5640-4c0d-9f71-94548c11397a-kube-api-access-htjnm\") pod \"insights-runtime-extractor-zz4wr\" (UID: \"0df457c5-5640-4c0d-9f71-94548c11397a\") " pod="openshift-insights/insights-runtime-extractor-zz4wr"
Oct 30 20:37:42.461990 ip-10-0-138-85 kubenswrapper[2577]: E1030 20:37:42.461473    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0df457c5-5640-4c0d-9f71-94548c11397a-insights-runtime-extractor-tls podName:0df457c5-5640-4c0d-9f71-94548c11397a nodeName:}" failed. No retries permitted until 2026-10-30 20:37:42.961431102 +0000 UTC m=+40.408226533 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/0df457c5-5640-4c0d-9f71-94548c11397a-insights-runtime-extractor-tls") pod "insights-runtime-extractor-zz4wr" (UID: "0df457c5-5640-4c0d-9f71-94548c11397a") : secret "insights-runtime-extractor-tls" not found
Oct 30 20:37:42.461990 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:42.461567    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/0df457c5-5640-4c0d-9f71-94548c11397a-data-volume\") pod \"insights-runtime-extractor-zz4wr\" (UID: \"0df457c5-5640-4c0d-9f71-94548c11397a\") " pod="openshift-insights/insights-runtime-extractor-zz4wr"
Oct 30 20:37:42.461990 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:42.461617    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/0df457c5-5640-4c0d-9f71-94548c11397a-crio-socket\") pod \"insights-runtime-extractor-zz4wr\" (UID: \"0df457c5-5640-4c0d-9f71-94548c11397a\") " pod="openshift-insights/insights-runtime-extractor-zz4wr"
Oct 30 20:37:42.461990 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:42.461706    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0df457c5-5640-4c0d-9f71-94548c11397a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-zz4wr\" (UID: \"0df457c5-5640-4c0d-9f71-94548c11397a\") " pod="openshift-insights/insights-runtime-extractor-zz4wr"
Oct 30 20:37:42.461990 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:42.461871    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/0df457c5-5640-4c0d-9f71-94548c11397a-crio-socket\") pod \"insights-runtime-extractor-zz4wr\" (UID: \"0df457c5-5640-4c0d-9f71-94548c11397a\") " pod="openshift-insights/insights-runtime-extractor-zz4wr"
Oct 30 20:37:42.461990 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:42.461898    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/0df457c5-5640-4c0d-9f71-94548c11397a-data-volume\") pod \"insights-runtime-extractor-zz4wr\" (UID: \"0df457c5-5640-4c0d-9f71-94548c11397a\") " pod="openshift-insights/insights-runtime-extractor-zz4wr"
Oct 30 20:37:42.461990 ip-10-0-138-85 kubenswrapper[2577]: E1030 20:37:42.461985    2577 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Oct 30 20:37:42.462452 ip-10-0-138-85 kubenswrapper[2577]: E1030 20:37:42.462076    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/0df457c5-5640-4c0d-9f71-94548c11397a-kube-rbac-proxy-cm podName:0df457c5-5640-4c0d-9f71-94548c11397a nodeName:}" failed. No retries permitted until 2026-10-30 20:37:42.962023113 +0000 UTC m=+40.408818553 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/0df457c5-5640-4c0d-9f71-94548c11397a-kube-rbac-proxy-cm") pod "insights-runtime-extractor-zz4wr" (UID: "0df457c5-5640-4c0d-9f71-94548c11397a") : configmap "kube-rbac-proxy" not found
Oct 30 20:37:42.500954 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:42.496284    2577 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-insights/periodic-gathering-c49f4-pnxgw"]
Oct 30 20:37:42.520197 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:42.519097    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-htjnm\" (UniqueName: \"kubernetes.io/projected/0df457c5-5640-4c0d-9f71-94548c11397a-kube-api-access-htjnm\") pod \"insights-runtime-extractor-zz4wr\" (UID: \"0df457c5-5640-4c0d-9f71-94548c11397a\") " pod="openshift-insights/insights-runtime-extractor-zz4wr"
Oct 30 20:37:42.533760 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:42.533733    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/periodic-gathering-c49f4-pnxgw"
Oct 30 20:37:42.555923 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:42.555898    2577 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-insights/periodic-gathering-c49f4-pnxgw"]
Oct 30 20:37:42.562613 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:42.562589    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/519501c9-00d9-416f-887a-13b83aad5762-service-ca-bundle\") pod \"periodic-gathering-c49f4-pnxgw\" (UID: \"519501c9-00d9-416f-887a-13b83aad5762\") " pod="openshift-insights/periodic-gathering-c49f4-pnxgw"
Oct 30 20:37:42.562738 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:42.562680    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f2b6b\" (UniqueName: \"kubernetes.io/projected/519501c9-00d9-416f-887a-13b83aad5762-kube-api-access-f2b6b\") pod \"periodic-gathering-c49f4-pnxgw\" (UID: \"519501c9-00d9-416f-887a-13b83aad5762\") " pod="openshift-insights/periodic-gathering-c49f4-pnxgw"
Oct 30 20:37:42.562738 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:42.562716    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/519501c9-00d9-416f-887a-13b83aad5762-trusted-ca-bundle\") pod \"periodic-gathering-c49f4-pnxgw\" (UID: \"519501c9-00d9-416f-887a-13b83aad5762\") " pod="openshift-insights/periodic-gathering-c49f4-pnxgw"
Oct 30 20:37:42.562829 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:42.562806    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"archives-path\" (UniqueName: \"kubernetes.io/empty-dir/519501c9-00d9-416f-887a-13b83aad5762-archives-path\") pod \"periodic-gathering-c49f4-pnxgw\" (UID: \"519501c9-00d9-416f-887a-13b83aad5762\") " pod="openshift-insights/periodic-gathering-c49f4-pnxgw"
Oct 30 20:37:42.585907 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:42.585883    2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-2xphj\""
Oct 30 20:37:42.663833 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:42.663807    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/519501c9-00d9-416f-887a-13b83aad5762-service-ca-bundle\") pod \"periodic-gathering-c49f4-pnxgw\" (UID: \"519501c9-00d9-416f-887a-13b83aad5762\") " pod="openshift-insights/periodic-gathering-c49f4-pnxgw"
Oct 30 20:37:42.663992 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:42.663886    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f2b6b\" (UniqueName: \"kubernetes.io/projected/519501c9-00d9-416f-887a-13b83aad5762-kube-api-access-f2b6b\") pod \"periodic-gathering-c49f4-pnxgw\" (UID: \"519501c9-00d9-416f-887a-13b83aad5762\") " pod="openshift-insights/periodic-gathering-c49f4-pnxgw"
Oct 30 20:37:42.663992 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:42.663917    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/519501c9-00d9-416f-887a-13b83aad5762-trusted-ca-bundle\") pod \"periodic-gathering-c49f4-pnxgw\" (UID: \"519501c9-00d9-416f-887a-13b83aad5762\") " pod="openshift-insights/periodic-gathering-c49f4-pnxgw"
Oct 30 20:37:42.663992 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:42.663957    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"archives-path\" (UniqueName: \"kubernetes.io/empty-dir/519501c9-00d9-416f-887a-13b83aad5762-archives-path\") pod \"periodic-gathering-c49f4-pnxgw\" (UID: \"519501c9-00d9-416f-887a-13b83aad5762\") " pod="openshift-insights/periodic-gathering-c49f4-pnxgw"
Oct 30 20:37:42.664311 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:42.664292    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"archives-path\" (UniqueName: \"kubernetes.io/empty-dir/519501c9-00d9-416f-887a-13b83aad5762-archives-path\") pod \"periodic-gathering-c49f4-pnxgw\" (UID: \"519501c9-00d9-416f-887a-13b83aad5762\") " pod="openshift-insights/periodic-gathering-c49f4-pnxgw"
Oct 30 20:37:42.664374 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:42.664356    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/519501c9-00d9-416f-887a-13b83aad5762-service-ca-bundle\") pod \"periodic-gathering-c49f4-pnxgw\" (UID: \"519501c9-00d9-416f-887a-13b83aad5762\") " pod="openshift-insights/periodic-gathering-c49f4-pnxgw"
Oct 30 20:37:42.664828 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:42.664811    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/519501c9-00d9-416f-887a-13b83aad5762-trusted-ca-bundle\") pod \"periodic-gathering-c49f4-pnxgw\" (UID: \"519501c9-00d9-416f-887a-13b83aad5762\") " pod="openshift-insights/periodic-gathering-c49f4-pnxgw"
Oct 30 20:37:42.671369 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:42.671329    2577 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-dhfg8" podStartSLOduration=2.907274101 podStartE2EDuration="8.671310921s" totalImagesPullingTime="5.76403682s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:37:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:37:42.670540196 +0000 UTC m=+40.117335647" watchObservedRunningTime="2026-10-30 20:37:42.671310921 +0000 UTC m=+40.118106369"
Oct 30 20:37:42.721024 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:42.720999    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f2b6b\" (UniqueName: \"kubernetes.io/projected/519501c9-00d9-416f-887a-13b83aad5762-kube-api-access-f2b6b\") pod \"periodic-gathering-c49f4-pnxgw\" (UID: \"519501c9-00d9-416f-887a-13b83aad5762\") " pod="openshift-insights/periodic-gathering-c49f4-pnxgw"
Oct 30 20:37:42.785911 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:42.785819    2577 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-6f78d59f99-gqbfm" podStartSLOduration=400.078143902 podStartE2EDuration="6m46.785805704s" totalImagesPullingTime="6.707661802s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:30:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:37:42.784491251 +0000 UTC m=+40.231286702" watchObservedRunningTime="2026-10-30 20:37:42.785805704 +0000 UTC m=+40.232601175"
Oct 30 20:37:42.842688 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:42.842660    2577 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf7ba0792_faca_42fd_8d0d_3499c5b7278f.slice/crio-06e97711d4698ea1dbb35a81db7b4d144d621213c150dfe71a0e56eec41e586d WatchSource:0}: Error finding container 06e97711d4698ea1dbb35a81db7b4d144d621213c150dfe71a0e56eec41e586d: Status 404 returned error can't find the container with id 06e97711d4698ea1dbb35a81db7b4d144d621213c150dfe71a0e56eec41e586d
Oct 30 20:37:42.847529 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:42.847508    2577 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-66df5d496b-dpsvp"]
Oct 30 20:37:42.859230 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:42.859205    2577 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-66df5d496b-lnmmq"]
Oct 30 20:37:42.860617 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:42.860593    2577 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6080982d_ff7c_47b2_8a0c_5a2fff21722b.slice/crio-3ea28277b909832ad3750923ecd980712d3cabca4e362ad1334a773117bac35e WatchSource:0}: Error finding container 3ea28277b909832ad3750923ecd980712d3cabca4e362ad1334a773117bac35e: Status 404 returned error can't find the container with id 3ea28277b909832ad3750923ecd980712d3cabca4e362ad1334a773117bac35e
Oct 30 20:37:42.863086 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:42.863041    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/periodic-gathering-c49f4-pnxgw"
Oct 30 20:37:42.900665 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:42.900613    2577 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-lqdtq" podStartSLOduration=34.415505764 podStartE2EDuration="39.900594391s" totalImagesPullingTime="5.485088627s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:37:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:37:42.899211808 +0000 UTC m=+40.346007257" watchObservedRunningTime="2026-10-30 20:37:42.900594391 +0000 UTC m=+40.347389843"
Oct 30 20:37:42.967511 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:42.967479    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0df457c5-5640-4c0d-9f71-94548c11397a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-zz4wr\" (UID: \"0df457c5-5640-4c0d-9f71-94548c11397a\") " pod="openshift-insights/insights-runtime-extractor-zz4wr"
Oct 30 20:37:42.967660 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:42.967601    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0df457c5-5640-4c0d-9f71-94548c11397a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-zz4wr\" (UID: \"0df457c5-5640-4c0d-9f71-94548c11397a\") " pod="openshift-insights/insights-runtime-extractor-zz4wr"
Oct 30 20:37:42.967660 ip-10-0-138-85 kubenswrapper[2577]: E1030 20:37:42.967604    2577 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Oct 30 20:37:42.967742 ip-10-0-138-85 kubenswrapper[2577]: E1030 20:37:42.967667    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/0df457c5-5640-4c0d-9f71-94548c11397a-kube-rbac-proxy-cm podName:0df457c5-5640-4c0d-9f71-94548c11397a nodeName:}" failed. No retries permitted until 2026-10-30 20:37:43.967651238 +0000 UTC m=+41.414446665 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/0df457c5-5640-4c0d-9f71-94548c11397a-kube-rbac-proxy-cm") pod "insights-runtime-extractor-zz4wr" (UID: "0df457c5-5640-4c0d-9f71-94548c11397a") : configmap "kube-rbac-proxy" not found
Oct 30 20:37:42.967742 ip-10-0-138-85 kubenswrapper[2577]: E1030 20:37:42.967718    2577 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Oct 30 20:37:42.967815 ip-10-0-138-85 kubenswrapper[2577]: E1030 20:37:42.967768    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0df457c5-5640-4c0d-9f71-94548c11397a-insights-runtime-extractor-tls podName:0df457c5-5640-4c0d-9f71-94548c11397a nodeName:}" failed. No retries permitted until 2026-10-30 20:37:43.967753942 +0000 UTC m=+41.414549387 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/0df457c5-5640-4c0d-9f71-94548c11397a-insights-runtime-extractor-tls") pod "insights-runtime-extractor-zz4wr" (UID: "0df457c5-5640-4c0d-9f71-94548c11397a") : secret "insights-runtime-extractor-tls" not found
Oct 30 20:37:43.252887 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:43.252652    2577 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-insights/periodic-gathering-c49f4-pnxgw"]
Oct 30 20:37:43.255037 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:43.255000    2577 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod519501c9_00d9_416f_887a_13b83aad5762.slice/crio-7ac2c7083eb6835289efd435b8ec60ae66457c6a19c6f3d8e64f8b02bc1190e6 WatchSource:0}: Error finding container 7ac2c7083eb6835289efd435b8ec60ae66457c6a19c6f3d8e64f8b02bc1190e6: Status 404 returned error can't find the container with id 7ac2c7083eb6835289efd435b8ec60ae66457c6a19c6f3d8e64f8b02bc1190e6
Oct 30 20:37:43.369578 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:43.369540    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/periodic-gathering-c49f4-pnxgw" event={"ID":"519501c9-00d9-416f-887a-13b83aad5762","Type":"ContainerStarted","Data":"7b11d51d9a96d18226370422e6b941e17c849028210da4ad320edcb03c4771b5"}
Oct 30 20:37:43.369987 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:43.369603    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/periodic-gathering-c49f4-pnxgw" event={"ID":"519501c9-00d9-416f-887a-13b83aad5762","Type":"ContainerStarted","Data":"7ac2c7083eb6835289efd435b8ec60ae66457c6a19c6f3d8e64f8b02bc1190e6"}
Oct 30 20:37:43.371014 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:43.370981    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-dpsvp" event={"ID":"f7ba0792-faca-42fd-8d0d-3499c5b7278f","Type":"ContainerStarted","Data":"06e97711d4698ea1dbb35a81db7b4d144d621213c150dfe71a0e56eec41e586d"}
Oct 30 20:37:43.372213 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:43.372186    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-lnmmq" event={"ID":"6080982d-ff7c-47b2-8a0c-5a2fff21722b","Type":"ContainerStarted","Data":"3ea28277b909832ad3750923ecd980712d3cabca4e362ad1334a773117bac35e"}
Oct 30 20:37:43.483421 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:43.483373    2577 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-insights/periodic-gathering-c49f4-pnxgw" podStartSLOduration=1.483358988 podStartE2EDuration="1.483358988s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:37:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:37:43.481915783 +0000 UTC m=+40.928711232" watchObservedRunningTime="2026-10-30 20:37:43.483358988 +0000 UTC m=+40.930154437"
Oct 30 20:37:43.975826 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:43.975788    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0df457c5-5640-4c0d-9f71-94548c11397a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-zz4wr\" (UID: \"0df457c5-5640-4c0d-9f71-94548c11397a\") " pod="openshift-insights/insights-runtime-extractor-zz4wr"
Oct 30 20:37:43.976007 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:43.975902    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0df457c5-5640-4c0d-9f71-94548c11397a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-zz4wr\" (UID: \"0df457c5-5640-4c0d-9f71-94548c11397a\") " pod="openshift-insights/insights-runtime-extractor-zz4wr"
Oct 30 20:37:43.976007 ip-10-0-138-85 kubenswrapper[2577]: E1030 20:37:43.975957    2577 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Oct 30 20:37:43.976137 ip-10-0-138-85 kubenswrapper[2577]: E1030 20:37:43.976041    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0df457c5-5640-4c0d-9f71-94548c11397a-insights-runtime-extractor-tls podName:0df457c5-5640-4c0d-9f71-94548c11397a nodeName:}" failed. No retries permitted until 2026-10-30 20:37:45.976018178 +0000 UTC m=+43.422813624 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/0df457c5-5640-4c0d-9f71-94548c11397a-insights-runtime-extractor-tls") pod "insights-runtime-extractor-zz4wr" (UID: "0df457c5-5640-4c0d-9f71-94548c11397a") : secret "insights-runtime-extractor-tls" not found
Oct 30 20:37:43.976137 ip-10-0-138-85 kubenswrapper[2577]: E1030 20:37:43.976039    2577 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Oct 30 20:37:43.976137 ip-10-0-138-85 kubenswrapper[2577]: E1030 20:37:43.976097    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/0df457c5-5640-4c0d-9f71-94548c11397a-kube-rbac-proxy-cm podName:0df457c5-5640-4c0d-9f71-94548c11397a nodeName:}" failed. No retries permitted until 2026-10-30 20:37:45.976086119 +0000 UTC m=+43.422881572 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/0df457c5-5640-4c0d-9f71-94548c11397a-kube-rbac-proxy-cm") pod "insights-runtime-extractor-zz4wr" (UID: "0df457c5-5640-4c0d-9f71-94548c11397a") : configmap "kube-rbac-proxy" not found
Oct 30 20:37:44.031152 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:44.031119    2577 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-5fffc97bdf-lswcr"]
Oct 30 20:37:44.046533 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:44.046504    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-5fffc97bdf-lswcr"
Oct 30 20:37:44.077338 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:44.077309    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/f31c8037-8b3e-4e1b-a363-fdca6686beb5-signing-key\") pod \"service-ca-5fffc97bdf-lswcr\" (UID: \"f31c8037-8b3e-4e1b-a363-fdca6686beb5\") " pod="openshift-service-ca/service-ca-5fffc97bdf-lswcr"
Oct 30 20:37:44.077338 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:44.077339    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ldfgb\" (UniqueName: \"kubernetes.io/projected/f31c8037-8b3e-4e1b-a363-fdca6686beb5-kube-api-access-ldfgb\") pod \"service-ca-5fffc97bdf-lswcr\" (UID: \"f31c8037-8b3e-4e1b-a363-fdca6686beb5\") " pod="openshift-service-ca/service-ca-5fffc97bdf-lswcr"
Oct 30 20:37:44.077529 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:44.077477    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/f31c8037-8b3e-4e1b-a363-fdca6686beb5-signing-cabundle\") pod \"service-ca-5fffc97bdf-lswcr\" (UID: \"f31c8037-8b3e-4e1b-a363-fdca6686beb5\") " pod="openshift-service-ca/service-ca-5fffc97bdf-lswcr"
Oct 30 20:37:44.105510 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:44.105476    2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\""
Oct 30 20:37:44.108898 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:44.107735    2577 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-5fffc97bdf-lswcr"]
Oct 30 20:37:44.155539 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:44.155509    2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-lqzxz\""
Oct 30 20:37:44.155756 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:44.155604    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\""
Oct 30 20:37:44.155756 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:44.155691    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\""
Oct 30 20:37:44.155756 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:44.155611    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\""
Oct 30 20:37:44.178443 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:44.178413    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/f31c8037-8b3e-4e1b-a363-fdca6686beb5-signing-key\") pod \"service-ca-5fffc97bdf-lswcr\" (UID: \"f31c8037-8b3e-4e1b-a363-fdca6686beb5\") " pod="openshift-service-ca/service-ca-5fffc97bdf-lswcr"
Oct 30 20:37:44.178443 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:44.178447    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ldfgb\" (UniqueName: \"kubernetes.io/projected/f31c8037-8b3e-4e1b-a363-fdca6686beb5-kube-api-access-ldfgb\") pod \"service-ca-5fffc97bdf-lswcr\" (UID: \"f31c8037-8b3e-4e1b-a363-fdca6686beb5\") " pod="openshift-service-ca/service-ca-5fffc97bdf-lswcr"
Oct 30 20:37:44.178633 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:44.178474    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/f31c8037-8b3e-4e1b-a363-fdca6686beb5-signing-cabundle\") pod \"service-ca-5fffc97bdf-lswcr\" (UID: \"f31c8037-8b3e-4e1b-a363-fdca6686beb5\") " pod="openshift-service-ca/service-ca-5fffc97bdf-lswcr"
Oct 30 20:37:44.179301 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:44.179276    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/f31c8037-8b3e-4e1b-a363-fdca6686beb5-signing-cabundle\") pod \"service-ca-5fffc97bdf-lswcr\" (UID: \"f31c8037-8b3e-4e1b-a363-fdca6686beb5\") " pod="openshift-service-ca/service-ca-5fffc97bdf-lswcr"
Oct 30 20:37:44.181339 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:44.181312    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/f31c8037-8b3e-4e1b-a363-fdca6686beb5-signing-key\") pod \"service-ca-5fffc97bdf-lswcr\" (UID: \"f31c8037-8b3e-4e1b-a363-fdca6686beb5\") " pod="openshift-service-ca/service-ca-5fffc97bdf-lswcr"
Oct 30 20:37:44.235997 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:44.235927    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ldfgb\" (UniqueName: \"kubernetes.io/projected/f31c8037-8b3e-4e1b-a363-fdca6686beb5-kube-api-access-ldfgb\") pod \"service-ca-5fffc97bdf-lswcr\" (UID: \"f31c8037-8b3e-4e1b-a363-fdca6686beb5\") " pod="openshift-service-ca/service-ca-5fffc97bdf-lswcr"
Oct 30 20:37:44.375083 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:44.374984    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-5fffc97bdf-lswcr"
Oct 30 20:37:44.781616 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:44.781510    2577 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-5fffc97bdf-lswcr"]
Oct 30 20:37:44.784268 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:44.784237    2577 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf31c8037_8b3e_4e1b_a363_fdca6686beb5.slice/crio-0d2cab1e4291094c1471865d16688f7a6546cdcf768d7493d1c4759fa3a3434d WatchSource:0}: Error finding container 0d2cab1e4291094c1471865d16688f7a6546cdcf768d7493d1c4759fa3a3434d: Status 404 returned error can't find the container with id 0d2cab1e4291094c1471865d16688f7a6546cdcf768d7493d1c4759fa3a3434d
Oct 30 20:37:44.839665 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:44.839639    2577 kubelet.go:2727] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-7cd56b8dbc-sb7ds"
Oct 30 20:37:44.839776 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:44.839687    2577 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-7cd56b8dbc-sb7ds"
Oct 30 20:37:44.840019 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:44.840006    2577 scope.go:122] "RemoveContainer" containerID="9fe6599cf15d4157e951b11cb7fc3cb00a172c92956aca003b44194fb8d09fe5"
Oct 30 20:37:44.840215 ip-10-0-138-85 kubenswrapper[2577]: E1030 20:37:44.840196    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7cd56b8dbc-sb7ds_openshift-console-operator(90cd3de0-c573-41c2-bf3e-cf0e46a41d50)\"" pod="openshift-console-operator/console-operator-7cd56b8dbc-sb7ds" podUID="90cd3de0-c573-41c2-bf3e-cf0e46a41d50"
Oct 30 20:37:45.382996 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:45.382969    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-dpsvp" event={"ID":"f7ba0792-faca-42fd-8d0d-3499c5b7278f","Type":"ContainerStarted","Data":"358b69235649e3d9fd39d97d2fb7aeaff1e16b7ed5d2f008f2176c3367150052"}
Oct 30 20:37:45.386237 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:45.386214    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-5fffc97bdf-lswcr" event={"ID":"f31c8037-8b3e-4e1b-a363-fdca6686beb5","Type":"ContainerStarted","Data":"36f9ded61513feda46a8b828f3f0704403ef58fdedecff791d8105a8c4f39c80"}
Oct 30 20:37:45.386492 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:45.386254    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-5fffc97bdf-lswcr" event={"ID":"f31c8037-8b3e-4e1b-a363-fdca6686beb5","Type":"ContainerStarted","Data":"0d2cab1e4291094c1471865d16688f7a6546cdcf768d7493d1c4759fa3a3434d"}
Oct 30 20:37:45.497859 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:45.497813    2577 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-dpsvp" podStartSLOduration=1.320127754 podStartE2EDuration="3.497800471s" totalImagesPullingTime="2.177672717s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:37:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:37:45.497564907 +0000 UTC m=+42.944360357" watchObservedRunningTime="2026-10-30 20:37:45.497800471 +0000 UTC m=+42.944595920"
Oct 30 20:37:45.614247 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:45.614194    2577 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-service-ca/service-ca-5fffc97bdf-lswcr" podStartSLOduration=2.614180437 podStartE2EDuration="2.614180437s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:37:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:37:45.612372468 +0000 UTC m=+43.059167918" watchObservedRunningTime="2026-10-30 20:37:45.614180437 +0000 UTC m=+43.060975885"
Oct 30 20:37:45.998949 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:45.998907    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0df457c5-5640-4c0d-9f71-94548c11397a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-zz4wr\" (UID: \"0df457c5-5640-4c0d-9f71-94548c11397a\") " pod="openshift-insights/insights-runtime-extractor-zz4wr"
Oct 30 20:37:45.999158 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:45.999021    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0df457c5-5640-4c0d-9f71-94548c11397a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-zz4wr\" (UID: \"0df457c5-5640-4c0d-9f71-94548c11397a\") " pod="openshift-insights/insights-runtime-extractor-zz4wr"
Oct 30 20:37:45.999158 ip-10-0-138-85 kubenswrapper[2577]: E1030 20:37:45.999076    2577 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Oct 30 20:37:45.999158 ip-10-0-138-85 kubenswrapper[2577]: E1030 20:37:45.999142    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0df457c5-5640-4c0d-9f71-94548c11397a-insights-runtime-extractor-tls podName:0df457c5-5640-4c0d-9f71-94548c11397a nodeName:}" failed. No retries permitted until 2026-10-30 20:37:49.999128394 +0000 UTC m=+47.445923834 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/0df457c5-5640-4c0d-9f71-94548c11397a-insights-runtime-extractor-tls") pod "insights-runtime-extractor-zz4wr" (UID: "0df457c5-5640-4c0d-9f71-94548c11397a") : secret "insights-runtime-extractor-tls" not found
Oct 30 20:37:45.999158 ip-10-0-138-85 kubenswrapper[2577]: E1030 20:37:45.999150    2577 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Oct 30 20:37:45.999340 ip-10-0-138-85 kubenswrapper[2577]: E1030 20:37:45.999203    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/0df457c5-5640-4c0d-9f71-94548c11397a-kube-rbac-proxy-cm podName:0df457c5-5640-4c0d-9f71-94548c11397a nodeName:}" failed. No retries permitted until 2026-10-30 20:37:49.999187628 +0000 UTC m=+47.445983059 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/0df457c5-5640-4c0d-9f71-94548c11397a-kube-rbac-proxy-cm") pod "insights-runtime-extractor-zz4wr" (UID: "0df457c5-5640-4c0d-9f71-94548c11397a") : configmap "kube-rbac-proxy" not found
Oct 30 20:37:46.400131 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:46.393009    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-lnmmq" event={"ID":"6080982d-ff7c-47b2-8a0c-5a2fff21722b","Type":"ContainerStarted","Data":"6415b6210f50ec820836bdfd81f5dcd2a29f99cfdda9c7618856c30da114b427"}
Oct 30 20:37:46.513128 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:46.513067    2577 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-lnmmq" podStartSLOduration=2.074503158 podStartE2EDuration="4.51303203s" totalImagesPullingTime="2.438528872s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:37:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:37:46.512638178 +0000 UTC m=+43.959433638" watchObservedRunningTime="2026-10-30 20:37:46.51303203 +0000 UTC m=+43.959827479"
Oct 30 20:37:46.571776 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:46.571747    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-t4227_16e71e18-453a-41bf-a3f8-9618482c9a50/dns-node-resolver/0.log"
Oct 30 20:37:47.369187 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:47.369162    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-jnn4r_4179c36b-8003-46e5-82b0-67f6edea7553/node-ca/0.log"
Oct 30 20:37:47.966024 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:47.965993    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-dhfg8_caca5f60-f777-4672-b570-faa422073cb9/serve-healthcheck-canary/0.log"
Oct 30 20:37:48.169544 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:48.169509    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-66df5d496b-dpsvp_f7ba0792-faca-42fd-8d0d-3499c5b7278f/migrator/0.log"
Oct 30 20:37:48.368804 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:48.368734    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-66df5d496b-lnmmq_6080982d-ff7c-47b2-8a0c-5a2fff21722b/migrator/0.log"
Oct 30 20:37:48.568503 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:48.568462    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-7d4bc45dd6-j7q2s_ee37dd25-4ac1-474f-80b8-d04da8da560c/kube-storage-version-migrator-operator/0.log"
Oct 30 20:37:50.039143 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:50.039108    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0df457c5-5640-4c0d-9f71-94548c11397a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-zz4wr\" (UID: \"0df457c5-5640-4c0d-9f71-94548c11397a\") " pod="openshift-insights/insights-runtime-extractor-zz4wr"
Oct 30 20:37:50.039644 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:50.039236    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0df457c5-5640-4c0d-9f71-94548c11397a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-zz4wr\" (UID: \"0df457c5-5640-4c0d-9f71-94548c11397a\") " pod="openshift-insights/insights-runtime-extractor-zz4wr"
Oct 30 20:37:50.039644 ip-10-0-138-85 kubenswrapper[2577]: E1030 20:37:50.039386    2577 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Oct 30 20:37:50.039644 ip-10-0-138-85 kubenswrapper[2577]: E1030 20:37:50.039449    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0df457c5-5640-4c0d-9f71-94548c11397a-insights-runtime-extractor-tls podName:0df457c5-5640-4c0d-9f71-94548c11397a nodeName:}" failed. No retries permitted until 2026-10-30 20:37:58.039433228 +0000 UTC m=+55.486228668 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/0df457c5-5640-4c0d-9f71-94548c11397a-insights-runtime-extractor-tls") pod "insights-runtime-extractor-zz4wr" (UID: "0df457c5-5640-4c0d-9f71-94548c11397a") : secret "insights-runtime-extractor-tls" not found
Oct 30 20:37:50.039823 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:50.039781    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0df457c5-5640-4c0d-9f71-94548c11397a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-zz4wr\" (UID: \"0df457c5-5640-4c0d-9f71-94548c11397a\") " pod="openshift-insights/insights-runtime-extractor-zz4wr"
Oct 30 20:37:50.341870 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:50.341788    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cd59fef4-66a5-471b-a8ef-18df25e44d5c-service-ca-bundle\") pod \"router-default-5b9d6cdd59-4g6mx\" (UID: \"cd59fef4-66a5-471b-a8ef-18df25e44d5c\") " pod="openshift-ingress/router-default-5b9d6cdd59-4g6mx"
Oct 30 20:37:50.341870 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:50.341868    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b3bff4d5-f9a8-4302-b63d-136ed3c6be35-registry-tls\") pod \"image-registry-6c5684fdcf-l5m76\" (UID: \"b3bff4d5-f9a8-4302-b63d-136ed3c6be35\") " pod="openshift-image-registry/image-registry-6c5684fdcf-l5m76"
Oct 30 20:37:50.342114 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:50.341921    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/d1fd1b0a-3831-4cb8-b6f3-ad2e67685188-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-884576c57-fl7nf\" (UID: \"d1fd1b0a-3831-4cb8-b6f3-ad2e67685188\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-fl7nf"
Oct 30 20:37:50.342114 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:50.341954    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/148ef018-4a87-49f3-8e89-839543748e77-registry-tls\") pod \"image-registry-556f5c99cd-v6q76\" (UID: \"148ef018-4a87-49f3-8e89-839543748e77\") " pod="openshift-image-registry/image-registry-556f5c99cd-v6q76"
Oct 30 20:37:50.342114 ip-10-0-138-85 kubenswrapper[2577]: E1030 20:37:50.341966    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/cd59fef4-66a5-471b-a8ef-18df25e44d5c-service-ca-bundle podName:cd59fef4-66a5-471b-a8ef-18df25e44d5c nodeName:}" failed. No retries permitted until 2026-10-30 20:38:06.341950374 +0000 UTC m=+63.788745814 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/cd59fef4-66a5-471b-a8ef-18df25e44d5c-service-ca-bundle") pod "router-default-5b9d6cdd59-4g6mx" (UID: "cd59fef4-66a5-471b-a8ef-18df25e44d5c") : configmap references non-existent config key: service-ca.crt
Oct 30 20:37:50.342114 ip-10-0-138-85 kubenswrapper[2577]: E1030 20:37:50.342007    2577 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Oct 30 20:37:50.342114 ip-10-0-138-85 kubenswrapper[2577]: E1030 20:37:50.342026    2577 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6c5684fdcf-l5m76: secret "image-registry-tls" not found
Oct 30 20:37:50.342114 ip-10-0-138-85 kubenswrapper[2577]: E1030 20:37:50.342034    2577 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Oct 30 20:37:50.342114 ip-10-0-138-85 kubenswrapper[2577]: E1030 20:37:50.342046    2577 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-556f5c99cd-v6q76: secret "image-registry-tls" not found
Oct 30 20:37:50.342114 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:50.342006    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/6cd9770e-ea54-4c33-ac1e-5643f3d8839d-samples-operator-tls\") pod \"cluster-samples-operator-6ddb6c8b94-7d57c\" (UID: \"6cd9770e-ea54-4c33-ac1e-5643f3d8839d\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-7d57c"
Oct 30 20:37:50.342114 ip-10-0-138-85 kubenswrapper[2577]: E1030 20:37:50.342089    2577 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Oct 30 20:37:50.342114 ip-10-0-138-85 kubenswrapper[2577]: E1030 20:37:50.342112    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b3bff4d5-f9a8-4302-b63d-136ed3c6be35-registry-tls podName:b3bff4d5-f9a8-4302-b63d-136ed3c6be35 nodeName:}" failed. No retries permitted until 2026-10-30 20:38:06.342094688 +0000 UTC m=+63.788890115 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/b3bff4d5-f9a8-4302-b63d-136ed3c6be35-registry-tls") pod "image-registry-6c5684fdcf-l5m76" (UID: "b3bff4d5-f9a8-4302-b63d-136ed3c6be35") : secret "image-registry-tls" not found
Oct 30 20:37:50.342483 ip-10-0-138-85 kubenswrapper[2577]: E1030 20:37:50.342143    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/148ef018-4a87-49f3-8e89-839543748e77-registry-tls podName:148ef018-4a87-49f3-8e89-839543748e77 nodeName:}" failed. No retries permitted until 2026-10-30 20:38:06.342132943 +0000 UTC m=+63.788928370 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/148ef018-4a87-49f3-8e89-839543748e77-registry-tls") pod "image-registry-556f5c99cd-v6q76" (UID: "148ef018-4a87-49f3-8e89-839543748e77") : secret "image-registry-tls" not found
Oct 30 20:37:50.342483 ip-10-0-138-85 kubenswrapper[2577]: E1030 20:37:50.342159    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6cd9770e-ea54-4c33-ac1e-5643f3d8839d-samples-operator-tls podName:6cd9770e-ea54-4c33-ac1e-5643f3d8839d nodeName:}" failed. No retries permitted until 2026-10-30 20:38:06.342150777 +0000 UTC m=+63.788946204 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/6cd9770e-ea54-4c33-ac1e-5643f3d8839d-samples-operator-tls") pod "cluster-samples-operator-6ddb6c8b94-7d57c" (UID: "6cd9770e-ea54-4c33-ac1e-5643f3d8839d") : secret "samples-operator-tls" not found
Oct 30 20:37:50.342483 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:50.342184    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/73676585-4ea4-43cb-af99-b4716472fb15-networking-console-plugin-cert\") pod \"networking-console-plugin-86c478bb88-fl89x\" (UID: \"73676585-4ea4-43cb-af99-b4716472fb15\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-fl89x"
Oct 30 20:37:50.342483 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:50.342211    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/aaadd8de-58cb-45af-a477-384fbf1cf317-metrics-tls\") pod \"dns-default-265zm\" (UID: \"aaadd8de-58cb-45af-a477-384fbf1cf317\") " pod="openshift-dns/dns-default-265zm"
Oct 30 20:37:50.342483 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:50.342240    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cd59fef4-66a5-471b-a8ef-18df25e44d5c-metrics-certs\") pod \"router-default-5b9d6cdd59-4g6mx\" (UID: \"cd59fef4-66a5-471b-a8ef-18df25e44d5c\") " pod="openshift-ingress/router-default-5b9d6cdd59-4g6mx"
Oct 30 20:37:50.342483 ip-10-0-138-85 kubenswrapper[2577]: E1030 20:37:50.342320    2577 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Oct 30 20:37:50.342483 ip-10-0-138-85 kubenswrapper[2577]: E1030 20:37:50.342334    2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Oct 30 20:37:50.342483 ip-10-0-138-85 kubenswrapper[2577]: E1030 20:37:50.342338    2577 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Oct 30 20:37:50.342483 ip-10-0-138-85 kubenswrapper[2577]: E1030 20:37:50.342371    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cd59fef4-66a5-471b-a8ef-18df25e44d5c-metrics-certs podName:cd59fef4-66a5-471b-a8ef-18df25e44d5c nodeName:}" failed. No retries permitted until 2026-10-30 20:38:06.34236352 +0000 UTC m=+63.789158947 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/cd59fef4-66a5-471b-a8ef-18df25e44d5c-metrics-certs") pod "router-default-5b9d6cdd59-4g6mx" (UID: "cd59fef4-66a5-471b-a8ef-18df25e44d5c") : secret "router-metrics-certs-default" not found
Oct 30 20:37:50.342483 ip-10-0-138-85 kubenswrapper[2577]: E1030 20:37:50.342381    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/73676585-4ea4-43cb-af99-b4716472fb15-networking-console-plugin-cert podName:73676585-4ea4-43cb-af99-b4716472fb15 nodeName:}" failed. No retries permitted until 2026-10-30 20:38:06.342375636 +0000 UTC m=+63.789171062 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/73676585-4ea4-43cb-af99-b4716472fb15-networking-console-plugin-cert") pod "networking-console-plugin-86c478bb88-fl89x" (UID: "73676585-4ea4-43cb-af99-b4716472fb15") : secret "networking-console-plugin-cert" not found
Oct 30 20:37:50.342483 ip-10-0-138-85 kubenswrapper[2577]: E1030 20:37:50.342392    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aaadd8de-58cb-45af-a477-384fbf1cf317-metrics-tls podName:aaadd8de-58cb-45af-a477-384fbf1cf317 nodeName:}" failed. No retries permitted until 2026-10-30 20:38:06.342386522 +0000 UTC m=+63.789181949 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/aaadd8de-58cb-45af-a477-384fbf1cf317-metrics-tls") pod "dns-default-265zm" (UID: "aaadd8de-58cb-45af-a477-384fbf1cf317") : secret "dns-default-metrics-tls" not found
Oct 30 20:37:50.344568 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:50.344546    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/d1fd1b0a-3831-4cb8-b6f3-ad2e67685188-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-884576c57-fl7nf\" (UID: \"d1fd1b0a-3831-4cb8-b6f3-ad2e67685188\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-fl7nf"
Oct 30 20:37:50.402396 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:50.402370    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-884576c57-fl7nf"
Oct 30 20:37:50.853890 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:50.853867    2577 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-884576c57-fl7nf"]
Oct 30 20:37:50.856312 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:50.856277    2577 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd1fd1b0a_3831_4cb8_b6f3_ad2e67685188.slice/crio-3d466244841d35a3c5c8bed0792fbdfc479f701a0b134bd3e9a8c1f1ad7cd7fb WatchSource:0}: Error finding container 3d466244841d35a3c5c8bed0792fbdfc479f701a0b134bd3e9a8c1f1ad7cd7fb: Status 404 returned error can't find the container with id 3d466244841d35a3c5c8bed0792fbdfc479f701a0b134bd3e9a8c1f1ad7cd7fb
Oct 30 20:37:51.409165 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:51.409136    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-884576c57-fl7nf" event={"ID":"d1fd1b0a-3831-4cb8-b6f3-ad2e67685188","Type":"ContainerStarted","Data":"3d466244841d35a3c5c8bed0792fbdfc479f701a0b134bd3e9a8c1f1ad7cd7fb"}
Oct 30 20:37:54.045404 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:54.045369    2577 scope.go:122] "RemoveContainer" containerID="9fe6599cf15d4157e951b11cb7fc3cb00a172c92956aca003b44194fb8d09fe5"
Oct 30 20:37:54.420505 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:54.420417    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-884576c57-fl7nf" event={"ID":"d1fd1b0a-3831-4cb8-b6f3-ad2e67685188","Type":"ContainerStarted","Data":"004529dcce1e6ccc645605ad7eadbd4086cf22e2ddbeb6cd3588a93c641ee541"}
Oct 30 20:37:54.422044 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:54.422020    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-sb7ds_90cd3de0-c573-41c2-bf3e-cf0e46a41d50/console-operator/2.log"
Oct 30 20:37:54.422427 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:54.422413    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-sb7ds_90cd3de0-c573-41c2-bf3e-cf0e46a41d50/console-operator/1.log"
Oct 30 20:37:54.422493 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:54.422444    2577 generic.go:356] "Generic (PLEG): container finished" podID="90cd3de0-c573-41c2-bf3e-cf0e46a41d50" containerID="22e92c57dba3dc870b000562eeb828e9942a53023e03c3fc4d8722d561ea38f7" exitCode=255
Oct 30 20:37:54.422542 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:54.422500    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7cd56b8dbc-sb7ds" event={"ID":"90cd3de0-c573-41c2-bf3e-cf0e46a41d50","Type":"ContainerDied","Data":"22e92c57dba3dc870b000562eeb828e9942a53023e03c3fc4d8722d561ea38f7"}
Oct 30 20:37:54.422579 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:54.422543    2577 scope.go:122] "RemoveContainer" containerID="9fe6599cf15d4157e951b11cb7fc3cb00a172c92956aca003b44194fb8d09fe5"
Oct 30 20:37:54.422815 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:54.422799    2577 scope.go:122] "RemoveContainer" containerID="22e92c57dba3dc870b000562eeb828e9942a53023e03c3fc4d8722d561ea38f7"
Oct 30 20:37:54.423011 ip-10-0-138-85 kubenswrapper[2577]: E1030 20:37:54.422992    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-7cd56b8dbc-sb7ds_openshift-console-operator(90cd3de0-c573-41c2-bf3e-cf0e46a41d50)\"" pod="openshift-console-operator/console-operator-7cd56b8dbc-sb7ds" podUID="90cd3de0-c573-41c2-bf3e-cf0e46a41d50"
Oct 30 20:37:54.536516 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:54.536466    2577 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-884576c57-fl7nf" podStartSLOduration=415.191585409 podStartE2EDuration="6m58.536451524s" totalImagesPullingTime="3.344866115s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:30:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:37:54.535313806 +0000 UTC m=+51.982109258" watchObservedRunningTime="2026-10-30 20:37:54.536451524 +0000 UTC m=+51.983246997"
Oct 30 20:37:54.840500 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:54.840466    2577 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-7cd56b8dbc-sb7ds"
Oct 30 20:37:54.840668 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:54.840528    2577 kubelet.go:2727] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-7cd56b8dbc-sb7ds"
Oct 30 20:37:55.427542 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:55.427513    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-sb7ds_90cd3de0-c573-41c2-bf3e-cf0e46a41d50/console-operator/2.log"
Oct 30 20:37:55.427928 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:55.427875    2577 scope.go:122] "RemoveContainer" containerID="22e92c57dba3dc870b000562eeb828e9942a53023e03c3fc4d8722d561ea38f7"
Oct 30 20:37:55.428088 ip-10-0-138-85 kubenswrapper[2577]: E1030 20:37:55.428071    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-7cd56b8dbc-sb7ds_openshift-console-operator(90cd3de0-c573-41c2-bf3e-cf0e46a41d50)\"" pod="openshift-console-operator/console-operator-7cd56b8dbc-sb7ds" podUID="90cd3de0-c573-41c2-bf3e-cf0e46a41d50"
Oct 30 20:37:56.431226 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:56.431199    2577 scope.go:122] "RemoveContainer" containerID="22e92c57dba3dc870b000562eeb828e9942a53023e03c3fc4d8722d561ea38f7"
Oct 30 20:37:56.431580 ip-10-0-138-85 kubenswrapper[2577]: E1030 20:37:56.431419    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-7cd56b8dbc-sb7ds_openshift-console-operator(90cd3de0-c573-41c2-bf3e-cf0e46a41d50)\"" pod="openshift-console-operator/console-operator-7cd56b8dbc-sb7ds" podUID="90cd3de0-c573-41c2-bf3e-cf0e46a41d50"
Oct 30 20:37:58.117197 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:58.117163    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0df457c5-5640-4c0d-9f71-94548c11397a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-zz4wr\" (UID: \"0df457c5-5640-4c0d-9f71-94548c11397a\") " pod="openshift-insights/insights-runtime-extractor-zz4wr"
Oct 30 20:37:58.119455 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:58.119434    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0df457c5-5640-4c0d-9f71-94548c11397a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-zz4wr\" (UID: \"0df457c5-5640-4c0d-9f71-94548c11397a\") " pod="openshift-insights/insights-runtime-extractor-zz4wr"
Oct 30 20:37:58.233382 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:58.233351    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-zz4wr"
Oct 30 20:37:58.600459 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:58.600429    2577 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-zz4wr"]
Oct 30 20:37:58.602821 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:37:58.602790    2577 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0df457c5_5640_4c0d_9f71_94548c11397a.slice/crio-0f4fb48440afc04a4fe603b9f13e0c085994cfabf5d14e9f77b79bbdf9f45088 WatchSource:0}: Error finding container 0f4fb48440afc04a4fe603b9f13e0c085994cfabf5d14e9f77b79bbdf9f45088: Status 404 returned error can't find the container with id 0f4fb48440afc04a4fe603b9f13e0c085994cfabf5d14e9f77b79bbdf9f45088
Oct 30 20:37:59.249163 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:59.249129    2577 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-mw7xm"
Oct 30 20:37:59.445195 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:59.445163    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-zz4wr" event={"ID":"0df457c5-5640-4c0d-9f71-94548c11397a","Type":"ContainerStarted","Data":"a54d6a86fb1dc245d33a22d38192c1df025db3f32ae1896e6ad5c01c7797a6ae"}
Oct 30 20:37:59.445349 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:37:59.445218    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-zz4wr" event={"ID":"0df457c5-5640-4c0d-9f71-94548c11397a","Type":"ContainerStarted","Data":"0f4fb48440afc04a4fe603b9f13e0c085994cfabf5d14e9f77b79bbdf9f45088"}
Oct 30 20:38:00.449851 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:38:00.449817    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-zz4wr" event={"ID":"0df457c5-5640-4c0d-9f71-94548c11397a","Type":"ContainerStarted","Data":"96945fe7a3a6a568dd214d3eeccae7fff4456d59a461cff4847f36b3cfedfff9"}
Oct 30 20:38:02.457943 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:38:02.457908    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-zz4wr" event={"ID":"0df457c5-5640-4c0d-9f71-94548c11397a","Type":"ContainerStarted","Data":"68c9a0c881a5231335b72033bb069f82690734dc2cee2e60bba16e9042dfaa0c"}
Oct 30 20:38:02.968391 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:38:02.968338    2577 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-zz4wr" podStartSLOduration=17.739984934 podStartE2EDuration="20.968325771s" totalImagesPullingTime="3.228340837s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 20:37:42 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:38:02.60832867 +0000 UTC m=+60.055124118" watchObservedRunningTime="2026-10-30 20:38:02.968325771 +0000 UTC m=+60.415121220"
Oct 30 20:38:02.969379 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:38:02.969356    2577 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-6489d8bf89-fqdw6"]
Oct 30 20:38:02.972044 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:38:02.972024    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-6489d8bf89-fqdw6"
Oct 30 20:38:03.010795 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:38:03.010762    2577 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-556f5c99cd-v6q76"]
Oct 30 20:38:03.010977 ip-10-0-138-85 kubenswrapper[2577]: E1030 20:38:03.010953    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context canceled" pod="openshift-image-registry/image-registry-556f5c99cd-v6q76" podUID="148ef018-4a87-49f3-8e89-839543748e77"
Oct 30 20:38:03.059043 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:38:03.059006    2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-95cqb\""
Oct 30 20:38:03.059043 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:38:03.059027    2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\""
Oct 30 20:38:03.060487 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:38:03.060465    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/708a2c3c-e061-4bb1-b9ff-48f111b08943-tls-certificates\") pod \"prometheus-operator-admission-webhook-6489d8bf89-fqdw6\" (UID: \"708a2c3c-e061-4bb1-b9ff-48f111b08943\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-6489d8bf89-fqdw6"
Oct 30 20:38:03.087230 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:38:03.087206    2577 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-57547d4649-8sjtp"]
Oct 30 20:38:03.089379 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:38:03.089364    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-57547d4649-8sjtp"
Oct 30 20:38:03.160855 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:38:03.160828    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/708a2c3c-e061-4bb1-b9ff-48f111b08943-tls-certificates\") pod \"prometheus-operator-admission-webhook-6489d8bf89-fqdw6\" (UID: \"708a2c3c-e061-4bb1-b9ff-48f111b08943\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-6489d8bf89-fqdw6"
Oct 30 20:38:03.161032 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:38:03.160881    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/2aee32c9-f358-4ff4-9d50-c18dba9885a5-image-registry-private-configuration\") pod \"image-registry-57547d4649-8sjtp\" (UID: \"2aee32c9-f358-4ff4-9d50-c18dba9885a5\") " pod="openshift-image-registry/image-registry-57547d4649-8sjtp"
Oct 30 20:38:03.161032 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:38:03.160910    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/2aee32c9-f358-4ff4-9d50-c18dba9885a5-registry-certificates\") pod \"image-registry-57547d4649-8sjtp\" (UID: \"2aee32c9-f358-4ff4-9d50-c18dba9885a5\") " pod="openshift-image-registry/image-registry-57547d4649-8sjtp"
Oct 30 20:38:03.161032 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:38:03.160933    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2aee32c9-f358-4ff4-9d50-c18dba9885a5-bound-sa-token\") pod \"image-registry-57547d4649-8sjtp\" (UID: \"2aee32c9-f358-4ff4-9d50-c18dba9885a5\") " pod="openshift-image-registry/image-registry-57547d4649-8sjtp"
Oct 30 20:38:03.161221 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:38:03.161127    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2aee32c9-f358-4ff4-9d50-c18dba9885a5-registry-tls\") pod \"image-registry-57547d4649-8sjtp\" (UID: \"2aee32c9-f358-4ff4-9d50-c18dba9885a5\") " pod="openshift-image-registry/image-registry-57547d4649-8sjtp"
Oct 30 20:38:03.161221 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:38:03.161183    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/2aee32c9-f358-4ff4-9d50-c18dba9885a5-ca-trust-extracted\") pod \"image-registry-57547d4649-8sjtp\" (UID: \"2aee32c9-f358-4ff4-9d50-c18dba9885a5\") " pod="openshift-image-registry/image-registry-57547d4649-8sjtp"
Oct 30 20:38:03.161301 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:38:03.161257    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/2aee32c9-f358-4ff4-9d50-c18dba9885a5-trusted-ca\") pod \"image-registry-57547d4649-8sjtp\" (UID: \"2aee32c9-f358-4ff4-9d50-c18dba9885a5\") " pod="openshift-image-registry/image-registry-57547d4649-8sjtp"
Oct 30 20:38:03.161344 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:38:03.161299    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/2aee32c9-f358-4ff4-9d50-c18dba9885a5-installation-pull-secrets\") pod \"image-registry-57547d4649-8sjtp\" (UID: \"2aee32c9-f358-4ff4-9d50-c18dba9885a5\") " pod="openshift-image-registry/image-registry-57547d4649-8sjtp"
Oct 30 20:38:03.161344 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:38:03.161315    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bkhhh\" (UniqueName: \"kubernetes.io/projected/2aee32c9-f358-4ff4-9d50-c18dba9885a5-kube-api-access-bkhhh\") pod \"image-registry-57547d4649-8sjtp\" (UID: \"2aee32c9-f358-4ff4-9d50-c18dba9885a5\") " pod="openshift-image-registry/image-registry-57547d4649-8sjtp"
Oct 30 20:38:03.163237 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:38:03.163217    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/708a2c3c-e061-4bb1-b9ff-48f111b08943-tls-certificates\") pod \"prometheus-operator-admission-webhook-6489d8bf89-fqdw6\" (UID: \"708a2c3c-e061-4bb1-b9ff-48f111b08943\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-6489d8bf89-fqdw6"
Oct 30 20:38:03.206889 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:38:03.206862    2577 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-57547d4649-8sjtp"]
Oct 30 20:38:03.210486 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:38:03.210459    2577 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-6489d8bf89-fqdw6"]
Oct 30 20:38:03.262681 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:38:03.262616    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/2aee32c9-f358-4ff4-9d50-c18dba9885a5-ca-trust-extracted\") pod \"image-registry-57547d4649-8sjtp\" (UID: \"2aee32c9-f358-4ff4-9d50-c18dba9885a5\") " pod="openshift-image-registry/image-registry-57547d4649-8sjtp"
Oct 30 20:38:03.262681 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:38:03.262670    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/2aee32c9-f358-4ff4-9d50-c18dba9885a5-trusted-ca\") pod \"image-registry-57547d4649-8sjtp\" (UID: \"2aee32c9-f358-4ff4-9d50-c18dba9885a5\") " pod="openshift-image-registry/image-registry-57547d4649-8sjtp"
Oct 30 20:38:03.262864 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:38:03.262767    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/2aee32c9-f358-4ff4-9d50-c18dba9885a5-installation-pull-secrets\") pod \"image-registry-57547d4649-8sjtp\" (UID: \"2aee32c9-f358-4ff4-9d50-c18dba9885a5\") " pod="openshift-image-registry/image-registry-57547d4649-8sjtp"
Oct 30 20:38:03.262864 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:38:03.262784    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bkhhh\" (UniqueName: \"kubernetes.io/projected/2aee32c9-f358-4ff4-9d50-c18dba9885a5-kube-api-access-bkhhh\") pod \"image-registry-57547d4649-8sjtp\" (UID: \"2aee32c9-f358-4ff4-9d50-c18dba9885a5\") " pod="openshift-image-registry/image-registry-57547d4649-8sjtp"
Oct 30 20:38:03.262864 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:38:03.262825    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/2aee32c9-f358-4ff4-9d50-c18dba9885a5-image-registry-private-configuration\") pod \"image-registry-57547d4649-8sjtp\" (UID: \"2aee32c9-f358-4ff4-9d50-c18dba9885a5\") " pod="openshift-image-registry/image-registry-57547d4649-8sjtp"
Oct 30 20:38:03.263021 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:38:03.262861    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/2aee32c9-f358-4ff4-9d50-c18dba9885a5-registry-certificates\") pod \"image-registry-57547d4649-8sjtp\" (UID: \"2aee32c9-f358-4ff4-9d50-c18dba9885a5\") " pod="openshift-image-registry/image-registry-57547d4649-8sjtp"
Oct 30 20:38:03.263021 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:38:03.262973    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2aee32c9-f358-4ff4-9d50-c18dba9885a5-bound-sa-token\") pod \"image-registry-57547d4649-8sjtp\" (UID: \"2aee32c9-f358-4ff4-9d50-c18dba9885a5\") " pod="openshift-image-registry/image-registry-57547d4649-8sjtp"
Oct 30 20:38:03.263157 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:38:03.263104    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2aee32c9-f358-4ff4-9d50-c18dba9885a5-registry-tls\") pod \"image-registry-57547d4649-8sjtp\" (UID: \"2aee32c9-f358-4ff4-9d50-c18dba9885a5\") " pod="openshift-image-registry/image-registry-57547d4649-8sjtp"
Oct 30 20:38:03.263215 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:38:03.263159    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/2aee32c9-f358-4ff4-9d50-c18dba9885a5-ca-trust-extracted\") pod \"image-registry-57547d4649-8sjtp\" (UID: \"2aee32c9-f358-4ff4-9d50-c18dba9885a5\") " pod="openshift-image-registry/image-registry-57547d4649-8sjtp"
Oct 30 20:38:03.263681 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:38:03.263659    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/2aee32c9-f358-4ff4-9d50-c18dba9885a5-registry-certificates\") pod \"image-registry-57547d4649-8sjtp\" (UID: \"2aee32c9-f358-4ff4-9d50-c18dba9885a5\") " pod="openshift-image-registry/image-registry-57547d4649-8sjtp"
Oct 30 20:38:03.264012 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:38:03.263970    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/2aee32c9-f358-4ff4-9d50-c18dba9885a5-trusted-ca\") pod \"image-registry-57547d4649-8sjtp\" (UID: \"2aee32c9-f358-4ff4-9d50-c18dba9885a5\") " pod="openshift-image-registry/image-registry-57547d4649-8sjtp"
Oct 30 20:38:03.265369 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:38:03.265348    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/2aee32c9-f358-4ff4-9d50-c18dba9885a5-image-registry-private-configuration\") pod \"image-registry-57547d4649-8sjtp\" (UID: \"2aee32c9-f358-4ff4-9d50-c18dba9885a5\") " pod="openshift-image-registry/image-registry-57547d4649-8sjtp"
Oct 30 20:38:03.265497 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:38:03.265475    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2aee32c9-f358-4ff4-9d50-c18dba9885a5-registry-tls\") pod \"image-registry-57547d4649-8sjtp\" (UID: \"2aee32c9-f358-4ff4-9d50-c18dba9885a5\") " pod="openshift-image-registry/image-registry-57547d4649-8sjtp"
Oct 30 20:38:03.265773 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:38:03.265755    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/2aee32c9-f358-4ff4-9d50-c18dba9885a5-installation-pull-secrets\") pod \"image-registry-57547d4649-8sjtp\" (UID: \"2aee32c9-f358-4ff4-9d50-c18dba9885a5\") " pod="openshift-image-registry/image-registry-57547d4649-8sjtp"
Oct 30 20:38:03.282483 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:38:03.282463    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-6489d8bf89-fqdw6"
Oct 30 20:38:03.321615 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:38:03.321580    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bkhhh\" (UniqueName: \"kubernetes.io/projected/2aee32c9-f358-4ff4-9d50-c18dba9885a5-kube-api-access-bkhhh\") pod \"image-registry-57547d4649-8sjtp\" (UID: \"2aee32c9-f358-4ff4-9d50-c18dba9885a5\") " pod="openshift-image-registry/image-registry-57547d4649-8sjtp"
Oct 30 20:38:03.321863 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:38:03.321845    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2aee32c9-f358-4ff4-9d50-c18dba9885a5-bound-sa-token\") pod \"image-registry-57547d4649-8sjtp\" (UID: \"2aee32c9-f358-4ff4-9d50-c18dba9885a5\") " pod="openshift-image-registry/image-registry-57547d4649-8sjtp"
Oct 30 20:38:03.450926 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:38:03.450897    2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-bhpnj\""
Oct 30 20:38:03.459573 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:38:03.459547    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-57547d4649-8sjtp"
Oct 30 20:38:03.461444 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:38:03.461420    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-556f5c99cd-v6q76"
Oct 30 20:38:03.467692 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:38:03.467670    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-556f5c99cd-v6q76"
Oct 30 20:38:03.565396 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:38:03.565325    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/148ef018-4a87-49f3-8e89-839543748e77-image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/148ef018-4a87-49f3-8e89-839543748e77-image-registry-private-configuration\") pod \"148ef018-4a87-49f3-8e89-839543748e77\" (UID: \"148ef018-4a87-49f3-8e89-839543748e77\") "
Oct 30 20:38:03.565396 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:38:03.565364    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/148ef018-4a87-49f3-8e89-839543748e77-installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/148ef018-4a87-49f3-8e89-839543748e77-installation-pull-secrets\") pod \"148ef018-4a87-49f3-8e89-839543748e77\" (UID: \"148ef018-4a87-49f3-8e89-839543748e77\") "
Oct 30 20:38:03.565396 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:38:03.565383    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/148ef018-4a87-49f3-8e89-839543748e77-registry-certificates\" (UniqueName: \"kubernetes.io/configmap/148ef018-4a87-49f3-8e89-839543748e77-registry-certificates\") pod \"148ef018-4a87-49f3-8e89-839543748e77\" (UID: \"148ef018-4a87-49f3-8e89-839543748e77\") "
Oct 30 20:38:03.565604 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:38:03.565438    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/148ef018-4a87-49f3-8e89-839543748e77-kube-api-access-n5rjs\" (UniqueName: \"kubernetes.io/projected/148ef018-4a87-49f3-8e89-839543748e77-kube-api-access-n5rjs\") pod \"148ef018-4a87-49f3-8e89-839543748e77\" (UID: \"148ef018-4a87-49f3-8e89-839543748e77\") "
Oct 30 20:38:03.565604 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:38:03.565468    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/148ef018-4a87-49f3-8e89-839543748e77-bound-sa-token\" (UniqueName: \"kubernetes.io/projected/148ef018-4a87-49f3-8e89-839543748e77-bound-sa-token\") pod \"148ef018-4a87-49f3-8e89-839543748e77\" (UID: \"148ef018-4a87-49f3-8e89-839543748e77\") "
Oct 30 20:38:03.565697 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:38:03.565635    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/148ef018-4a87-49f3-8e89-839543748e77-trusted-ca\" (UniqueName: \"kubernetes.io/configmap/148ef018-4a87-49f3-8e89-839543748e77-trusted-ca\") pod \"148ef018-4a87-49f3-8e89-839543748e77\" (UID: \"148ef018-4a87-49f3-8e89-839543748e77\") "
Oct 30 20:38:03.565748 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:38:03.565731    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/148ef018-4a87-49f3-8e89-839543748e77-ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/148ef018-4a87-49f3-8e89-839543748e77-ca-trust-extracted\") pod \"148ef018-4a87-49f3-8e89-839543748e77\" (UID: \"148ef018-4a87-49f3-8e89-839543748e77\") "
Oct 30 20:38:03.565899 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:38:03.565868    2577 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/148ef018-4a87-49f3-8e89-839543748e77-registry-certificates" pod "148ef018-4a87-49f3-8e89-839543748e77" (UID: "148ef018-4a87-49f3-8e89-839543748e77"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 20:38:03.566067 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:38:03.566027    2577 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/148ef018-4a87-49f3-8e89-839543748e77-trusted-ca" pod "148ef018-4a87-49f3-8e89-839543748e77" (UID: "148ef018-4a87-49f3-8e89-839543748e77"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 20:38:03.566175 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:38:03.566151    2577 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/148ef018-4a87-49f3-8e89-839543748e77-ca-trust-extracted" pod "148ef018-4a87-49f3-8e89-839543748e77" (UID: "148ef018-4a87-49f3-8e89-839543748e77"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:38:03.566235 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:38:03.566191    2577 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/148ef018-4a87-49f3-8e89-839543748e77-registry-certificates\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:38:03.566235 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:38:03.566217    2577 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/148ef018-4a87-49f3-8e89-839543748e77-trusted-ca\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:38:03.567866 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:38:03.567841    2577 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/148ef018-4a87-49f3-8e89-839543748e77-image-registry-private-configuration" pod "148ef018-4a87-49f3-8e89-839543748e77" (UID: "148ef018-4a87-49f3-8e89-839543748e77"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 20:38:03.567954 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:38:03.567915    2577 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/148ef018-4a87-49f3-8e89-839543748e77-kube-api-access-n5rjs" pod "148ef018-4a87-49f3-8e89-839543748e77" (UID: "148ef018-4a87-49f3-8e89-839543748e77"). InnerVolumeSpecName "kube-api-access-n5rjs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:38:03.568007 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:38:03.567986    2577 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/148ef018-4a87-49f3-8e89-839543748e77-installation-pull-secrets" pod "148ef018-4a87-49f3-8e89-839543748e77" (UID: "148ef018-4a87-49f3-8e89-839543748e77"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 20:38:03.568007 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:38:03.567994    2577 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/148ef018-4a87-49f3-8e89-839543748e77-bound-sa-token" pod "148ef018-4a87-49f3-8e89-839543748e77" (UID: "148ef018-4a87-49f3-8e89-839543748e77"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:38:03.664809 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:38:03.664786    2577 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-6489d8bf89-fqdw6"]
Oct 30 20:38:03.667083 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:38:03.667040    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n5rjs\" (UniqueName: \"kubernetes.io/projected/148ef018-4a87-49f3-8e89-839543748e77-kube-api-access-n5rjs\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:38:03.667083 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:38:03.667076    2577 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/148ef018-4a87-49f3-8e89-839543748e77-bound-sa-token\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:38:03.667289 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:38:03.667093    2577 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/148ef018-4a87-49f3-8e89-839543748e77-ca-trust-extracted\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:38:03.667289 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:38:03.667107    2577 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/148ef018-4a87-49f3-8e89-839543748e77-image-registry-private-configuration\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:38:03.667289 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:38:03.667121    2577 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/148ef018-4a87-49f3-8e89-839543748e77-installation-pull-secrets\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:38:03.667289 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:38:03.667136    2577 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod708a2c3c_e061_4bb1_b9ff_48f111b08943.slice/crio-adfab031b80b88534a4d34be8417010a57059812a625478a6a3b3fba56218cc3 WatchSource:0}: Error finding container adfab031b80b88534a4d34be8417010a57059812a625478a6a3b3fba56218cc3: Status 404 returned error can't find the container with id adfab031b80b88534a4d34be8417010a57059812a625478a6a3b3fba56218cc3
Oct 30 20:38:03.840255 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:38:03.840174    2577 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-57547d4649-8sjtp"]
Oct 30 20:38:03.844471 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:38:03.844443    2577 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2aee32c9_f358_4ff4_9d50_c18dba9885a5.slice/crio-ceea8eb5df582eef6e1c92a2a0e04e96bf3dca304c816bb55b10064b00e659d4 WatchSource:0}: Error finding container ceea8eb5df582eef6e1c92a2a0e04e96bf3dca304c816bb55b10064b00e659d4: Status 404 returned error can't find the container with id ceea8eb5df582eef6e1c92a2a0e04e96bf3dca304c816bb55b10064b00e659d4
Oct 30 20:38:04.465753 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:38:04.465716    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-6489d8bf89-fqdw6" event={"ID":"708a2c3c-e061-4bb1-b9ff-48f111b08943","Type":"ContainerStarted","Data":"adfab031b80b88534a4d34be8417010a57059812a625478a6a3b3fba56218cc3"}
Oct 30 20:38:04.467226 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:38:04.467205    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-556f5c99cd-v6q76"
Oct 30 20:38:04.467340 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:38:04.467241    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-57547d4649-8sjtp" event={"ID":"2aee32c9-f358-4ff4-9d50-c18dba9885a5","Type":"ContainerStarted","Data":"b622f5b33e32c7b5957aaaf185ed0753f04a1fcd2529b22bef3aa9217e656d17"}
Oct 30 20:38:04.467340 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:38:04.467289    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-57547d4649-8sjtp" event={"ID":"2aee32c9-f358-4ff4-9d50-c18dba9885a5","Type":"ContainerStarted","Data":"ceea8eb5df582eef6e1c92a2a0e04e96bf3dca304c816bb55b10064b00e659d4"}
Oct 30 20:38:04.467340 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:38:04.467320    2577 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-57547d4649-8sjtp"
Oct 30 20:38:04.647396 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:38:04.647304    2577 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-image-registry/image-registry-57547d4649-8sjtp" podStartSLOduration=1.6472860919999999 podStartE2EDuration="1.647286092s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:38:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:38:04.646898433 +0000 UTC m=+62.093693883" watchObservedRunningTime="2026-10-30 20:38:04.647286092 +0000 UTC m=+62.094081542"
Oct 30 20:38:04.831435 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:38:04.831342    2577 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-556f5c99cd-v6q76"]
Oct 30 20:38:04.833648 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:38:04.833620    2577 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-556f5c99cd-v6q76"]
Oct 30 20:38:04.981509 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:38:04.981469    2577 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/148ef018-4a87-49f3-8e89-839543748e77-registry-tls\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:38:05.050867 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:38:05.050824    2577 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="148ef018-4a87-49f3-8e89-839543748e77" path="/var/lib/kubelet/pods/148ef018-4a87-49f3-8e89-839543748e77/volumes"
Oct 30 20:38:05.471774 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:38:05.471741    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-6489d8bf89-fqdw6" event={"ID":"708a2c3c-e061-4bb1-b9ff-48f111b08943","Type":"ContainerStarted","Data":"42fa1d6d004abecf3a0e6e763e8e684ef04d6342363883f1bfb25f2b246e5e65"}
Oct 30 20:38:05.472253 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:38:05.471896    2577 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-6489d8bf89-fqdw6"
Oct 30 20:38:05.476615 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:38:05.476592    2577 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-6489d8bf89-fqdw6"
Oct 30 20:38:05.588037 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:38:05.587990    2577 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-6489d8bf89-fqdw6" podStartSLOduration=2.093101837 podStartE2EDuration="3.587975784s" totalImagesPullingTime="1.494873947s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:38:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:38:05.586425269 +0000 UTC m=+63.033220721" watchObservedRunningTime="2026-10-30 20:38:05.587975784 +0000 UTC m=+63.034771232"
Oct 30 20:38:06.395602 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:38:06.395566    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cd59fef4-66a5-471b-a8ef-18df25e44d5c-service-ca-bundle\") pod \"router-default-5b9d6cdd59-4g6mx\" (UID: \"cd59fef4-66a5-471b-a8ef-18df25e44d5c\") " pod="openshift-ingress/router-default-5b9d6cdd59-4g6mx"
Oct 30 20:38:06.395778 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:38:06.395631    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b3bff4d5-f9a8-4302-b63d-136ed3c6be35-registry-tls\") pod \"image-registry-6c5684fdcf-l5m76\" (UID: \"b3bff4d5-f9a8-4302-b63d-136ed3c6be35\") " pod="openshift-image-registry/image-registry-6c5684fdcf-l5m76"
Oct 30 20:38:06.395778 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:38:06.395674    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/6cd9770e-ea54-4c33-ac1e-5643f3d8839d-samples-operator-tls\") pod \"cluster-samples-operator-6ddb6c8b94-7d57c\" (UID: \"6cd9770e-ea54-4c33-ac1e-5643f3d8839d\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-7d57c"
Oct 30 20:38:06.395778 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:38:06.395694    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/73676585-4ea4-43cb-af99-b4716472fb15-networking-console-plugin-cert\") pod \"networking-console-plugin-86c478bb88-fl89x\" (UID: \"73676585-4ea4-43cb-af99-b4716472fb15\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-fl89x"
Oct 30 20:38:06.395778 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:38:06.395724    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/aaadd8de-58cb-45af-a477-384fbf1cf317-metrics-tls\") pod \"dns-default-265zm\" (UID: \"aaadd8de-58cb-45af-a477-384fbf1cf317\") " pod="openshift-dns/dns-default-265zm"
Oct 30 20:38:06.395778 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:38:06.395756    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cd59fef4-66a5-471b-a8ef-18df25e44d5c-metrics-certs\") pod \"router-default-5b9d6cdd59-4g6mx\" (UID: \"cd59fef4-66a5-471b-a8ef-18df25e44d5c\") " pod="openshift-ingress/router-default-5b9d6cdd59-4g6mx"
Oct 30 20:38:06.396365 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:38:06.396335    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cd59fef4-66a5-471b-a8ef-18df25e44d5c-service-ca-bundle\") pod \"router-default-5b9d6cdd59-4g6mx\" (UID: \"cd59fef4-66a5-471b-a8ef-18df25e44d5c\") " pod="openshift-ingress/router-default-5b9d6cdd59-4g6mx"
Oct 30 20:38:06.398234 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:38:06.398206    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/aaadd8de-58cb-45af-a477-384fbf1cf317-metrics-tls\") pod \"dns-default-265zm\" (UID: \"aaadd8de-58cb-45af-a477-384fbf1cf317\") " pod="openshift-dns/dns-default-265zm"
Oct 30 20:38:06.398349 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:38:06.398270    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/73676585-4ea4-43cb-af99-b4716472fb15-networking-console-plugin-cert\") pod \"networking-console-plugin-86c478bb88-fl89x\" (UID: \"73676585-4ea4-43cb-af99-b4716472fb15\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-fl89x"
Oct 30 20:38:06.398415 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:38:06.398342    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b3bff4d5-f9a8-4302-b63d-136ed3c6be35-registry-tls\") pod \"image-registry-6c5684fdcf-l5m76\" (UID: \"b3bff4d5-f9a8-4302-b63d-136ed3c6be35\") " pod="openshift-image-registry/image-registry-6c5684fdcf-l5m76"
Oct 30 20:38:06.398595 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:38:06.398576    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cd59fef4-66a5-471b-a8ef-18df25e44d5c-metrics-certs\") pod \"router-default-5b9d6cdd59-4g6mx\" (UID: \"cd59fef4-66a5-471b-a8ef-18df25e44d5c\") " pod="openshift-ingress/router-default-5b9d6cdd59-4g6mx"
Oct 30 20:38:06.398681 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:38:06.398591    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/6cd9770e-ea54-4c33-ac1e-5643f3d8839d-samples-operator-tls\") pod \"cluster-samples-operator-6ddb6c8b94-7d57c\" (UID: \"6cd9770e-ea54-4c33-ac1e-5643f3d8839d\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-7d57c"
Oct 30 20:38:06.577689 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:38:06.577656    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-5b9d6cdd59-4g6mx"
Oct 30 20:38:06.599635 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:38:06.599609    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-7d57c"
Oct 30 20:38:06.617388 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:38:06.617255    2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-dockercfg-9qsb8\""
Oct 30 20:38:06.622425 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:38:06.622396    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6c5684fdcf-l5m76"
Oct 30 20:38:06.629183 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:38:06.626003    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-86c478bb88-fl89x"
Oct 30 20:38:06.702112 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:38:06.702017    2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-wsjv8\""
Oct 30 20:38:06.710326 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:38:06.710302    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-265zm"
Oct 30 20:38:07.023090 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:38:07.022934    2577 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-5b9d6cdd59-4g6mx"]
Oct 30 20:38:07.025662 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:38:07.025634    2577 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcd59fef4_66a5_471b_a8ef_18df25e44d5c.slice/crio-71ed00c42bdcd0ee5d18398ebbbb1db1cc2293c018ef1b4d1a1a7b5417893be9 WatchSource:0}: Error finding container 71ed00c42bdcd0ee5d18398ebbbb1db1cc2293c018ef1b4d1a1a7b5417893be9: Status 404 returned error can't find the container with id 71ed00c42bdcd0ee5d18398ebbbb1db1cc2293c018ef1b4d1a1a7b5417893be9
Oct 30 20:38:07.055933 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:38:07.055907    2577 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-7d57c"]
Oct 30 20:38:07.073099 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:38:07.073072    2577 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-86c478bb88-fl89x"]
Oct 30 20:38:07.073921 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:38:07.073898    2577 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod73676585_4ea4_43cb_af99_b4716472fb15.slice/crio-7185e7d5c843ee0755d3c3eccc2f874e7a470f56052336f380f365847d632f37 WatchSource:0}: Error finding container 7185e7d5c843ee0755d3c3eccc2f874e7a470f56052336f380f365847d632f37: Status 404 returned error can't find the container with id 7185e7d5c843ee0755d3c3eccc2f874e7a470f56052336f380f365847d632f37
Oct 30 20:38:07.074850 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:38:07.074807    2577 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6c5684fdcf-l5m76"]
Oct 30 20:38:07.076960 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:38:07.076900    2577 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb3bff4d5_f9a8_4302_b63d_136ed3c6be35.slice/crio-ed2c4569b0ef02ef7486d1463e75049ee89c6ad4b14a41244e5f16c0dfda8853 WatchSource:0}: Error finding container ed2c4569b0ef02ef7486d1463e75049ee89c6ad4b14a41244e5f16c0dfda8853: Status 404 returned error can't find the container with id ed2c4569b0ef02ef7486d1463e75049ee89c6ad4b14a41244e5f16c0dfda8853
Oct 30 20:38:07.108857 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:38:07.108830    2577 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-265zm"]
Oct 30 20:38:07.111406 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:38:07.111383    2577 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaaadd8de_58cb_45af_a477_384fbf1cf317.slice/crio-1c7cf13c5e7d97d83e2894e2fe03fec0e591c3fca850b253e4736ff5994873fd WatchSource:0}: Error finding container 1c7cf13c5e7d97d83e2894e2fe03fec0e591c3fca850b253e4736ff5994873fd: Status 404 returned error can't find the container with id 1c7cf13c5e7d97d83e2894e2fe03fec0e591c3fca850b253e4736ff5994873fd
Oct 30 20:38:07.480331 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:38:07.480295    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-86c478bb88-fl89x" event={"ID":"73676585-4ea4-43cb-af99-b4716472fb15","Type":"ContainerStarted","Data":"7185e7d5c843ee0755d3c3eccc2f874e7a470f56052336f380f365847d632f37"}
Oct 30 20:38:07.481438 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:38:07.481410    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-7d57c" event={"ID":"6cd9770e-ea54-4c33-ac1e-5643f3d8839d","Type":"ContainerStarted","Data":"16f3dda5ceedd4b983a9583d227589b440f5d269e991c5a282ba12bbfe0e5826"}
Oct 30 20:38:07.482888 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:38:07.482867    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-5b9d6cdd59-4g6mx" event={"ID":"cd59fef4-66a5-471b-a8ef-18df25e44d5c","Type":"ContainerStarted","Data":"46ceee4a7a59709ee634c41cff34c9f06a44de83358a2db086f6e42701d74609"}
Oct 30 20:38:07.483013 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:38:07.482908    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-5b9d6cdd59-4g6mx" event={"ID":"cd59fef4-66a5-471b-a8ef-18df25e44d5c","Type":"ContainerStarted","Data":"71ed00c42bdcd0ee5d18398ebbbb1db1cc2293c018ef1b4d1a1a7b5417893be9"}
Oct 30 20:38:07.484508 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:38:07.484488    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6c5684fdcf-l5m76" event={"ID":"b3bff4d5-f9a8-4302-b63d-136ed3c6be35","Type":"ContainerStarted","Data":"22640beac8730d2a896c3efed39a9cae4696ae5c13b58f6c6489eacac98a526b"}
Oct 30 20:38:07.484618 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:38:07.484525    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6c5684fdcf-l5m76" event={"ID":"b3bff4d5-f9a8-4302-b63d-136ed3c6be35","Type":"ContainerStarted","Data":"ed2c4569b0ef02ef7486d1463e75049ee89c6ad4b14a41244e5f16c0dfda8853"}
Oct 30 20:38:07.484618 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:38:07.484545    2577 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-6c5684fdcf-l5m76"
Oct 30 20:38:07.485678 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:38:07.485659    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-265zm" event={"ID":"aaadd8de-58cb-45af-a477-384fbf1cf317","Type":"ContainerStarted","Data":"1c7cf13c5e7d97d83e2894e2fe03fec0e591c3fca850b253e4736ff5994873fd"}
Oct 30 20:38:07.578301 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:38:07.578273    2577 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-5b9d6cdd59-4g6mx"
Oct 30 20:38:07.580982 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:38:07.580952    2577 patch_prober.go:29] interesting pod/router-default-5b9d6cdd59-4g6mx container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-proxy-http failed: reason withheld
Oct 30 20:38:07.580982 ip-10-0-138-85 kubenswrapper[2577]: [+]has-synced ok
Oct 30 20:38:07.580982 ip-10-0-138-85 kubenswrapper[2577]: [+]process-running ok
Oct 30 20:38:07.580982 ip-10-0-138-85 kubenswrapper[2577]: healthz check failed
Oct 30 20:38:07.581151 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:38:07.581008    2577 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-5b9d6cdd59-4g6mx" podUID="cd59fef4-66a5-471b-a8ef-18df25e44d5c" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500"
Oct 30 20:38:07.603647 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:38:07.603602    2577 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/router-default-5b9d6cdd59-4g6mx" podStartSLOduration=432.603590838 podStartE2EDuration="7m12.603590838s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:30:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:38:07.60275609 +0000 UTC m=+65.049551538" watchObservedRunningTime="2026-10-30 20:38:07.603590838 +0000 UTC m=+65.050386287"
Oct 30 20:38:08.012426 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:38:08.012386    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a4cdc725-3dd0-4917-b8a0-c8ff77a40abb-original-pull-secret\") pod \"global-pull-secret-syncer-tvvd9\" (UID: \"a4cdc725-3dd0-4917-b8a0-c8ff77a40abb\") " pod="kube-system/global-pull-secret-syncer-tvvd9"
Oct 30 20:38:08.012613 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:38:08.012449    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0f424633-11a5-49fa-a933-f9c6ec7ca97e-metrics-certs\") pod \"network-metrics-daemon-mlctd\" (UID: \"0f424633-11a5-49fa-a933-f9c6ec7ca97e\") " pod="openshift-multus/network-metrics-daemon-mlctd"
Oct 30 20:38:08.064180 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:38:08.064145    2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Oct 30 20:38:08.064180 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:38:08.064176    2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Oct 30 20:38:08.093083 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:38:08.076345    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0f424633-11a5-49fa-a933-f9c6ec7ca97e-metrics-certs\") pod \"network-metrics-daemon-mlctd\" (UID: \"0f424633-11a5-49fa-a933-f9c6ec7ca97e\") " pod="openshift-multus/network-metrics-daemon-mlctd"
Oct 30 20:38:08.093083 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:38:08.078351    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a4cdc725-3dd0-4917-b8a0-c8ff77a40abb-original-pull-secret\") pod \"global-pull-secret-syncer-tvvd9\" (UID: \"a4cdc725-3dd0-4917-b8a0-c8ff77a40abb\") " pod="kube-system/global-pull-secret-syncer-tvvd9"
Oct 30 20:38:08.217960 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:38:08.217928    2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-4lpn7\""
Oct 30 20:38:08.219948 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:38:08.219923    2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"global-pull-secret-syncer-dockercfg-49f2v\""
Oct 30 20:38:08.227314 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:38:08.227288    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mlctd"
Oct 30 20:38:08.228938 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:38:08.228917    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tvvd9"
Oct 30 20:38:08.580233 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:38:08.580105    2577 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-5b9d6cdd59-4g6mx"
Oct 30 20:38:08.620478 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:38:08.620418    2577 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-image-registry/image-registry-6c5684fdcf-l5m76" podStartSLOduration=56.620396403 podStartE2EDuration="56.620396403s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:37:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:38:07.722268281 +0000 UTC m=+65.169063731" watchObservedRunningTime="2026-10-30 20:38:08.620396403 +0000 UTC m=+66.067191854"
Oct 30 20:38:08.623226 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:38:08.621902    2577 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-mlctd"]
Oct 30 20:38:08.631397 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:38:08.631363    2577 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0f424633_11a5_49fa_a933_f9c6ec7ca97e.slice/crio-785ea1d56bc26d9acb8aece1b9d4d4abb385a1dc10cd092e84179201a1c55bdf WatchSource:0}: Error finding container 785ea1d56bc26d9acb8aece1b9d4d4abb385a1dc10cd092e84179201a1c55bdf: Status 404 returned error can't find the container with id 785ea1d56bc26d9acb8aece1b9d4d4abb385a1dc10cd092e84179201a1c55bdf
Oct 30 20:38:08.677122 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:38:08.676372    2577 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-tvvd9"]
Oct 30 20:38:08.686355 ip-10-0-138-85 kubenswrapper[2577]: W1030 20:38:08.686159    2577 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda4cdc725_3dd0_4917_b8a0_c8ff77a40abb.slice/crio-3c4b7aa9d6b93e3bc695fb3bc709c056fa379953a683ee1028bab28928775a8b WatchSource:0}: Error finding container 3c4b7aa9d6b93e3bc695fb3bc709c056fa379953a683ee1028bab28928775a8b: Status 404 returned error can't find the container with id 3c4b7aa9d6b93e3bc695fb3bc709c056fa379953a683ee1028bab28928775a8b
Oct 30 20:38:09.509161 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:38:09.509124    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-86c478bb88-fl89x" event={"ID":"73676585-4ea4-43cb-af99-b4716472fb15","Type":"ContainerStarted","Data":"a094aeb7be54eb9a4dcf145abc659c9ce6d569fb96ee867c3fa4137a523259f9"}
Oct 30 20:38:09.512339 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:38:09.512308    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-7d57c" event={"ID":"6cd9770e-ea54-4c33-ac1e-5643f3d8839d","Type":"ContainerStarted","Data":"b8be40a03358121dce9b718b6b0a9211864f66a706332ee785f06dd24cbed4a4"}
Oct 30 20:38:09.515128 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:38:09.514831    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-tvvd9" event={"ID":"a4cdc725-3dd0-4917-b8a0-c8ff77a40abb","Type":"ContainerStarted","Data":"3c4b7aa9d6b93e3bc695fb3bc709c056fa379953a683ee1028bab28928775a8b"}
Oct 30 20:38:09.518742 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:38:09.518717    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-mlctd" event={"ID":"0f424633-11a5-49fa-a933-f9c6ec7ca97e","Type":"ContainerStarted","Data":"785ea1d56bc26d9acb8aece1b9d4d4abb385a1dc10cd092e84179201a1c55bdf"}
Oct 30 20:38:09.524113 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:38:09.524083    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-265zm" event={"ID":"aaadd8de-58cb-45af-a477-384fbf1cf317","Type":"ContainerStarted","Data":"003aca413b57c1d497b2b70a98377b3b39acbad2044719b92df0952f257f9272"}
Oct 30 20:38:09.524206 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:38:09.524148    2577 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-5b9d6cdd59-4g6mx"
Oct 30 20:38:09.524869 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:38:09.524828    2577 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-5b9d6cdd59-4g6mx"
Oct 30 20:38:09.626040 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:38:09.625975    2577 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-86c478bb88-fl89x" podStartSLOduration=400.976857534 podStartE2EDuration="6m42.625956248s" totalImagesPullingTime="1.649098714s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:31:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:38:09.623632305 +0000 UTC m=+67.070427759" watchObservedRunningTime="2026-10-30 20:38:09.625956248 +0000 UTC m=+67.072751699"
Oct 30 20:38:10.530750 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:38:10.530627    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-265zm" event={"ID":"aaadd8de-58cb-45af-a477-384fbf1cf317","Type":"ContainerStarted","Data":"4ffcff3377d2e3cdc7273df15201e4e5a1b73328b9ce4960f0f96992f26239e8"}
Oct 30 20:38:10.530986 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:38:10.530796    2577 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-265zm"
Oct 30 20:38:10.533103 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:38:10.533080    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-7d57c" event={"ID":"6cd9770e-ea54-4c33-ac1e-5643f3d8839d","Type":"ContainerStarted","Data":"0382e64f97137c30ce608b1c6d1627e1989f5a9122520844baf0e74f232e26a9"}
Oct 30 20:38:10.535212 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:38:10.535110    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-mlctd" event={"ID":"0f424633-11a5-49fa-a933-f9c6ec7ca97e","Type":"ContainerStarted","Data":"a4daa59131a7e3f6c7682826436ba2c66cb68a80e780619c4459f5e86d68b60d"}
Oct 30 20:38:10.535212 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:38:10.535162    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-mlctd" event={"ID":"0f424633-11a5-49fa-a933-f9c6ec7ca97e","Type":"ContainerStarted","Data":"9c3441e6283b40b7dff206327f5eed076790a2f536bf758d45bebf9780447252"}
Oct 30 20:38:10.647986 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:38:10.647926    2577 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-dns/dns-default-265zm" podStartSLOduration=34.366904372 podStartE2EDuration="36.647911419s" totalImagesPullingTime="2.281007047s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:37:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:38:10.64638888 +0000 UTC m=+68.093184332" watchObservedRunningTime="2026-10-30 20:38:10.647911419 +0000 UTC m=+68.094706877"
Oct 30 20:38:10.764244 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:38:10.764176    2577 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-mlctd" podStartSLOduration=65.196018036 podStartE2EDuration="1m6.764158619s" totalImagesPullingTime="1.568140583s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:37:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:38:10.763373056 +0000 UTC m=+68.210168504" watchObservedRunningTime="2026-10-30 20:38:10.764158619 +0000 UTC m=+68.210954068"
Oct 30 20:38:10.879458 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:38:10.879336    2577 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-7d57c" podStartSLOduration=433.588152145 podStartE2EDuration="7m15.879323305s" totalImagesPullingTime="2.29117116s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:30:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:38:10.878442483 +0000 UTC m=+68.325237931" watchObservedRunningTime="2026-10-30 20:38:10.879323305 +0000 UTC m=+68.326118755"
Oct 30 20:38:13.374437 ip-10-0-138-85 kubenswrapper[2577]: I1030 20:38:13.374408    2577 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-lqdtq"
Oct 30 20:38:14.019372 ip-10-0-138-85 systemd[1]: Stopping Kubernetes Kubelet...
Oct 30 20:38:14.035559 ip-10-0-138-85 systemd[1]: kubelet.service: Deactivated successfully.
Oct 30 20:38:14.035720 ip-10-0-138-85 systemd[1]: Stopped Kubernetes Kubelet.
Oct 30 20:38:14.035770 ip-10-0-138-85 systemd[1]: kubelet.service: Consumed 4.697s CPU time.
Oct 30 20:38:14.047669 ip-10-0-138-85 systemd[1]: Starting Kubernetes Kubelet...
Oct 30 20:38:14.119089 ip-10-0-138-85 kubenswrapper[6004]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Oct 30 20:38:14.119089 ip-10-0-138-85 kubenswrapper[6004]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Oct 30 20:38:14.119089 ip-10-0-138-85 kubenswrapper[6004]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Oct 30 20:38:14.119089 ip-10-0-138-85 kubenswrapper[6004]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Oct 30 20:38:14.121208 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.121118    6004 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 30 20:38:14.121208 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.121206    6004 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 30 20:38:14.121208 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.121209    6004 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 30 20:38:14.121208 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.121213    6004 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 30 20:38:14.121345 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.121216    6004 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 30 20:38:14.121345 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.121220    6004 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 30 20:38:14.121345 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.121222    6004 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 30 20:38:14.121345 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.121226    6004 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 30 20:38:14.121345 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.121228    6004 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 30 20:38:14.121345 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.121236    6004 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 30 20:38:14.121345 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.121240    6004 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 30 20:38:14.121345 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.121242    6004 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 30 20:38:14.121345 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.121245    6004 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 30 20:38:14.121345 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.121248    6004 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 30 20:38:14.121345 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.121251    6004 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 30 20:38:14.121345 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.121254    6004 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 30 20:38:14.121345 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.121256    6004 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 30 20:38:14.121345 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.121259    6004 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 30 20:38:14.121345 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.121262    6004 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 30 20:38:14.121345 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.121265    6004 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 30 20:38:14.121345 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.121267    6004 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 30 20:38:14.121345 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.121270    6004 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 30 20:38:14.121345 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.121273    6004 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 30 20:38:14.121345 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.121275    6004 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 30 20:38:14.121852 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.121278    6004 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 30 20:38:14.121852 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.121280    6004 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 30 20:38:14.121852 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.121283    6004 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 30 20:38:14.121852 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.121286    6004 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 30 20:38:14.121852 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.121288    6004 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 30 20:38:14.121852 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.121291    6004 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 30 20:38:14.121852 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.121293    6004 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 30 20:38:14.121852 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.121296    6004 feature_gate.go:386] unrecognized feature gate: Example
Oct 30 20:38:14.121852 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.121298    6004 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 30 20:38:14.121852 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.121302    6004 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 30 20:38:14.121852 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.121305    6004 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 30 20:38:14.121852 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.121308    6004 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 30 20:38:14.121852 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.121315    6004 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 30 20:38:14.121852 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.121318    6004 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 30 20:38:14.121852 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.121321    6004 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 30 20:38:14.121852 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.121324    6004 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 30 20:38:14.121852 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.121327    6004 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 30 20:38:14.121852 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.121329    6004 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 30 20:38:14.121852 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.121332    6004 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 30 20:38:14.121852 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.121335    6004 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 30 20:38:14.122395 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.121338    6004 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 30 20:38:14.122395 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.121340    6004 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 30 20:38:14.122395 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.121343    6004 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 30 20:38:14.122395 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.121347    6004 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 30 20:38:14.122395 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.121351    6004 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 30 20:38:14.122395 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.121355    6004 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 30 20:38:14.122395 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.121358    6004 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 30 20:38:14.122395 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.121361    6004 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 30 20:38:14.122395 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.121364    6004 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 30 20:38:14.122395 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.121367    6004 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 30 20:38:14.122395 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.121370    6004 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 30 20:38:14.122395 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.121372    6004 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 30 20:38:14.122395 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.121375    6004 feature_gate.go:386] unrecognized feature gate: Example2
Oct 30 20:38:14.122395 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.121378    6004 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 30 20:38:14.122395 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.121381    6004 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 30 20:38:14.122395 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.121384    6004 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 30 20:38:14.122395 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.121387    6004 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 30 20:38:14.122395 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.121390    6004 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 30 20:38:14.122395 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.121392    6004 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 30 20:38:14.122877 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.121395    6004 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 30 20:38:14.122877 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.121398    6004 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 30 20:38:14.122877 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.121401    6004 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 30 20:38:14.122877 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.121404    6004 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 30 20:38:14.122877 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.121406    6004 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 30 20:38:14.122877 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.121409    6004 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 30 20:38:14.122877 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.121415    6004 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 30 20:38:14.122877 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.121418    6004 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 30 20:38:14.122877 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.121422    6004 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 30 20:38:14.122877 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.121425    6004 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 30 20:38:14.122877 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.121428    6004 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 30 20:38:14.122877 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.121430    6004 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 30 20:38:14.122877 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.121433    6004 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 30 20:38:14.122877 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.121436    6004 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 30 20:38:14.122877 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.121439    6004 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 30 20:38:14.122877 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.121442    6004 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 30 20:38:14.122877 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.121444    6004 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 30 20:38:14.122877 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.121447    6004 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 30 20:38:14.122877 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.121450    6004 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 30 20:38:14.123362 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.121453    6004 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 30 20:38:14.123362 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.121456    6004 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 30 20:38:14.123362 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.121459    6004 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 30 20:38:14.123362 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.121461    6004 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 30 20:38:14.123362 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.121464    6004 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 30 20:38:14.123362 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.121467    6004 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 30 20:38:14.123362 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.121470    6004 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 30 20:38:14.123362 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.121472    6004 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 30 20:38:14.123362 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.121475    6004 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 30 20:38:14.123362 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.121478    6004 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 30 20:38:14.123362 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.121482    6004 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 30 20:38:14.123362 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.121484    6004 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 30 20:38:14.123362 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.121487    6004 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 30 20:38:14.123362 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.121490    6004 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 30 20:38:14.123362 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.121492    6004 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 30 20:38:14.123362 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.121495    6004 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 30 20:38:14.123362 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.121497    6004 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 30 20:38:14.123362 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.121500    6004 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 30 20:38:14.123362 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.121503    6004 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 30 20:38:14.123848 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.121506    6004 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 30 20:38:14.123848 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.121509    6004 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 30 20:38:14.123848 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.121511    6004 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 30 20:38:14.123848 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.121514    6004 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 30 20:38:14.123848 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.121517    6004 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 30 20:38:14.123848 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.122314    6004 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 30 20:38:14.123848 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.122322    6004 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 30 20:38:14.123848 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.122326    6004 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 30 20:38:14.123848 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.122328    6004 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 30 20:38:14.123848 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.122331    6004 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 30 20:38:14.123848 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.122334    6004 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 30 20:38:14.123848 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.122337    6004 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 30 20:38:14.123848 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.122340    6004 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 30 20:38:14.123848 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.122343    6004 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 30 20:38:14.123848 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.122346    6004 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 30 20:38:14.123848 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.122348    6004 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 30 20:38:14.123848 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.122352    6004 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 30 20:38:14.123848 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.122354    6004 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 30 20:38:14.123848 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.122357    6004 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 30 20:38:14.123848 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.122360    6004 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 30 20:38:14.124376 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.122362    6004 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 30 20:38:14.124376 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.122365    6004 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 30 20:38:14.124376 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.122368    6004 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 30 20:38:14.124376 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.122370    6004 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 30 20:38:14.124376 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.122373    6004 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 30 20:38:14.124376 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.122376    6004 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 30 20:38:14.124376 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.122378    6004 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 30 20:38:14.124376 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.122381    6004 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 30 20:38:14.124376 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.122384    6004 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 30 20:38:14.124376 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.122386    6004 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 30 20:38:14.124376 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.122389    6004 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 30 20:38:14.124376 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.122392    6004 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 30 20:38:14.124376 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.122395    6004 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 30 20:38:14.124376 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.122398    6004 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 30 20:38:14.124376 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.122402    6004 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 30 20:38:14.124376 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.122405    6004 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 30 20:38:14.124376 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.122407    6004 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 30 20:38:14.124376 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.122410    6004 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 30 20:38:14.124376 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.122413    6004 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 30 20:38:14.124376 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.122416    6004 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 30 20:38:14.124880 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.122418    6004 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 30 20:38:14.124880 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.122421    6004 feature_gate.go:386] unrecognized feature gate: Example
Oct 30 20:38:14.124880 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.122423    6004 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 30 20:38:14.124880 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.122427    6004 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 30 20:38:14.124880 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.122430    6004 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 30 20:38:14.124880 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.122433    6004 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 30 20:38:14.124880 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.122436    6004 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 30 20:38:14.124880 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.122438    6004 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 30 20:38:14.124880 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.122441    6004 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 30 20:38:14.124880 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.122444    6004 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 30 20:38:14.124880 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.122447    6004 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 30 20:38:14.124880 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.122450    6004 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 30 20:38:14.124880 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.122453    6004 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 30 20:38:14.124880 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.122456    6004 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 30 20:38:14.124880 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.122458    6004 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 30 20:38:14.124880 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.122461    6004 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 30 20:38:14.124880 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.122464    6004 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 30 20:38:14.124880 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.122466    6004 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 30 20:38:14.124880 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.122469    6004 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 30 20:38:14.124880 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.122472    6004 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 30 20:38:14.125653 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.122475    6004 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 30 20:38:14.125653 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.122477    6004 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 30 20:38:14.125653 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.122480    6004 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 30 20:38:14.125653 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.122482    6004 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 30 20:38:14.125653 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.122485    6004 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 30 20:38:14.125653 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.122487    6004 feature_gate.go:386] unrecognized feature gate: Example2
Oct 30 20:38:14.125653 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.122490    6004 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 30 20:38:14.125653 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.122494    6004 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 30 20:38:14.125653 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.122496    6004 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 30 20:38:14.125653 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.122499    6004 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 30 20:38:14.125653 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.122502    6004 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 30 20:38:14.125653 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.122504    6004 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 30 20:38:14.125653 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.122507    6004 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 30 20:38:14.125653 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.122510    6004 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 30 20:38:14.125653 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.122512    6004 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 30 20:38:14.125653 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.122515    6004 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 30 20:38:14.125653 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.122518    6004 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 30 20:38:14.125653 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.122522    6004 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 30 20:38:14.125653 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.122526    6004 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 30 20:38:14.126205 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.122530    6004 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 30 20:38:14.126205 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.122534    6004 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 30 20:38:14.126205 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.122537    6004 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 30 20:38:14.126205 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.122540    6004 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 30 20:38:14.126205 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.122544    6004 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 30 20:38:14.126205 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.122548    6004 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 30 20:38:14.126205 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.122552    6004 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 30 20:38:14.126205 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.122556    6004 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 30 20:38:14.126205 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.122558    6004 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 30 20:38:14.126205 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.122561    6004 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 30 20:38:14.126205 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.122564    6004 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 30 20:38:14.126205 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.122567    6004 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 30 20:38:14.126205 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.122570    6004 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 30 20:38:14.126205 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.122572    6004 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 30 20:38:14.126205 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.122575    6004 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 30 20:38:14.126205 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.122578    6004 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 30 20:38:14.126205 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.122580    6004 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 30 20:38:14.126205 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.122583    6004 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 30 20:38:14.126205 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.122586    6004 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 30 20:38:14.126689 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.122588    6004 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 30 20:38:14.126689 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.122591    6004 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 30 20:38:14.126689 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.122594    6004 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 30 20:38:14.126689 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.122597    6004 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 30 20:38:14.126689 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.122600    6004 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 30 20:38:14.126689 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.122603    6004 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 30 20:38:14.126689 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.122606    6004 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 30 20:38:14.126689 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.122608    6004 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 30 20:38:14.126689 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.122611    6004 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 30 20:38:14.126689 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.122614    6004 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 30 20:38:14.126689 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.122617    6004 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 30 20:38:14.126689 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.122619    6004 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 30 20:38:14.126689 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.122623    6004 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 30 20:38:14.126689 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.123122    6004 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 30 20:38:14.126689 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.123129    6004 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 30 20:38:14.126689 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.123132    6004 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 30 20:38:14.126689 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.123136    6004 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 30 20:38:14.126689 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.123138    6004 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 30 20:38:14.126689 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.123141    6004 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 30 20:38:14.126689 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.123144    6004 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 30 20:38:14.127209 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.123148    6004 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 30 20:38:14.127209 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.123150    6004 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 30 20:38:14.127209 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.123153    6004 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 30 20:38:14.127209 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.123156    6004 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 30 20:38:14.127209 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.123159    6004 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 30 20:38:14.127209 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.123162    6004 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 30 20:38:14.127209 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.123164    6004 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 30 20:38:14.127209 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.123167    6004 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 30 20:38:14.127209 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.123170    6004 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 30 20:38:14.127209 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.123173    6004 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 30 20:38:14.127209 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.123176    6004 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 30 20:38:14.127209 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.123179    6004 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 30 20:38:14.127209 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.123181    6004 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 30 20:38:14.127209 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.123184    6004 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 30 20:38:14.127209 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.123187    6004 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 30 20:38:14.127209 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.123190    6004 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 30 20:38:14.127209 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.123193    6004 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 30 20:38:14.127209 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.123196    6004 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 30 20:38:14.127209 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.123198    6004 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 30 20:38:14.127209 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.123201    6004 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 30 20:38:14.127776 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.123204    6004 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 30 20:38:14.127776 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.123207    6004 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 30 20:38:14.127776 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.123209    6004 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 30 20:38:14.127776 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.123212    6004 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 30 20:38:14.127776 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.123214    6004 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 30 20:38:14.127776 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.123218    6004 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 30 20:38:14.127776 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.123221    6004 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 30 20:38:14.127776 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.123224    6004 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 30 20:38:14.127776 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.123227    6004 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 30 20:38:14.127776 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.123230    6004 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 30 20:38:14.127776 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.123232    6004 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 30 20:38:14.127776 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.123235    6004 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 30 20:38:14.127776 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.123238    6004 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 30 20:38:14.127776 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.123241    6004 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 30 20:38:14.127776 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.123244    6004 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 30 20:38:14.127776 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.123246    6004 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 30 20:38:14.127776 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.123249    6004 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 30 20:38:14.127776 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.123251    6004 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 30 20:38:14.127776 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.123254    6004 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 30 20:38:14.128572 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.123257    6004 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 30 20:38:14.128572 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.123259    6004 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 30 20:38:14.128572 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.123262    6004 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 30 20:38:14.128572 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.123264    6004 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 30 20:38:14.128572 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.123267    6004 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 30 20:38:14.128572 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.123270    6004 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 30 20:38:14.128572 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.123272    6004 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 30 20:38:14.128572 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.123275    6004 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 30 20:38:14.128572 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.123278    6004 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 30 20:38:14.128572 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.123281    6004 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 30 20:38:14.128572 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.123283    6004 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 30 20:38:14.128572 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.123286    6004 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 30 20:38:14.128572 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.123289    6004 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 30 20:38:14.128572 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.123291    6004 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 30 20:38:14.128572 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.123294    6004 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 30 20:38:14.128572 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.123296    6004 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 30 20:38:14.128572 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.123302    6004 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 30 20:38:14.128572 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.123305    6004 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 30 20:38:14.128572 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.123308    6004 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 30 20:38:14.129142 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.123310    6004 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 30 20:38:14.129142 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.123313    6004 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 30 20:38:14.129142 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.123316    6004 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 30 20:38:14.129142 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.123318    6004 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 30 20:38:14.129142 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.123321    6004 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 30 20:38:14.129142 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.123324    6004 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 30 20:38:14.129142 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.123326    6004 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 30 20:38:14.129142 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.123329    6004 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 30 20:38:14.129142 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.123332    6004 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 30 20:38:14.129142 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.123334    6004 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 30 20:38:14.129142 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.123337    6004 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 30 20:38:14.129142 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.123341    6004 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 30 20:38:14.129142 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.123345    6004 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 30 20:38:14.129142 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.123348    6004 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 30 20:38:14.129142 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.123351    6004 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 30 20:38:14.129142 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.123354    6004 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 30 20:38:14.129142 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.123356    6004 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 30 20:38:14.129142 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.123359    6004 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 30 20:38:14.129142 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.123361    6004 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 30 20:38:14.129619 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.123364    6004 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 30 20:38:14.129619 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.123367    6004 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 30 20:38:14.129619 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.123370    6004 feature_gate.go:386] unrecognized feature gate: Example
Oct 30 20:38:14.129619 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.123373    6004 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 30 20:38:14.129619 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.123376    6004 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 30 20:38:14.129619 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.123379    6004 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 30 20:38:14.129619 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.123381    6004 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 30 20:38:14.129619 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.123384    6004 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 30 20:38:14.129619 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.123387    6004 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 30 20:38:14.129619 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.123391    6004 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 30 20:38:14.129619 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.123396    6004 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 30 20:38:14.129619 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.123400    6004 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 30 20:38:14.129619 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.123404    6004 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 30 20:38:14.129619 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.123407    6004 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 30 20:38:14.129619 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.123409    6004 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 30 20:38:14.129619 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.123412    6004 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 30 20:38:14.129619 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.123415    6004 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 30 20:38:14.129619 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.123418    6004 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 30 20:38:14.129619 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.123421    6004 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 30 20:38:14.129619 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.123423    6004 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 30 20:38:14.130152 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.123426    6004 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 30 20:38:14.130152 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.123429    6004 feature_gate.go:386] unrecognized feature gate: Example2
Oct 30 20:38:14.130152 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:14.123522    6004 flags.go:64] FLAG: --address="0.0.0.0"
Oct 30 20:38:14.130152 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:14.123534    6004 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Oct 30 20:38:14.130152 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:14.123540    6004 flags.go:64] FLAG: --anonymous-auth="true"
Oct 30 20:38:14.130152 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:14.123545    6004 flags.go:64] FLAG: --application-metrics-count-limit="100"
Oct 30 20:38:14.130152 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:14.123550    6004 flags.go:64] FLAG: --authentication-token-webhook="false"
Oct 30 20:38:14.130152 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:14.123553    6004 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Oct 30 20:38:14.130152 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:14.123557    6004 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Oct 30 20:38:14.130152 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:14.123562    6004 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Oct 30 20:38:14.130152 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:14.123565    6004 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Oct 30 20:38:14.130152 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:14.123568    6004 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Oct 30 20:38:14.130152 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:14.123572    6004 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Oct 30 20:38:14.130152 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:14.123575    6004 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Oct 30 20:38:14.130152 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:14.123579    6004 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Oct 30 20:38:14.130152 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:14.123582    6004 flags.go:64] FLAG: --cgroup-root=""
Oct 30 20:38:14.130152 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:14.123585    6004 flags.go:64] FLAG: --cgroups-per-qos="true"
Oct 30 20:38:14.130152 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:14.123589    6004 flags.go:64] FLAG: --client-ca-file=""
Oct 30 20:38:14.130152 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:14.123592    6004 flags.go:64] FLAG: --cloud-provider="external"
Oct 30 20:38:14.130152 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:14.123595    6004 flags.go:64] FLAG: --cluster-dns="[]"
Oct 30 20:38:14.130152 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:14.123598    6004 flags.go:64] FLAG: --cluster-domain=""
Oct 30 20:38:14.130152 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:14.123601    6004 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Oct 30 20:38:14.130152 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:14.123606    6004 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Oct 30 20:38:14.130152 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:14.123610    6004 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Oct 30 20:38:14.130758 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:14.123615    6004 flags.go:64] FLAG: --container-log-max-files="5"
Oct 30 20:38:14.130758 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:14.123618    6004 flags.go:64] FLAG: --container-log-max-size="10Mi"
Oct 30 20:38:14.130758 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:14.123622    6004 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Oct 30 20:38:14.130758 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:14.123625    6004 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Oct 30 20:38:14.130758 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:14.123629    6004 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Oct 30 20:38:14.130758 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:14.123632    6004 flags.go:64] FLAG: --contention-profiling="false"
Oct 30 20:38:14.130758 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:14.123635    6004 flags.go:64] FLAG: --cpu-cfs-quota="true"
Oct 30 20:38:14.130758 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:14.123638    6004 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Oct 30 20:38:14.130758 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:14.123642    6004 flags.go:64] FLAG: --cpu-manager-policy="none"
Oct 30 20:38:14.130758 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:14.123645    6004 flags.go:64] FLAG: --cpu-manager-policy-options=""
Oct 30 20:38:14.130758 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:14.123649    6004 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Oct 30 20:38:14.130758 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:14.123652    6004 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Oct 30 20:38:14.130758 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:14.123655    6004 flags.go:64] FLAG: --enable-debugging-handlers="true"
Oct 30 20:38:14.130758 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:14.123658    6004 flags.go:64] FLAG: --enable-load-reader="false"
Oct 30 20:38:14.130758 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:14.123661    6004 flags.go:64] FLAG: --enable-server="true"
Oct 30 20:38:14.130758 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:14.123664    6004 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Oct 30 20:38:14.130758 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:14.123669    6004 flags.go:64] FLAG: --event-burst="100"
Oct 30 20:38:14.130758 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:14.123672    6004 flags.go:64] FLAG: --event-qps="50"
Oct 30 20:38:14.130758 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:14.123675    6004 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Oct 30 20:38:14.130758 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:14.123678    6004 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Oct 30 20:38:14.130758 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:14.123681    6004 flags.go:64] FLAG: --eviction-hard=""
Oct 30 20:38:14.130758 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:14.123686    6004 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Oct 30 20:38:14.130758 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:14.123689    6004 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Oct 30 20:38:14.130758 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:14.123692    6004 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Oct 30 20:38:14.130758 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:14.123695    6004 flags.go:64] FLAG: --eviction-soft=""
Oct 30 20:38:14.131433 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:14.123699    6004 flags.go:64] FLAG: --eviction-soft-grace-period=""
Oct 30 20:38:14.131433 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:14.123702    6004 flags.go:64] FLAG: --exit-on-lock-contention="false"
Oct 30 20:38:14.131433 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:14.123705    6004 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Oct 30 20:38:14.131433 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:14.123708    6004 flags.go:64] FLAG: --experimental-mounter-path=""
Oct 30 20:38:14.131433 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:14.123711    6004 flags.go:64] FLAG: --fail-cgroupv1="true"
Oct 30 20:38:14.131433 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:14.123715    6004 flags.go:64] FLAG: --fail-swap-on="true"
Oct 30 20:38:14.131433 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:14.123718    6004 flags.go:64] FLAG: --feature-gates=""
Oct 30 20:38:14.131433 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:14.123724    6004 flags.go:64] FLAG: --file-check-frequency="20s"
Oct 30 20:38:14.131433 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:14.123727    6004 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Oct 30 20:38:14.131433 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:14.123730    6004 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Oct 30 20:38:14.131433 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:14.123734    6004 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Oct 30 20:38:14.131433 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:14.123737    6004 flags.go:64] FLAG: --healthz-port="10248"
Oct 30 20:38:14.131433 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:14.123740    6004 flags.go:64] FLAG: --help="false"
Oct 30 20:38:14.131433 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:14.123743    6004 flags.go:64] FLAG: --hostname-override="ip-10-0-138-85.us-west-1.compute.internal"
Oct 30 20:38:14.131433 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:14.123747    6004 flags.go:64] FLAG: --housekeeping-interval="10s"
Oct 30 20:38:14.131433 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:14.123750    6004 flags.go:64] FLAG: --http-check-frequency="20s"
Oct 30 20:38:14.131433 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:14.123753    6004 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Oct 30 20:38:14.131433 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:14.123756    6004 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Oct 30 20:38:14.131433 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:14.123760    6004 flags.go:64] FLAG: --image-gc-high-threshold="85"
Oct 30 20:38:14.131433 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:14.123763    6004 flags.go:64] FLAG: --image-gc-low-threshold="80"
Oct 30 20:38:14.131433 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:14.123766    6004 flags.go:64] FLAG: --image-service-endpoint=""
Oct 30 20:38:14.131433 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:14.123769    6004 flags.go:64] FLAG: --kernel-memcg-notification="false"
Oct 30 20:38:14.131433 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:14.123772    6004 flags.go:64] FLAG: --kube-api-burst="100"
Oct 30 20:38:14.132025 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:14.123775    6004 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Oct 30 20:38:14.132025 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:14.123778    6004 flags.go:64] FLAG: --kube-api-qps="50"
Oct 30 20:38:14.132025 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:14.123781    6004 flags.go:64] FLAG: --kube-reserved=""
Oct 30 20:38:14.132025 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:14.123784    6004 flags.go:64] FLAG: --kube-reserved-cgroup=""
Oct 30 20:38:14.132025 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:14.123787    6004 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Oct 30 20:38:14.132025 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:14.123790    6004 flags.go:64] FLAG: --kubelet-cgroups=""
Oct 30 20:38:14.132025 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:14.123793    6004 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Oct 30 20:38:14.132025 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:14.123796    6004 flags.go:64] FLAG: --lock-file=""
Oct 30 20:38:14.132025 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:14.123799    6004 flags.go:64] FLAG: --log-cadvisor-usage="false"
Oct 30 20:38:14.132025 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:14.123802    6004 flags.go:64] FLAG: --log-flush-frequency="5s"
Oct 30 20:38:14.132025 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:14.123806    6004 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Oct 30 20:38:14.132025 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:14.123811    6004 flags.go:64] FLAG: --log-json-split-stream="false"
Oct 30 20:38:14.132025 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:14.123815    6004 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Oct 30 20:38:14.132025 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:14.123818    6004 flags.go:64] FLAG: --log-text-split-stream="false"
Oct 30 20:38:14.132025 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:14.123822    6004 flags.go:64] FLAG: --logging-format="text"
Oct 30 20:38:14.132025 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:14.123825    6004 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Oct 30 20:38:14.132025 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:14.123833    6004 flags.go:64] FLAG: --make-iptables-util-chains="true"
Oct 30 20:38:14.132025 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:14.123836    6004 flags.go:64] FLAG: --manifest-url=""
Oct 30 20:38:14.132025 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:14.123839    6004 flags.go:64] FLAG: --manifest-url-header=""
Oct 30 20:38:14.132025 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:14.123843    6004 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Oct 30 20:38:14.132025 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:14.123846    6004 flags.go:64] FLAG: --max-open-files="1000000"
Oct 30 20:38:14.132025 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:14.123850    6004 flags.go:64] FLAG: --max-pods="110"
Oct 30 20:38:14.132025 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:14.123854    6004 flags.go:64] FLAG: --maximum-dead-containers="-1"
Oct 30 20:38:14.132025 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:14.123857    6004 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Oct 30 20:38:14.132025 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:14.123860    6004 flags.go:64] FLAG: --memory-manager-policy="None"
Oct 30 20:38:14.132685 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:14.123863    6004 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Oct 30 20:38:14.132685 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:14.123866    6004 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Oct 30 20:38:14.132685 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:14.123869    6004 flags.go:64] FLAG: --node-ip="0.0.0.0"
Oct 30 20:38:14.132685 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:14.123873    6004 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Oct 30 20:38:14.132685 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:14.123880    6004 flags.go:64] FLAG: --node-status-max-images="50"
Oct 30 20:38:14.132685 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:14.123883    6004 flags.go:64] FLAG: --node-status-update-frequency="10s"
Oct 30 20:38:14.132685 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:14.123886    6004 flags.go:64] FLAG: --oom-score-adj="-999"
Oct 30 20:38:14.132685 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:14.123889    6004 flags.go:64] FLAG: --pod-cidr=""
Oct 30 20:38:14.132685 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:14.123892    6004 flags.go:64] FLAG: --pod-manifest-path=""
Oct 30 20:38:14.132685 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:14.123895    6004 flags.go:64] FLAG: --pod-max-pids="-1"
Oct 30 20:38:14.132685 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:14.123898    6004 flags.go:64] FLAG: --pods-per-core="0"
Oct 30 20:38:14.132685 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:14.123901    6004 flags.go:64] FLAG: --port="10250"
Oct 30 20:38:14.132685 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:14.123904    6004 flags.go:64] FLAG: --protect-kernel-defaults="false"
Oct 30 20:38:14.132685 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:14.123907    6004 flags.go:64] FLAG: --provider-id="aws:///us-west-1a/i-0628b1f1e57a8dbfd"
Oct 30 20:38:14.132685 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:14.123911    6004 flags.go:64] FLAG: --qos-reserved=""
Oct 30 20:38:14.132685 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:14.123913    6004 flags.go:64] FLAG: --read-only-port="10255"
Oct 30 20:38:14.132685 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:14.123916    6004 flags.go:64] FLAG: --register-node="true"
Oct 30 20:38:14.132685 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:14.123919    6004 flags.go:64] FLAG: --register-with-taints=""
Oct 30 20:38:14.132685 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:14.123924    6004 flags.go:64] FLAG: --registry-burst="10"
Oct 30 20:38:14.132685 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:14.123927    6004 flags.go:64] FLAG: --registry-qps="5"
Oct 30 20:38:14.132685 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:14.123930    6004 flags.go:64] FLAG: --reserved-cpus=""
Oct 30 20:38:14.132685 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:14.123934    6004 flags.go:64] FLAG: --reserved-memory=""
Oct 30 20:38:14.132685 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:14.123937    6004 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Oct 30 20:38:14.132685 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:14.123942    6004 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Oct 30 20:38:14.132685 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:14.123945    6004 flags.go:64] FLAG: --rotate-certificates="false"
Oct 30 20:38:14.132685 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:14.123948    6004 flags.go:64] FLAG: --rotate-server-certificates="false"
Oct 30 20:38:14.133353 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:14.123951    6004 flags.go:64] FLAG: --runonce="false"
Oct 30 20:38:14.133353 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:14.123954    6004 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Oct 30 20:38:14.133353 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:14.123957    6004 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Oct 30 20:38:14.133353 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:14.123960    6004 flags.go:64] FLAG: --seccomp-default="false"
Oct 30 20:38:14.133353 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:14.123963    6004 flags.go:64] FLAG: --serialize-image-pulls="true"
Oct 30 20:38:14.133353 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:14.123966    6004 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Oct 30 20:38:14.133353 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:14.123969    6004 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Oct 30 20:38:14.133353 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:14.123972    6004 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Oct 30 20:38:14.133353 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:14.123975    6004 flags.go:64] FLAG: --storage-driver-password="root"
Oct 30 20:38:14.133353 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:14.123978    6004 flags.go:64] FLAG: --storage-driver-secure="false"
Oct 30 20:38:14.133353 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:14.123981    6004 flags.go:64] FLAG: --storage-driver-table="stats"
Oct 30 20:38:14.133353 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:14.123984    6004 flags.go:64] FLAG: --storage-driver-user="root"
Oct 30 20:38:14.133353 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:14.123987    6004 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Oct 30 20:38:14.133353 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:14.123990    6004 flags.go:64] FLAG: --sync-frequency="1m0s"
Oct 30 20:38:14.133353 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:14.123993    6004 flags.go:64] FLAG: --system-cgroups=""
Oct 30 20:38:14.133353 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:14.123996    6004 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Oct 30 20:38:14.133353 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:14.124001    6004 flags.go:64] FLAG: --system-reserved-cgroup=""
Oct 30 20:38:14.133353 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:14.124004    6004 flags.go:64] FLAG: --tls-cert-file=""
Oct 30 20:38:14.133353 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:14.124007    6004 flags.go:64] FLAG: --tls-cipher-suites="[]"
Oct 30 20:38:14.133353 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:14.124010    6004 flags.go:64] FLAG: --tls-min-version=""
Oct 30 20:38:14.133353 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:14.124013    6004 flags.go:64] FLAG: --tls-private-key-file=""
Oct 30 20:38:14.133353 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:14.124016    6004 flags.go:64] FLAG: --topology-manager-policy="none"
Oct 30 20:38:14.133353 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:14.124018    6004 flags.go:64] FLAG: --topology-manager-policy-options=""
Oct 30 20:38:14.133353 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:14.124021    6004 flags.go:64] FLAG: --topology-manager-scope="container"
Oct 30 20:38:14.133353 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:14.124024    6004 flags.go:64] FLAG: --v="2"
Oct 30 20:38:14.133967 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:14.124029    6004 flags.go:64] FLAG: --version="false"
Oct 30 20:38:14.133967 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:14.124033    6004 flags.go:64] FLAG: --vmodule=""
Oct 30 20:38:14.133967 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:14.124037    6004 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Oct 30 20:38:14.133967 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:14.124040    6004 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Oct 30 20:38:14.133967 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.124229    6004 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 30 20:38:14.133967 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.124235    6004 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 30 20:38:14.133967 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.124239    6004 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 30 20:38:14.133967 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.124242    6004 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 30 20:38:14.133967 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.124245    6004 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 30 20:38:14.133967 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.124248    6004 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 30 20:38:14.133967 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.124251    6004 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 30 20:38:14.133967 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.124254    6004 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 30 20:38:14.133967 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.124256    6004 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 30 20:38:14.133967 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.124259    6004 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 30 20:38:14.133967 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.124262    6004 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 30 20:38:14.133967 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.124264    6004 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 30 20:38:14.133967 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.124267    6004 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 30 20:38:14.133967 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.124270    6004 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 30 20:38:14.133967 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.124273    6004 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 30 20:38:14.133967 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.124276    6004 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 30 20:38:14.134520 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.124279    6004 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 30 20:38:14.134520 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.124281    6004 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 30 20:38:14.134520 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.124284    6004 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 30 20:38:14.134520 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.124287    6004 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 30 20:38:14.134520 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.124291    6004 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 30 20:38:14.134520 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.124295    6004 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 30 20:38:14.134520 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.124298    6004 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 30 20:38:14.134520 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.124301    6004 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 30 20:38:14.134520 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.124305    6004 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 30 20:38:14.134520 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.124308    6004 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 30 20:38:14.134520 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.124311    6004 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 30 20:38:14.134520 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.124314    6004 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 30 20:38:14.134520 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.124317    6004 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 30 20:38:14.134520 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.124320    6004 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 30 20:38:14.134520 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.124323    6004 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 30 20:38:14.134520 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.124325    6004 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 30 20:38:14.134520 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.124330    6004 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 30 20:38:14.134520 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.124333    6004 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 30 20:38:14.134520 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.124336    6004 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 30 20:38:14.134520 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.124339    6004 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 30 20:38:14.135016 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.124341    6004 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 30 20:38:14.135016 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.124344    6004 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 30 20:38:14.135016 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.124347    6004 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 30 20:38:14.135016 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.124350    6004 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 30 20:38:14.135016 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.124354    6004 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 30 20:38:14.135016 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.124357    6004 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 30 20:38:14.135016 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.124360    6004 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 30 20:38:14.135016 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.124363    6004 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 30 20:38:14.135016 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.124366    6004 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 30 20:38:14.135016 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.124368    6004 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 30 20:38:14.135016 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.124371    6004 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 30 20:38:14.135016 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.124374    6004 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 30 20:38:14.135016 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.124377    6004 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 30 20:38:14.135016 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.124380    6004 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 30 20:38:14.135016 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.124382    6004 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 30 20:38:14.135016 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.124385    6004 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 30 20:38:14.135016 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.124388    6004 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 30 20:38:14.135016 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.124391    6004 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 30 20:38:14.135016 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.124394    6004 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 30 20:38:14.135600 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.124396    6004 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 30 20:38:14.135600 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.124399    6004 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 30 20:38:14.135600 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.124402    6004 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 30 20:38:14.135600 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.124405    6004 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 30 20:38:14.135600 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.124408    6004 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 30 20:38:14.135600 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.124410    6004 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 30 20:38:14.135600 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.124413    6004 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 30 20:38:14.135600 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.124416    6004 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 30 20:38:14.135600 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.124419    6004 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 30 20:38:14.135600 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.124423    6004 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 30 20:38:14.135600 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.124426    6004 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 30 20:38:14.135600 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.124428    6004 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 30 20:38:14.135600 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.124431    6004 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 30 20:38:14.135600 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.124434    6004 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 30 20:38:14.135600 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.124437    6004 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 30 20:38:14.135600 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.124439    6004 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 30 20:38:14.135600 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.124442    6004 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 30 20:38:14.135600 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.124444    6004 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 30 20:38:14.135600 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.124449    6004 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 30 20:38:14.135600 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.124452    6004 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 30 20:38:14.136294 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.124454    6004 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 30 20:38:14.136294 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.124457    6004 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 30 20:38:14.136294 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.124460    6004 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 30 20:38:14.136294 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.124465    6004 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 30 20:38:14.136294 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.124469    6004 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 30 20:38:14.136294 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.124473    6004 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 30 20:38:14.136294 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.124477    6004 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 30 20:38:14.136294 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.124482    6004 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 30 20:38:14.136294 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.124486    6004 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 30 20:38:14.136294 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.124491    6004 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 30 20:38:14.136294 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.124494    6004 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 30 20:38:14.136294 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.124496    6004 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 30 20:38:14.136294 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.124499    6004 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 30 20:38:14.136294 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.124502    6004 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 30 20:38:14.136294 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.124505    6004 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 30 20:38:14.136294 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.124507    6004 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 30 20:38:14.136294 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.124510    6004 feature_gate.go:386] unrecognized feature gate: Example2
Oct 30 20:38:14.136294 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.124513    6004 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 30 20:38:14.136294 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.124516    6004 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 30 20:38:14.136778 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.124518    6004 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 30 20:38:14.136778 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.124522    6004 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 30 20:38:14.136778 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.124526    6004 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 30 20:38:14.136778 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.124529    6004 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 30 20:38:14.136778 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.124532    6004 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 30 20:38:14.136778 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.124534    6004 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 30 20:38:14.136778 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.124537    6004 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 30 20:38:14.136778 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.124540    6004 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 30 20:38:14.136778 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.124542    6004 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 30 20:38:14.136778 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.124545    6004 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 30 20:38:14.136778 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.124548    6004 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 30 20:38:14.136778 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.124552    6004 feature_gate.go:386] unrecognized feature gate: Example
Oct 30 20:38:14.136778 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:14.124579    6004 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]}
Oct 30 20:38:14.136778 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.124620    6004 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 30 20:38:14.136778 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.124625    6004 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 30 20:38:14.136778 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.124628    6004 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 30 20:38:14.137240 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.124631    6004 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 30 20:38:14.137240 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.124634    6004 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 30 20:38:14.137240 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.124637    6004 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 30 20:38:14.137240 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.124640    6004 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 30 20:38:14.137240 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.124643    6004 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 30 20:38:14.137240 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.124646    6004 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 30 20:38:14.137240 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.124648    6004 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 30 20:38:14.137240 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.124651    6004 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 30 20:38:14.137240 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.124654    6004 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 30 20:38:14.137240 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.124656    6004 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 30 20:38:14.137240 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.124659    6004 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 30 20:38:14.137240 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.124662    6004 feature_gate.go:386] unrecognized feature gate: Example2
Oct 30 20:38:14.137240 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.124665    6004 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 30 20:38:14.137240 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.124667    6004 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 30 20:38:14.137240 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.124670    6004 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 30 20:38:14.137240 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.124673    6004 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 30 20:38:14.137240 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.124676    6004 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 30 20:38:14.137240 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.124679    6004 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 30 20:38:14.137240 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.124683    6004 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 30 20:38:14.137240 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.124686    6004 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 30 20:38:14.137882 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.124689    6004 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 30 20:38:14.137882 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.124691    6004 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 30 20:38:14.137882 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.124694    6004 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 30 20:38:14.137882 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.124697    6004 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 30 20:38:14.137882 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.124700    6004 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 30 20:38:14.137882 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.124703    6004 feature_gate.go:386] unrecognized feature gate: Example
Oct 30 20:38:14.137882 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.124705    6004 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 30 20:38:14.137882 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.124708    6004 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 30 20:38:14.137882 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.124712    6004 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 30 20:38:14.137882 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.124715    6004 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 30 20:38:14.137882 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.124717    6004 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 30 20:38:14.137882 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.124720    6004 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 30 20:38:14.137882 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.124723    6004 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 30 20:38:14.137882 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.124726    6004 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 30 20:38:14.137882 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.124728    6004 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 30 20:38:14.137882 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.124731    6004 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 30 20:38:14.137882 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.124734    6004 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 30 20:38:14.137882 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.124736    6004 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 30 20:38:14.137882 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.124739    6004 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 30 20:38:14.137882 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.124742    6004 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 30 20:38:14.138622 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.124744    6004 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 30 20:38:14.138622 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.124747    6004 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 30 20:38:14.138622 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.124750    6004 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 30 20:38:14.138622 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.124752    6004 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 30 20:38:14.138622 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.124755    6004 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 30 20:38:14.138622 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.124758    6004 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 30 20:38:14.138622 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.124762    6004 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 30 20:38:14.138622 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.124766    6004 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 30 20:38:14.138622 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.124769    6004 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 30 20:38:14.138622 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.124772    6004 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 30 20:38:14.138622 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.124777    6004 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 30 20:38:14.138622 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.124781    6004 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 30 20:38:14.138622 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.124784    6004 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 30 20:38:14.138622 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.124787    6004 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 30 20:38:14.138622 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.124789    6004 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 30 20:38:14.138622 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.124792    6004 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 30 20:38:14.138622 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.124794    6004 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 30 20:38:14.138622 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.124797    6004 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 30 20:38:14.138622 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.124800    6004 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 30 20:38:14.139168 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.124802    6004 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 30 20:38:14.139168 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.124806    6004 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 30 20:38:14.139168 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.124809    6004 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 30 20:38:14.139168 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.124812    6004 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 30 20:38:14.139168 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.124815    6004 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 30 20:38:14.139168 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.124817    6004 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 30 20:38:14.139168 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.124822    6004 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 30 20:38:14.139168 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.124826    6004 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 30 20:38:14.139168 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.124829    6004 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 30 20:38:14.139168 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.124831    6004 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 30 20:38:14.139168 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.124834    6004 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 30 20:38:14.139168 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.124837    6004 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 30 20:38:14.139168 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.124840    6004 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 30 20:38:14.139168 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.124843    6004 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 30 20:38:14.139168 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.124845    6004 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 30 20:38:14.139168 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.124848    6004 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 30 20:38:14.139168 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.124851    6004 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 30 20:38:14.139168 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.124853    6004 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 30 20:38:14.139168 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.124856    6004 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 30 20:38:14.139652 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.124859    6004 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 30 20:38:14.139652 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.124861    6004 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 30 20:38:14.139652 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.124864    6004 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 30 20:38:14.139652 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.124867    6004 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 30 20:38:14.139652 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.124870    6004 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 30 20:38:14.139652 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.124873    6004 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 30 20:38:14.139652 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.124876    6004 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 30 20:38:14.139652 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.124879    6004 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 30 20:38:14.139652 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.124882    6004 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 30 20:38:14.139652 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.124885    6004 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 30 20:38:14.139652 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.124888    6004 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 30 20:38:14.139652 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.124891    6004 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 30 20:38:14.139652 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.124893    6004 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 30 20:38:14.139652 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.124896    6004 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 30 20:38:14.139652 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.124900    6004 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 30 20:38:14.139652 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.124903    6004 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 30 20:38:14.139652 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.124906    6004 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 30 20:38:14.139652 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.124908    6004 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 30 20:38:14.139652 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.124911    6004 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 30 20:38:14.140165 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.124914    6004 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 30 20:38:14.140165 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.124916    6004 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 30 20:38:14.140165 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.124919    6004 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 30 20:38:14.140165 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.124923    6004 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 30 20:38:14.140165 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.124926    6004 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 30 20:38:14.140165 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.124929    6004 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 30 20:38:14.140165 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:14.130194    6004 server.go:525] "Kubelet version" kubeletVersion="v1.35.9"
Oct 30 20:38:14.140165 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:14.130212    6004 server.go:527] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Oct 30 20:38:14.140165 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:14.130232    6004 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Oct 30 20:38:14.140165 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:14.130237    6004 watchdog_linux.go:138] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Oct 30 20:38:14.140165 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.130296    6004 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 30 20:38:14.140165 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.130302    6004 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 30 20:38:14.140165 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.130306    6004 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 30 20:38:14.140165 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.130309    6004 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 30 20:38:14.140165 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.130312    6004 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 30 20:38:14.140165 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.130315    6004 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 30 20:38:14.140165 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.130318    6004 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 30 20:38:14.140165 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.130320    6004 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 30 20:38:14.140165 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.130323    6004 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 30 20:38:14.140654 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.130326    6004 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 30 20:38:14.140654 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.130329    6004 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 30 20:38:14.140654 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.130331    6004 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 30 20:38:14.140654 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.130334    6004 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 30 20:38:14.140654 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.130337    6004 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 30 20:38:14.140654 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.130340    6004 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 30 20:38:14.140654 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.130343    6004 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 30 20:38:14.140654 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.130346    6004 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 30 20:38:14.140654 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.130349    6004 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 30 20:38:14.140654 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.130351    6004 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 30 20:38:14.140654 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.130354    6004 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 30 20:38:14.140654 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.130357    6004 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 30 20:38:14.140654 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.130360    6004 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 30 20:38:14.140654 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.130363    6004 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 30 20:38:14.140654 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.130366    6004 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 30 20:38:14.140654 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.130368    6004 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 30 20:38:14.140654 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.130371    6004 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 30 20:38:14.140654 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.130374    6004 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 30 20:38:14.140654 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.130377    6004 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 30 20:38:14.141156 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.130380    6004 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 30 20:38:14.141156 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.130384    6004 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 30 20:38:14.141156 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.130387    6004 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 30 20:38:14.141156 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.130389    6004 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 30 20:38:14.141156 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.130394    6004 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 30 20:38:14.141156 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.130398    6004 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 30 20:38:14.141156 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.130402    6004 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 30 20:38:14.141156 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.130404    6004 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 30 20:38:14.141156 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.130407    6004 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 30 20:38:14.141156 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.130410    6004 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 30 20:38:14.141156 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.130413    6004 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 30 20:38:14.141156 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.130416    6004 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 30 20:38:14.141156 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.130418    6004 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 30 20:38:14.141156 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.130421    6004 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 30 20:38:14.141156 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.130424    6004 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 30 20:38:14.141156 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.130426    6004 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 30 20:38:14.141156 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.130429    6004 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 30 20:38:14.141156 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.130432    6004 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 30 20:38:14.141156 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.130434    6004 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 30 20:38:14.141730 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.130438    6004 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 30 20:38:14.141730 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.130441    6004 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 30 20:38:14.141730 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.130444    6004 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 30 20:38:14.141730 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.130446    6004 feature_gate.go:386] unrecognized feature gate: Example
Oct 30 20:38:14.141730 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.130449    6004 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 30 20:38:14.141730 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.130452    6004 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 30 20:38:14.141730 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.130454    6004 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 30 20:38:14.141730 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.130457    6004 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 30 20:38:14.141730 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.130460    6004 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 30 20:38:14.141730 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.130463    6004 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 30 20:38:14.141730 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.130466    6004 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 30 20:38:14.141730 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.130468    6004 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 30 20:38:14.141730 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.130471    6004 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 30 20:38:14.141730 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.130474    6004 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 30 20:38:14.141730 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.130477    6004 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 30 20:38:14.141730 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.130480    6004 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 30 20:38:14.141730 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.130483    6004 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 30 20:38:14.141730 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.130487    6004 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 30 20:38:14.141730 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.130490    6004 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 30 20:38:14.142250 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.130494    6004 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 30 20:38:14.142250 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.130497    6004 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 30 20:38:14.142250 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.130500    6004 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 30 20:38:14.142250 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.130503    6004 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 30 20:38:14.142250 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.130506    6004 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 30 20:38:14.142250 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.130509    6004 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 30 20:38:14.142250 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.130512    6004 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 30 20:38:14.142250 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.130515    6004 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 30 20:38:14.142250 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.130517    6004 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 30 20:38:14.142250 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.130520    6004 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 30 20:38:14.142250 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.130523    6004 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 30 20:38:14.142250 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.130526    6004 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 30 20:38:14.142250 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.130529    6004 feature_gate.go:386] unrecognized feature gate: Example2
Oct 30 20:38:14.142250 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.130533    6004 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 30 20:38:14.142250 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.130536    6004 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 30 20:38:14.142250 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.130539    6004 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 30 20:38:14.142250 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.130542    6004 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 30 20:38:14.142250 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.130544    6004 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 30 20:38:14.142250 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.130547    6004 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 30 20:38:14.142250 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.130550    6004 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 30 20:38:14.142808 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.130552    6004 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 30 20:38:14.142808 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.130555    6004 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 30 20:38:14.142808 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.130559    6004 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 30 20:38:14.142808 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.130561    6004 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 30 20:38:14.142808 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.130564    6004 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 30 20:38:14.142808 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.130567    6004 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 30 20:38:14.142808 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.130571    6004 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 30 20:38:14.142808 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.130574    6004 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 30 20:38:14.142808 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.130576    6004 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 30 20:38:14.142808 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.130579    6004 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 30 20:38:14.142808 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.130582    6004 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 30 20:38:14.142808 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.130585    6004 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 30 20:38:14.142808 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.130587    6004 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 30 20:38:14.142808 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.130590    6004 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 30 20:38:14.142808 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.130593    6004 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 30 20:38:14.142808 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.130595    6004 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 30 20:38:14.142808 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.130598    6004 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 30 20:38:14.142808 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.130601    6004 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 30 20:38:14.142808 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.130603    6004 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 30 20:38:14.142808 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.130606    6004 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 30 20:38:14.143365 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:14.130634    6004 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]}
Oct 30 20:38:14.143365 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.130787    6004 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 30 20:38:14.143365 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.130792    6004 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 30 20:38:14.143365 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.130795    6004 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 30 20:38:14.143365 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.130798    6004 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 30 20:38:14.143365 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.130801    6004 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 30 20:38:14.143365 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.130804    6004 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 30 20:38:14.143365 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.130808    6004 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 30 20:38:14.143365 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.130811    6004 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 30 20:38:14.143365 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.130813    6004 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 30 20:38:14.143365 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.130816    6004 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 30 20:38:14.143365 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.130820    6004 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 30 20:38:14.143365 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.130824    6004 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 30 20:38:14.143365 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.130827    6004 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 30 20:38:14.143365 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.130830    6004 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 30 20:38:14.143365 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.130833    6004 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 30 20:38:14.143815 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.130835    6004 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 30 20:38:14.143815 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.130839    6004 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 30 20:38:14.143815 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.130841    6004 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 30 20:38:14.143815 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.130844    6004 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 30 20:38:14.143815 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.130847    6004 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 30 20:38:14.143815 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.130849    6004 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 30 20:38:14.143815 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.130852    6004 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 30 20:38:14.143815 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.130855    6004 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 30 20:38:14.143815 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.130858    6004 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 30 20:38:14.143815 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.130860    6004 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 30 20:38:14.143815 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.130863    6004 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 30 20:38:14.143815 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.130866    6004 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 30 20:38:14.143815 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.130868    6004 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 30 20:38:14.143815 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.130871    6004 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 30 20:38:14.143815 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.130873    6004 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 30 20:38:14.143815 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.130876    6004 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 30 20:38:14.143815 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.130879    6004 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 30 20:38:14.143815 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.130882    6004 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 30 20:38:14.143815 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.130885    6004 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 30 20:38:14.144876 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.130888    6004 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 30 20:38:14.144876 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.130890    6004 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 30 20:38:14.144876 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.130893    6004 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 30 20:38:14.144876 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.130896    6004 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 30 20:38:14.144876 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.130900    6004 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 30 20:38:14.144876 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.130904    6004 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 30 20:38:14.144876 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.130908    6004 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 30 20:38:14.144876 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.130911    6004 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 30 20:38:14.144876 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.130914    6004 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 30 20:38:14.144876 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.130917    6004 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 30 20:38:14.144876 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.130920    6004 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 30 20:38:14.144876 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.130922    6004 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 30 20:38:14.144876 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.130925    6004 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 30 20:38:14.144876 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.130928    6004 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 30 20:38:14.144876 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.130930    6004 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 30 20:38:14.144876 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.130933    6004 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 30 20:38:14.144876 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.130936    6004 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 30 20:38:14.144876 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.130939    6004 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 30 20:38:14.144876 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.130942    6004 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 30 20:38:14.145430 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.130944    6004 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 30 20:38:14.145430 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.130947    6004 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 30 20:38:14.145430 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.130950    6004 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 30 20:38:14.145430 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.130952    6004 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 30 20:38:14.145430 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.130955    6004 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 30 20:38:14.145430 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.130958    6004 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 30 20:38:14.145430 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.130961    6004 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 30 20:38:14.145430 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.130963    6004 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 30 20:38:14.145430 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.130966    6004 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 30 20:38:14.145430 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.130968    6004 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 30 20:38:14.145430 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.130971    6004 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 30 20:38:14.145430 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.130974    6004 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 30 20:38:14.145430 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.130977    6004 feature_gate.go:386] unrecognized feature gate: Example2
Oct 30 20:38:14.145430 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.130980    6004 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 30 20:38:14.145430 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.130983    6004 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 30 20:38:14.145430 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.130985    6004 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 30 20:38:14.145430 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.130988    6004 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 30 20:38:14.145430 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.130991    6004 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 30 20:38:14.145430 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.130994    6004 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 30 20:38:14.145430 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.130996    6004 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 30 20:38:14.145930 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.130999    6004 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 30 20:38:14.145930 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.131002    6004 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 30 20:38:14.145930 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.131005    6004 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 30 20:38:14.145930 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.131007    6004 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 30 20:38:14.145930 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.131010    6004 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 30 20:38:14.145930 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.131013    6004 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 30 20:38:14.145930 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.131015    6004 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 30 20:38:14.145930 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.131018    6004 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 30 20:38:14.145930 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.131020    6004 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 30 20:38:14.145930 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.131023    6004 feature_gate.go:386] unrecognized feature gate: Example
Oct 30 20:38:14.145930 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.131026    6004 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 30 20:38:14.145930 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.131029    6004 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 30 20:38:14.145930 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.131031    6004 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 30 20:38:14.145930 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.131034    6004 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 30 20:38:14.145930 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.131036    6004 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 30 20:38:14.145930 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.131039    6004 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 30 20:38:14.145930 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.131042    6004 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 30 20:38:14.145930 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.131045    6004 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 30 20:38:14.145930 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.131062    6004 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 30 20:38:14.145930 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.131065    6004 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 30 20:38:14.146510 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.131068    6004 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 30 20:38:14.146510 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.131071    6004 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 30 20:38:14.146510 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.131073    6004 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 30 20:38:14.146510 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.131076    6004 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 30 20:38:14.146510 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.131079    6004 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 30 20:38:14.146510 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.131082    6004 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 30 20:38:14.146510 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.131085    6004 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 30 20:38:14.146510 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.131087    6004 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 30 20:38:14.146510 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.131090    6004 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 30 20:38:14.146510 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.131093    6004 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 30 20:38:14.146510 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.131095    6004 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 30 20:38:14.146510 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.131099    6004 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 30 20:38:14.146510 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.131102    6004 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 30 20:38:14.146510 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:14.131126    6004 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]}
Oct 30 20:38:14.146510 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.131157    6004 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 30 20:38:14.146896 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.131161    6004 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 30 20:38:14.146896 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.131165    6004 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 30 20:38:14.146896 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.131168    6004 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 30 20:38:14.146896 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.131170    6004 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 30 20:38:14.146896 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.131173    6004 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 30 20:38:14.146896 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.131176    6004 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 30 20:38:14.146896 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.131178    6004 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 30 20:38:14.146896 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.131181    6004 feature_gate.go:386] unrecognized feature gate: Example2
Oct 30 20:38:14.146896 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.131184    6004 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 30 20:38:14.146896 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.131186    6004 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 30 20:38:14.146896 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.131189    6004 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 30 20:38:14.146896 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.131192    6004 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 30 20:38:14.146896 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.131195    6004 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 30 20:38:14.146896 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.131197    6004 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 30 20:38:14.146896 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.131200    6004 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 30 20:38:14.146896 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.131203    6004 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 30 20:38:14.146896 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.131206    6004 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 30 20:38:14.146896 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.131209    6004 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 30 20:38:14.146896 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.131211    6004 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 30 20:38:14.147414 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.131214    6004 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 30 20:38:14.147414 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.131217    6004 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 30 20:38:14.147414 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.131219    6004 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 30 20:38:14.147414 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.131222    6004 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 30 20:38:14.147414 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.131225    6004 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 30 20:38:14.147414 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.131228    6004 feature_gate.go:386] unrecognized feature gate: Example
Oct 30 20:38:14.147414 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.131230    6004 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 30 20:38:14.147414 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.131233    6004 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 30 20:38:14.147414 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.131236    6004 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 30 20:38:14.147414 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.131239    6004 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 30 20:38:14.147414 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.131243    6004 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 30 20:38:14.147414 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.131245    6004 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 30 20:38:14.147414 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.131248    6004 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 30 20:38:14.147414 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.131251    6004 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 30 20:38:14.147414 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.131253    6004 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 30 20:38:14.147414 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.131256    6004 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 30 20:38:14.147414 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.131259    6004 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 30 20:38:14.147414 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.131261    6004 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 30 20:38:14.147414 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.131264    6004 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 30 20:38:14.147414 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.131267    6004 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 30 20:38:14.148042 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.131270    6004 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 30 20:38:14.148042 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.131272    6004 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 30 20:38:14.148042 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.131275    6004 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 30 20:38:14.148042 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.131278    6004 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 30 20:38:14.148042 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.131280    6004 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 30 20:38:14.148042 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.131283    6004 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 30 20:38:14.148042 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.131286    6004 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 30 20:38:14.148042 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.131288    6004 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 30 20:38:14.148042 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.131291    6004 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 30 20:38:14.148042 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.131294    6004 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 30 20:38:14.148042 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.131297    6004 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 30 20:38:14.148042 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.131299    6004 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 30 20:38:14.148042 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.131302    6004 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 30 20:38:14.148042 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.131307    6004 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 30 20:38:14.148042 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.131309    6004 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 30 20:38:14.148042 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.131312    6004 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 30 20:38:14.148042 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.131315    6004 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 30 20:38:14.148042 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.131318    6004 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 30 20:38:14.148042 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.131320    6004 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 30 20:38:14.148042 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.131324    6004 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 30 20:38:14.148557 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.131328    6004 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 30 20:38:14.148557 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.131330    6004 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 30 20:38:14.148557 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.131333    6004 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 30 20:38:14.148557 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.131336    6004 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 30 20:38:14.148557 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.131339    6004 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 30 20:38:14.148557 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.131341    6004 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 30 20:38:14.148557 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.131344    6004 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 30 20:38:14.148557 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.131347    6004 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 30 20:38:14.148557 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.131349    6004 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 30 20:38:14.148557 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.131352    6004 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 30 20:38:14.148557 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.131358    6004 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 30 20:38:14.148557 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.131362    6004 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 30 20:38:14.148557 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.131365    6004 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 30 20:38:14.148557 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.131368    6004 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 30 20:38:14.148557 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.131370    6004 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 30 20:38:14.148557 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.131373    6004 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 30 20:38:14.148557 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.131376    6004 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 30 20:38:14.148557 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.131379    6004 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 30 20:38:14.148557 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.131381    6004 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 30 20:38:14.148557 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.131384    6004 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 30 20:38:14.149073 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.131387    6004 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 30 20:38:14.149073 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.131390    6004 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 30 20:38:14.149073 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.131393    6004 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 30 20:38:14.149073 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.131396    6004 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 30 20:38:14.149073 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.131398    6004 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 30 20:38:14.149073 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.131402    6004 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 30 20:38:14.149073 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.131405    6004 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 30 20:38:14.149073 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.131408    6004 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 30 20:38:14.149073 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.131412    6004 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 30 20:38:14.149073 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.131417    6004 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 30 20:38:14.149073 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.131420    6004 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 30 20:38:14.149073 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.131423    6004 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 30 20:38:14.149073 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.131427    6004 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 30 20:38:14.149073 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.131430    6004 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 30 20:38:14.149073 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.131433    6004 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 30 20:38:14.149073 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.131436    6004 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 30 20:38:14.149073 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.131446    6004 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 30 20:38:14.149073 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.131452    6004 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 30 20:38:14.149073 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.131455    6004 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 30 20:38:14.149551 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.131458    6004 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 30 20:38:14.149551 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.131461    6004 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 30 20:38:14.149551 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.131463    6004 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 30 20:38:14.149551 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.131468    6004 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 30 20:38:14.149551 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.131470    6004 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 30 20:38:14.149551 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.131473    6004 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 30 20:38:14.149551 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:14.131476    6004 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 30 20:38:14.149551 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:14.131535    6004 server.go:957] "Client rotation is on, will bootstrap in background"
Oct 30 20:38:14.149551 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:14.132579    6004 bootstrap.go:85] "Current kubeconfig file contents are still valid, no bootstrap necessary"
Oct 30 20:38:14.149551 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:14.132631    6004 certificate_store.go:147] "Loading cert/key pair from a file" filePath="/var/lib/kubelet/pki/kubelet-client-current.pem"
Oct 30 20:38:14.149551 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:14.132827    6004 server.go:1014] "Starting client certificate rotation"
Oct 30 20:38:14.149551 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:14.132963    6004 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Oct 30 20:38:14.149551 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:14.133010    6004 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-10-29 20:32:03 +0000 UTC" deadline="2028-04-24 15:29:58.110086318 +0000 UTC"
Oct 30 20:38:14.149551 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:14.133059    6004 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13002h51m43.977041338s"
Oct 30 20:38:14.149551 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:14.133320    6004 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Oct 30 20:38:14.149551 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:14.134410    6004 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Oct 30 20:38:14.149949 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:14.135611    6004 log.go:25] "Validated CRI v1 runtime API"
Oct 30 20:38:14.149949 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:14.137563    6004 log.go:25] "Validated CRI v1 image API"
Oct 30 20:38:14.149949 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:14.138317    6004 server.go:1424] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Oct 30 20:38:14.149949 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:14.140792    6004 fs.go:135] Filesystem UUIDs: map[115fb574-e3e5-444a-a567-d8172141dbde:/dev/nvme0n1p4 2ebbd8e8-a9f6-4fa0-a75c-89c745e108b7:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2]
Oct 30 20:38:14.150097 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:14.140813    6004 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:24 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:26 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/02a557dab75dfe0f6ed35c6634e8a3488f54d0eb99085daa7b5deb877d2e1ba7/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/02a557dab75dfe0f6ed35c6634e8a3488f54d0eb99085daa7b5deb877d2e1ba7/userdata/shm major:0 minor:243 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/06e97711d4698ea1dbb35a81db7b4d144d621213c150dfe71a0e56eec41e586d/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/06e97711d4698ea1dbb35a81db7b4d144d621213c150dfe71a0e56eec41e586d/userdata/shm major:0 minor:329 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/09410978095d72951cc272dae5be2979d26a77b38714d8e43fbcbffb974196a1/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/09410978095d72951cc272dae5be2979d26a77b38714d8e43fbcbffb974196a1/userdata/shm major:0 minor:242 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/0d2cab1e4291094c1471865d16688f7a6546cdcf768d7493d1c4759fa3a3434d/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/0d2cab1e4291094c1471865d16688f7a6546cdcf768d7493d1c4759fa3a3434d/userdata/shm major:0 minor:357 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/0f4fb48440afc04a4fe603b9f13e0c085994cfabf5d14e9f77b79bbdf9f45088/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/0f4fb48440afc04a4fe603b9f13e0c085994cfabf5d14e9f77b79bbdf9f45088/userdata/shm major:0 minor:391 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/16f3dda5ceedd4b983a9583d227589b440f5d269e991c5a282ba12bbfe0e5826/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/16f3dda5ceedd4b983a9583d227589b440f5d269e991c5a282ba12bbfe0e5826/userdata/shm major:0 minor:440 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/19a86db780d09c50b7bb6f7d99b809986121c52c5fbdbca19debbd58212fb6e4/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/19a86db780d09c50b7bb6f7d99b809986121c52c5fbdbca19debbd58212fb6e4/userdata/shm major:0 minor:98 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/1a172c2763bdb8dfac94e4dfe195534aca58c8414f72576402b6d15d9301741f/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/1a172c2763bdb8dfac94e4dfe195534aca58c8414f72576402b6d15d9301741f/userdata/shm major:0 minor:233 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/1c7cf13c5e7d97d83e2894e2fe03fec0e591c3fca850b253e4736ff5994873fd/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/1c7cf13c5e7d97d83e2894e2fe03fec0e591c3fca850b253e4736ff5994873fd/userdata/shm major:0 minor:446 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/215a0f06b1ba627125a24388fe9d4c7883735f82bd784a859c0c6a9ae57b9599/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/215a0f06b1ba627125a24388fe9d4c7883735f82bd784a859c0c6a9ae57b9599/userdata/shm major:0 minor:94 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/27bf82e38841ca1e4c5e87738b53e9b60debb5bcc4d39e42c16e5fa32783cce3/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/27bf82e38841ca1e4c5e87738b53e9b60debb5bcc4d39e42c16e5fa32783cce3/userdata/shm major:0 minor:226 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/3c4b7aa9d6b93e3bc695fb3bc709c056fa379953a683ee1028bab28928775a8b/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/3c4b7aa9d6b93e3bc695fb3bc709c056fa379953a683ee1028bab28928775a8b/userdata/shm major:0 minor:478 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/3d466244841d35a3c5c8bed0792fbdfc479f701a0b134bd3e9a8c1f1ad7cd7fb/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/3d466244841d35a3c5c8bed0792fbdfc479f701a0b134bd3e9a8c1f1ad7cd7fb/userdata/shm major:0 minor:380 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/3ea28277b909832ad3750923ecd980712d3cabca4e362ad1334a773117bac35e/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/3ea28277b909832ad3750923ecd980712d3cabca4e362ad1334a773117bac35e/userdata/shm major:0 minor:337 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/3ee5674fefa80f861ac99efaff539b30317b132fd15d163a51175201cc743941/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/3ee5674fefa80f861ac99efaff539b30317b132fd15d163a51175201cc743941/userdata/shm major:0 minor:76 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/4088da9d4706d1180c27fbdd893b9e7895365e1298191651e59b97cd0ae5dc29/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/4088da9d4706d1180c27fbdd893b9e7895365e1298191651e59b97cd0ae5dc29/userdata/shm major:0 minor:254 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/4098327b09c725e4b0c5dd15ca8b971b63d1118afac841b02f631d8b8eb7e440/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/4098327b09c725e4b0c5dd15ca8b971b63d1118afac841b02f631d8b8eb7e440/userdata/shm major:0 minor:90 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/4b0bf6d5013068d8bbb0e5ea418174eb6ed04e5fe648b32719858885afa323e1/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/4b0bf6d5013068d8bbb0e5ea418174eb6ed04e5fe648b32719858885afa323e1/userdata/shm major:0 minor:60 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/66145fbcb03e7b18dcbe92eb181e4fb803aaee858de607365c278692a620f912/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/66145fbcb03e7b18dcbe92eb181e4fb803aaee858de607365c278692a620f912/userdata/shm major:0 minor:61 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/6c147cd2e985b08382d5544ea140b781216100fb882810c0ace9cb47679cdccd/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/6c147cd2e985b08382d5544ea140b781216100fb882810c0ace9cb47679cdccd/userdata/shm major:0 minor:80 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/6c96cef7fbddfcbae2c787759d6f82c874b85287eb58630616057cdc4a1d30e8/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/6c96cef7fbddfcbae2c787759d6f82c874b85287eb58630616057cdc4a1d30e8/userdata/shm major:0 minor:228 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/7185e7d5c843ee0755d3c3eccc2f874e7a470f56052336f380f365847d632f37/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/7185e7d5c843ee0755d3c3eccc2f874e7a470f56052336f380f365847d632f37/userdata/shm major:0 minor:443 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/71ed00c42bdcd0ee5d18398ebbbb1db1cc2293c018ef1b4d1a1a7b5417893be9/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/71ed00c42bdcd0ee5d18398ebbbb1db1cc2293c018ef1b4d1a1a7b5417893be9/userdata/shm major:0 minor:438 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/722d8048419608895a084525c22623910879d39fcee62a3b68e720e5acefbcc5/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/722d8048419608895a084525c22623910879d39fcee62a3b68e720e5acefbcc5/userdata/shm major:0 minor:84 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/7464cdd104d1f5884d27de3ec909a225235235639e60bfb30473f7d70141fa42/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/7464cdd104d1f5884d27de3ec909a225235235639e60bfb30473f7d70141fa42/userdata/shm major:0 minor:72 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/785ea1d56bc26d9acb8aece1b9d4d4abb385a1dc10cd092e84179201a1c55bdf/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/785ea1d56bc26d9acb8aece1b9d4d4abb385a1dc10cd092e84179201a1c55bdf/userdata/shm major:0 minor:476 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/7ac2c7083eb6835289efd435b8ec60ae66457c6a19c6f3d8e64f8b02bc1190e6/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/7ac2c7083eb6835289efd435b8ec60ae66457c6a19c6f3d8e64f8b02bc1190e6/userdata/shm major:0 minor:345 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/adfab031b80b88534a4d34be8417010a57059812a625478a6a3b3fba56218cc3/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/adfab031b80b88534a4d34be8417010a57059812a625478a6a3b3fba56218cc3/userdata/shm major:0 minor:415 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/b0b15f491b8385bf9ee746cbd3985f832579b42a340c1dc6e3443af6f61f25e5/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/b0b15f491b8385bf9ee746cbd3985f832579b42a340c1dc6e3443af6f61f25e5/userdata/shm major:0 minor:230 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/baeacfc304391a12cde769f20bf03da6002f7385c5a2080b0648c42526e4bc00/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/baeacfc304391a12cde769f20bf03da6002f7385c5a2080b0648c42526e4bc00/userdata/shm major:0 minor:68 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/bc0f209bfe0d8144bd3957cdb82896a69e098ce4b1ada0009dc90854b036073c/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/bc0f209bfe0d8144bd3957cdb82896a69e098ce4b1ada0009dc90854b036073c/userdata/shm major:0 minor:235 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/ceea8eb5df582eef6e1c92a2a0e04e96bf3dca304c816bb55b10064b00e659d4/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/ceea8eb5df582eef6e1c92a2a0e04e96bf3dca304c816bb55b10064b00e659d4/userdata/shm major:0 minor:419 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/e606140f9254872cbc379fb7b09b46df44fb15fed7d1375637c8d2ae8239f421/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/e606140f9254872cbc379fb7b09b46df44fb15fed7d1375637c8d2ae8239f421/userdata/shm major:0 minor:287 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/ed2c4569b0ef02ef7486d1463e75049ee89c6ad4b14a41244e5f16c0dfda8853/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/ed2c4569b0ef02ef7486d1463e75049ee89c6ad4b14a41244e5f16c0dfda8853/userdata/shm major:0 minor:442 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/f9d5194c08d6e2f26953231b76211dcdf3a77c719149ff159692ef748005380f/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/f9d5194c08d6e2f26953231b76211dcdf3a77c719149ff159692ef748005380f/userdata/shm major:0 minor:240 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/fcb69e9039ff6b8835f54db87a5c29114b148ed76f6ce48a9933d8bba63a3b4d/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/fcb69e9039ff6b8835f54db87a5c29114b148ed76f6ce48a9933d8bba63a3b4d/userdata/shm major:0 minor:237 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:32 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/0b7ae038-91bf-40f1-9930-8a6158706a3e/volume-subpaths/run-systemd/ovnkube-controller/6:{mountpoint:/var/lib/kubelet/pods/0b7ae038-91bf-40f1-9930-8a6158706a3e/volume-subpaths/run-systemd/ovnkube-controller/6 major:0 minor:26 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/0b7ae038-91bf-40f1-9930-8a6158706a3e/volumes/kubernetes.io~projected/kube-api-access-mh8k8:{mountpoint:/var/lib/kubelet/pods/0b7ae038-91bf-40f1-9930-8a6158706a3e/volumes/kubernetes.io~projected/kube-api-access-mh8k8 major:0 minor:51 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/0b7ae038-91bf-40f1-9930-8a6158706a3e/volumes/kubernetes.io~secret/ovn-node-metrics-cert:{mountpoint:/var/lib/kubelet/pods/0b7ae038-91bf-40f1-9930-8a6158706a3e/volumes/kubernetes.io~secret/ovn-node-metrics-cert major:0 minor:47 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/0df457c5-5640-4c0d-9f71-94548c11397a/volumes/kubernetes.io~projected/kube-api-access-htjnm:{mountpoint:/var/lib/kubelet/pods/0df457c5-5640-4c0d-9f71-94548c11397a/volumes/kubernetes.io~projected/kube-api-access-htjnm major:0 minor:339 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/0df457c5-5640-4c0d-9f71-94548c11397a/volumes/kubernetes.io~secret/insights-runtime-extractor-tls:{mountpoint:/var/lib/kubelet/pods/0df457c5-5640-4c0d-9f71-94548c11397a/volumes/kubernetes.io~secret/insights-runtime-extractor-tls major:0 minor:386 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/0f424633-11a5-49fa-a933-f9c6ec7ca97e/volumes/kubernetes.io~projected/kube-api-access-lq6t2:{mountpoint:/var/lib/kubelet/pods/0f424633-11a5-49fa-a933-f9c6ec7ca97e/volumes/kubernetes.io~projected/kube-api-access-lq6t2 major:0 minor:56 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/0f424633-11a5-49fa-a933-f9c6ec7ca97e/volumes/kubernetes.io~secret/metrics-certs:{mountpoint:/var/lib/kubelet/pods/0f424633-11a5-49fa-a933-f9c6ec7ca97e/volumes/kubernetes.io~secret/metrics-certs major:0 minor:469 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/16e71e18-453a-41bf-a3f8-9618482c9a50/volumes/kubernetes.io~projected/kube-api-access-c2w8k:{mountpoint:/var/lib/kubelet/pods/16e71e18-453a-41bf-a3f8-9618482c9a50/volumes/kubernetes.io~projected/kube-api-access-c2w8k major:0 minor:53 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/1dc89e41-1e32-476f-b5fc-e45945a45efd/volumes/kubernetes.io~empty-dir/etc-tuned:{mountpoint:/var/lib/kubelet/pods/1dc89e41-1e32-476f-b5fc-e45945a45efd/volumes/kubernetes.io~empty-dir/etc-tuned major:0 minor:50 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/1dc89e41-1e32-476f-b5fc-e45945a45efd/volumes/kubernetes.io~empty-dir/tmp:{mountpoint:/var/lib/kubelet/pods/1dc89e41-1e32-476f-b5fc-e45945a45efd/volumes/kubernetes.io~empty-dir/tmp major:0 minor:48 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/1dc89e41-1e32-476f-b5fc-e45945a45efd/volumes/kubernetes.io~projected/kube-api-access-wc2mp:{mountpoint:/var/lib/kubelet/pods/1dc89e41-1e32-476f-b5fc-e45945a45efd/volumes/kubernetes.io~projected/kube-api-access-wc2mp major:0 minor:59 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/2aee32c9-f358-4ff4-9d50-c18dba9885a5/volumes/kubernetes.io~projected/bound-sa-token:{mountpoint:/var/lib/kubelet/pods/2aee32c9-f358-4ff4-9d50-c18dba9885a5/volumes/kubernetes.io~projected/bound-sa-token major:0 minor:418 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/2aee32c9-f358-4ff4-9d50-c18dba9885a5/volumes/kubernetes.io~projected/kube-api-access-bkhhh:{mountpoint:/var/lib/kubelet/pods/2aee32c9-f358-4ff4-9d50-c18dba9885a5/volumes/kubernetes.io~projected/kube-api-access-bkhhh major:0 minor:417 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/2aee32c9-f358-4ff4-9d50-c18dba9885a5/volumes/kubernetes.io~projected/registry-tls:{mountpoint:/var/lib/kubelet/pods/2aee32c9-f358-4ff4-9d50-c18dba9885a5/volumes/kubernetes.io~projected/registry-tls major:0 minor:414 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/2aee32c9-f358-4ff4-9d50-c18dba9885a5/volumes/kubernetes.io~secret/image-registry-private-configuration:{mountpoint:/var/lib/kubelet/pods/2aee32c9-f358-4ff4-9d50-c18dba9885a5/volumes/kubernetes.io~secret/image-registry-private-configuration major:0 minor:413 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/2aee32c9-f358-4ff4-9d50-c18dba9885a5/volumes/kubernetes.io~secret/installation-pull-secrets:{mountpoint:/var/lib/kubelet/pods/2aee32c9-f358-4ff4-9d50-c18dba9885a5/volumes/kubernetes.io~secret/installation-pull-secrets major:0 minor:412 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/2f9dd030-281c-473e-b441-9ee972019413/volumes/kubernetes.io~projected/kube-api-access-48plj:{mountpoint:/var/lib/kubelet/pods/2f9dd030-281c-473e-b441-9ee972019413/volumes/kubernetes.io~projected/kube-api-access-48plj major:0 minor:55 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/4179c36b-8003-46e5-82b0-67f6edea7553/volumes/kubernetes.io~projected/kube-api-access-79wpr:{mountpoint:/var/lib/kubelet/pods/4179c36b-8003-46e5-82b0-67f6edea7553/volumes/kubernetes.io~projected/kube-api-access-79wpr major:0 minor:57 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/4dde41e2-34fe-429b-bf23-35bdb99d894e/volumes/kubernetes.io~projected/kube-api-access-xp792:{mountpoint:/var/lib/kubelet/pods/4dde41e2-34fe-429b-bf23-35bdb99d894e/volumes/kubernetes.io~projected/kube-api-access-xp792 major:0 minor:214 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/4dde41e2-34fe-429b-bf23-35bdb99d894e/volumes/kubernetes.io~secret/serving-cert:{mountpoint:/var/lib/kubelet/pods/4dde41e2-34fe-429b-bf23-35bdb99d894e/volumes/kubernetes.io~secret/serving-cert major:0 minor:207 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/50e37bd4-e46f-4577-b7b2-1ac7695637ea/volumes/kubernetes.io~projected/kube-api-access-7qzv8:{mountpoint:/var/lib/kubelet/pods/50e37bd4-e46f-4577-b7b2-1ac7695637ea/volumes/kubernetes.io~projected/kube-api-access-7qzv8 major:0 minor:278 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/519501c9-00d9-416f-887a-13b83aad5762/volumes/kubernetes.io~projected/kube-api-access-f2b6b:{mountpoint:/var/lib/kubelet/pods/519501c9-00d9-416f-887a-13b83aad5762/volumes/kubernetes.io~projected/kube-api-access-f2b6b major:0 minor:340 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/537a9c41-5ed1-4ff5-bf9a-9d0bcb853f80/volumes/kubernetes.io~projected/kube-api-access-9hnz8:{mountpoint:/var/lib/kubelet/pods/537a9c41-5ed1-4ff5-bf9a-9d0bcb853f80/volumes/kubernetes.io~projected/kube-api-access-9hnz8 major:0 minor:217 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/6080982d-ff7c-47b2-8a0c-5a2fff21722b/volumes/kubernetes.io~projected/kube-api-access-7z886:{mountpoint:/var/lib/kubelet/pods/6080982d-ff7c-47b2-8a0c-5a2fff21722b/volumes/kubernetes.io~projected/kube-api-access-7z886 major:0 minor:334 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/6cd9770e-ea54-4c33-ac1e-5643f3d8839d/volumes/kubernetes.io~projected/kube-api-access-trh2f:{mountpoint:/var/lib/kubelet/pods/6cd9770e-ea54-4c33-ac1e-5643f3d8839d/volumes/kubernetes.io~projected/kube-api-access-trh2f major:0 minor:210 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/6cd9770e-ea54-4c33-ac1e-5643f3d8839d/volumes/kubernetes.io~secret/samples-operator-tls:{mountpoint:/var/lib/kubelet/pods/6cd9770e-ea54-4c33-ac1e-5643f3d8839d/volumes/kubernetes.io~secret/samples-operator-tls major:0 minor:436 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/708a2c3c-e061-4bb1-b9ff-48f111b08943/volumes/kubernetes.io~secret/tls-certificates:{mountpoint:/var/lib/kubelet/pods/708a2c3c-e061-4bb1-b9ff-48f111b08943/volumes/kubernetes.io~secret/tls-certificates major:0 minor:408 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/73676585-4ea4-43cb-af99-b4716472fb15/volumes/kubernetes.io~secret/networking-console-plugin-cert:{mountpoint:/var/lib/kubelet/pods/73676585-4ea4-43cb-af99-b4716472fb15/volumes/kubernetes.io~secret/networking-console-plugin-cert major:0 minor:429 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/780e67fb-196e-485a-8aa4-e11cecdc4b63/volumes/kubernetes.io~projected/kube-api-access-49sfp:{mountpoint:/var/lib/kubelet/pods/780e67fb-196e-485a-8aa4-e11cecdc4b63/volumes/kubernetes.io~projected/kube-api-access-49sfp major:0 minor:58 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/793cb601-841f-4511-9b8f-ff30262611c2/volumes/kubernetes.io~projected/kube-api-access-72b4g:{mountpoint:/var/lib/kubelet/pods/793cb601-841f-4511-9b8f-ff30262611c2/volumes/kubernetes.io~projected/kube-api-access-72b4g major:0 minor:211 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/90cd3de0-c573-41c2-bf3e-cf0e46a41d50/volumes/kubernetes.io~projected/kube-api-access-tz88w:{mountpoint:/var/lib/kubelet/pods/90cd3de0-c573-41c2-bf3e-cf0e46a41d50/volumes/kubernetes.io~projected/kube-api-access-tz88w major:0 minor:216 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/90cd3de0-c573-41c2-bf3e-cf0e46a41d50/volumes/kubernetes.io~secret/serving-cert:{mountpoint:/var/lib/kubelet/pods/90cd3de0-c573-41c2-bf3e-cf0e46a41d50/volumes/kubernetes.io~secret/serving-cert major:0 minor:201 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/a4cdc725-3dd0-4917-b8a0-c8ff77a40abb/volumes/kubernetes.io~secret/original-pull-secret:{mountpoint:/var/lib/kubelet/pods/a4cdc725-3dd0-4917-b8a0-c8ff77a40abb/volumes/kubernetes.io~secret/original-pull-secret major:0 minor:475 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/aaadd8de-58cb-45af-a477-384fbf1cf317/volumes/kubernetes.io~projected/kube-api-access-hzklm:{mountpoint:/var/lib/kubelet/pods/aaadd8de-58cb-45af-a477-384fbf1cf317/volumes/kubernetes.io~projected/kube-api-access-hzklm major:0 minor:213 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/aaadd8de-58cb-45af-a477-384fbf1cf317/volumes/kubernetes.io~secret/metrics-tls:{mountpoint:/var/lib/kubelet/pods/aaadd8de-58cb-45af-a477-384fbf1cf317/volumes/kubernetes.io~secret/metrics-tls major:0 minor:434 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/ac7adab4-061f-4371-bc6c-96260eb988d8/volumes/kubernetes.io~projected/kube-api-access-mwd9g:{mountpoint:/var/lib/kubelet/pods/ac7adab4-061f-4371-bc6c-96260eb988d8/volumes/kubernetes.io~projected/kube-api-access-mwd9g major:0 minor:54 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/b2dae567-b378-41ed-9f7e-881153b7d03b/volumes/kubernetes.io~projected/kube-api-access-zkkqp:{mountpoint:/var/lib/kubelet/pods/b2dae567-b378-41ed-9f7e-881153b7d03b/volumes/kubernetes.io~projected/kube-api-access-zkkqp major:0 minor:52 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/b3bff4d5-f9a8-4302-b63d-136ed3c6be35/volumes/kubernetes.io~projected/bound-sa-token:{mountpoint:/var/lib/kubelet/pods/b3bff4d5-f9a8-4302-b63d-136ed3c6be35/volumes/kubernetes.io~projected/bound-sa-token major:0 minor:223 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/b3bff4d5-f9a8-4302-b63d-136ed3c6be35/volumes/kubernetes.io~projected/kube-api-access-75wkc:{mountpoint:/var/lib/kubelet/pods/b3bff4d5-f9a8-4302-b63d-136ed3c6be35/volumes/kubernetes.io~projected/kube-api-access-75wkc major:0 minor:224 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/b3bff4d5-f9a8-4302-b63d-136ed3c6be35/volumes/kubernetes.io~projected/registry-tls:{mountpoint:/var/lib/kubelet/pods/b3bff4d5-f9a8-4302-b63d-136ed3c6be35/volumes/kubernetes.io~projected/registry-tls major:0 minor:435 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/b3bff4d5-f9a8-4302-b63d-136ed3c6be35/volumes/kubernetes.io~secret/image-registry-private-configuration:{mountpoint:/var/lib/kubelet/pods/b3bff4d5-f9a8-4302-b63d-136ed3c6be35/volumes/kubernetes.io~secret/image-registry-private-configuration major:0 minor:208 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/b3bff4d5-f9a8-4302-b63d-136ed3c6be35/volumes/kubernetes.io~secret/installation-pull-secrets:{mountpoint:/var/lib/kubelet/pods/b3bff4d5-f9a8-4302-b63d-136ed3c6be35/volumes/kubernetes.io~secret/installation-pull-secrets major:0 minor:45 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/caca5f60-f777-4672-b570-faa422073cb9/volumes/kubernetes.io~projected/kube-api-access-mgww7:{mountpoint:/var/lib/kubelet/pods/caca5f60-f777-4672-b570-faa422073cb9/volumes/kubernetes.io~projected/kube-api-access-mgww7 major:0 minor:239 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/caca5f60-f777-4672-b570-faa422073cb9/volumes/kubernetes.io~secret/cert:{mountpoint:/var/lib/kubelet/pods/caca5f60-f777-4672-b570-faa422073cb9/volumes/kubernetes.io~secret/cert major:0 minor:232 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/cd59fef4-66a5-471b-a8ef-18df25e44d5c/volumes/kubernetes.io~projected/kube-api-access-rvdqt:{mountpoint:/var/lib/kubelet/pods/cd59fef4-66a5-471b-a8ef-18df25e44d5c/volumes/kubernetes.io~projected/kube-api-access-rvdqt major:0 minor:209 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/cd59fef4-66a5-471b-a8ef-18df25e44d5c/volumes/kubernetes.io~secret/default-certificate:{mountpoint:/var/lib/kubelet/pods/cd59fef4-66a5-471b-a8ef-18df25e44d5c/volumes/kubernetes.io~secret/default-certificate major:0 minor:205 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/cd59fef4-66a5-471b-a8ef-18df25e44d5c/volumes/kubernetes.io~secret/metrics-certs:{mountpoint:/var/lib/kubelet/pods/cd59fef4-66a5-471b-a8ef-18df25e44d5c/volumes/kubernetes.io~secret/metrics-certs major:0 minor:437 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/cd59fef4-66a5-471b-a8ef-18df25e44d5c/volumes/kubernetes.io~secret/stats-auth:{mountpoint:/var/lib/kubelet/pods/cd59fef4-66a5-471b-a8ef-18df25e44d5c/volumes/kubernetes.io~secret/stats-auth major:0 minor:197 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/d1fd1b0a-3831-4cb8-b6f3-ad2e67685188/volumes/kubernetes.io~projected/kube-api-access-cjbpj:{mountpoint:/var/lib/kubelet/pods/d1fd1b0a-3831-4cb8-b6f3-ad2e67685188/volumes/kubernetes.io~projected/kube-api-access-cjbpj major:0 minor:225 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/d1fd1b0a-3831-4cb8-b6f3-ad2e67685188/volumes/kubernetes.io~secret/cluster-monitoring-operator-tls:{mountpoint:/var/lib/kubelet/pods/d1fd1b0a-3831-4cb8-b6f3-ad2e67685188/volumes/kubernetes.io~secret/cluster-monitoring-operator-tls major:0 minor:375 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/db64c15b-58b0-4829-b702-de7b6c846ab4/volumes/kubernetes.io~projected/kube-api-access-nnz7p:{mountpoint:/var/lib/kubelet/pods/db64c15b-58b0-4829-b702-de7b6c846ab4/volumes/kubernetes.io~projected/kube-api-access-nnz7p major:0 minor:215 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/e33ef368-1f7c-4455-beb9-a2b2c5106792/volumes/kubernetes.io~projected/kube-api-access-4r7tw:{mountpoint:/var/lib/kubelet/pods/e33ef368-1f7c-4455-beb9-a2b2c5106792/volumes/kubernetes.io~projected/kube-api-access-4r7tw major:0 minor:222 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/e33ef368-1f7c-4455-beb9-a2b2c5106792/volumes/kubernetes.io~secret/serving-cert:{mountpoint:/var/lib/kubelet/pods/e33ef368-1f7c-4455-beb9-a2b2c5106792/volumes/kubernetes.io~secret/serving-cert major:0 minor:203 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/e5ac6e6d-4ea4-4874-b2eb-285977a285f7/volumes/kubernetes.io~projected/kube-api-access-5tcf2:{mountpoint:/var/lib/kubelet/pods/e5ac6e6d-4ea4-4874-b2eb-285977a285f7/volumes/kubernetes.io~projected/kube-api-access-5tcf2 major:0 minor:221 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/ee37dd25-4ac1-474f-80b8-d04da8da560c/volumes/kubernetes.io~projected/kube-api-access-j6vtn:{mountpoint:/var/lib/kubelet/pods/ee37dd25-4ac1-474f-80b8-d04da8da560c/volumes/kubernetes.io~projected/kube-api-access-j6vtn major:0 minor:218 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/ee37dd25-4ac1-474f-80b8-d04da8da560c/volumes/kubernetes.io~secret/serving-cert:{mountpoint:/var/lib/kubelet/pods/ee37dd25-4ac1-474f-80b8-d04da8da560c/volumes/kubernetes.io~secret/serving-cert major:0 minor:202 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/ef128f2b-0a66-4c2d-a969-6197e0f82c58/volumes/kubernetes.io~secret/agent-certs:{mountpoint:/var/lib/kubelet/pods/ef128f2b-0a66-4c2d-a969-6197e0f82c58/volumes/kubernetes.io~secret/agent-certs major:0 minor:49 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/f1a05736-0bc6-4914-981e-5524121561e4/volumes/kubernetes.io~projected/kube-api-access-lc26k:{mountpoint:/var/lib/kubelet/pods/f1a05736-0bc6-4914-981e-5524121561e4/volumes/kubernetes.io~projected/kube-api-access-lc26k major:0 minor:212 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/f31c8037-8b3e-4e1b-a363-fdca6686beb5/volumes/kubernetes.io~projected/kube-api-access-ldfgb:{mountpoint:/var/lib/kubelet/pods/f31c8037-8b3e-4e1b-a363-fdca6686beb5/volumes/kubernetes.io~projected/kube-api-access-ldfgb major:0 minor:356 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/f31c8037-8b3e-4e1b-a363-fdca6686beb5/volumes/kubernetes.io~secret/signing-key:{mountpoint:/var/lib/kubelet/pods/f31c8037-8b3e-4e1b-a363-fdca6686beb5/volumes/kubernetes.io~secret/signing-key major:0 minor:351 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/f7ba0792-faca-42fd-8d0d-3499c5b7278f/volumes/kubernetes.io~projected/kube-api-access-h8vbt:{mountpoint:/var/lib/kubelet/pods/f7ba0792-faca-42fd-8d0d-3499c5b7278f/volumes/kubernetes.io~projected/kube-api-access-h8vbt major:0 minor:335 fsType:tmpfs blockSize:0} composefs_0-34:{mountpoint:/ major:0 minor:34 fsType:overlay blockSize:0} overlay_0-100:{mountpoint:/var/lib/containers/storage/overlay/7b39e10eec721428af708919b00f50b9791462a84efdeabcdc141fbe762bb082/merged major:0 minor:100 fsType:overlay blockSize:0} overlay_0-102:{mountpoint:/var/lib/containers/storage/overlay/13c15305b50a7f6b192597ff7e25b62780afc71975ec2f58ae1afdcf9051e319/merged major:0 minor:102 fsType:overlay blockSize:0} overlay_0-105:{mountpoint:/var/lib/containers/storage/overlay/d7d073d33586119af68c6403de2f5655b5603556db2711384bd7fd34abb4b0d2/merged major:0 minor:105 fsType:overlay blockSize:0} overlay_0-106:{mountpoint:/var/lib/containers/storage/overlay/76a52929dd0aec5efcba021e6d6b5592703e6c8d47b07063be0ee29c66dd976c/merged major:0 minor:106 fsType:overlay blockSize:0} overlay_0-114:{mountpoint:/var/lib/containers/storage/overlay/d0dd513e6e83484859a76b4481fde23767c384163b7295708bdf8047d84cbe39/merged major:0 minor:114 fsType:overlay blockSize:0} overlay_0-119:{mountpoint:/var/lib/containers/storage/overlay/e4946fa79264c2ed8ae0aa6524f9e021be2761cd3d5f5ed95283d82911891192/merged major:0 minor:119 fsType:overlay blockSize:0} overlay_0-124:{mountpoint:/var/lib/containers/storage/overlay/6f24011923afea6511b0f48194c66a0d86c3439d38afb9640bcf90920e51f9f5/merged major:0 minor:124 fsType:overlay blockSize:0} overlay_0-127:{mountpoint:/var/lib/containers/storage/overlay/d057b3731fa190321fb3eca0e7c6be735ccb15144df1d3a0fb574d60e22567bf/merged major:0 minor:127 fsType:overlay blockSize:0} overlay_0-132:{mountpoint:/var/lib/containers/storage/overlay/810d56e601b25e4a3a324b7d17dea334792470edcd4f386e7fd1b04ee276fe73/merged major:0 minor:132 fsType:overlay blockSize:0} overlay_0-134:{mountpoint:/var/lib/containers/storage/overlay/4b8e25ec1251e5ea2a40cf1455eb6f3e20523568df487a5940591edde1c498b6/merged major:0 minor:134 fsType:overlay blockSize:0} overlay_0-139:{mountpoint:/var/lib/containers/storage/overlay/9c0e728bed567b55f85649089bcd4c24266f4f9ed93cdae59fc6ac39883788c4/merged major:0 minor:139 fsType:overlay blockSize:0} overlay_0-144:{mountpoint:/var/lib/containers/storage/overlay/e6e397d98be089648ddbdba17979aeb7d3dd397a101c7ec00e3c1eb9c6b1f1a0/merged major:0 minor:144 fsType:overlay blockSize:0} overlay_0-152:{mountpoint:/var/lib/containers/storage/overlay/a6598b8e4d4c8bb5660bafa9154ab789d127b3e96525796cd25f75c8f3a417fe/merged major:0 minor:152 fsType:overlay blockSize:0} overlay_0-157:{mountpoint:/var/lib/containers/storage/overlay/d02e59fb9d09ce0bb8df05b1a1034132dff5b6410e56f981ae6d7b83d63bdf28/merged major:0 minor:157 fsType:overlay blockSize:0} overlay_0-162:{mountpoint:/var/lib/containers/storage/overlay/2b937d581feb3565473cfa4b59b3c1992e5f14878f689c5db4acaa0e0f8c4620/merged major:0 minor:162 fsType:overlay blockSize:0} overlay_0-167:{mountpoint:/var/lib/containers/storage/overlay/108ed1e5f945075b29aab26636e460e2a49011662a421381e6684a18c072a178/merged major:0 minor:167 fsType:overlay blockSize:0} overlay_0-172:{mountpoint:/var/lib/containers/storage/overlay/319e38a780ffe3035137462777a1b636bfde844d8d0c453b6cac6ea1f4407766/merged major:0 minor:172 fsType:overlay blockSize:0} overlay_0-177:{mountpoint:/var/lib/containers/storage/overlay/8ba21d8de7fa620dfb2f1866911ddf60892d6965bf441c69c737a1b2d2fe2acf/merged major:0 minor:177 fsType:overlay blockSize:0} overlay_0-182:{mountpoint:/var/lib/containers/storage/overlay/3ddc0ecff21fa6ac3a63342a4a60320b4534048cf40253e4b0b2c2991f845ca0/merged major:0 minor:182 fsType:overlay blockSize:0} overlay_0-187:{mountpoint:/var/lib/containers/storage/overlay/f551088f8f39f9cd303e3f218c04906054e57cf122f3ddea6aed64f81e3d3fde/merged major:0 minor:187 fsType:overlay blockSize:0} overlay_0-189:{mountpoint:/var/lib/containers/storage/overlay/050b1161a19650447ef8e05b21853df14abcbd5f0450f8e1d6df05c197904114/merged major:0 minor:189 fsType:overlay blockSize:0} overlay_0-204:{mountpoint:/var/lib/containers/storage/overlay/a89ba761a4966dcd9b5882e55dfdfe7f3ad31bdc80d1ff0215db7328fff6308e/merged major:0 minor:204 fsType:overlay blockSize:0} overlay_0-219:{mountpoint:/var/lib/containers/storage/overlay/4cb39a2779e9bb134bb403653a975e0f251ebd729b718b027a06b3b0e8772331/merged major:0 minor:219 fsType:overlay blockSize:0} overlay_0-246:{mountpoint:/var/lib/containers/storage/overlay/fdc17de049f3c9135c22d271c5c6140fe17e79d34caa3e9e6ad6af21d1d58a79/merged major:0 minor:246 fsType:overlay blockSize:0} overlay_0-248:{mountpoint:/var/lib/containers/storage/overlay/497af6a8793932fbfb0fe01fbaadb766fe9100f3fddd2af3e76bd07db57dbdbb/merged major:0 minor:248 fsType:overlay blockSize:0} overlay_0-250:{mountpoint:/var/lib/containers/storage/overlay/b448b4150bf6205886dea447a97202a43ed043b93b25174053ac3c26b64b3e71/merged major:0 minor:250 fsType:overlay blockSize:0} overlay_0-252:{mountpoint:/var/lib/containers/storage/overlay/2434d685c72d2ee5642cec29e742bf058d3fc6460547e94da1470ab880cf52f8/merged major:0 minor:252 fsType:overlay blockSize:0} overlay_0-256:{mountpoint:/var/lib/containers/storage/overlay/68d5653c9403005619445132205974623fa3c6c610e367342457cb52d239ffe5/merged major:0 minor:256 fsType:overlay blockSize:0} overlay_0-258:{mountpoint:/var/lib/containers/storage/overlay/52679dfc4b803a25b5f4da495e12209c845e8253c70b86eb0040b640f2cce0c0/merged major:0 minor:258 fsType:overlay blockSize:0} overlay_0-260:{mountpoint:/var/lib/containers/storage/overlay/9f404e0c8a3e8ad48453fef5cf9a3c6973f5add67ff4fc2d24527e25077bedd3/merged major:0 minor:260 fsType:overlay blockSize:0} overlay_0-262:{mountpoint:/var/lib/containers/storage/overlay/dc86b73c1458f18445eb910fb5446604aa4236484fed6403ef27bc6b9f428214/merged major:0 minor:262 fsType:overlay blockSize:0} overlay_0-264:{mountpoint:/var/lib/containers/storage/overlay/4a2814192baf42a2272982032c468291de1abe4d993284f326c76bd9ae77fa9e/merged major:0 minor:264 fsType:overlay blockSize:0} overlay_0-266:{mountpoint:/var/lib/containers/storage/overlay/45689973e6c84d7baec60a010bfff8f4fa3c04722ebbeed6d103deb4e56ff972/merged major:0 minor:266 fsType:overlay blockSize:0} overlay_0-268:{mountpoint:/var/lib/containers/storage/overlay/a97f14b7a9180929361ef3baa90b9d59a622798d2f06da7598d317bcdd9f4a21/merged major:0 minor:268 fsType:overlay blockSize:0} overlay_0-269:{mountpoint:/var/lib/containers/storage/overlay/b3fe6d5e09a838c7c6a548dc141a0d38eb38b5d086934123eaed306e14654a79/merged major:0 minor:269 fsType:overlay blockSize:0} overlay_0-271:{mountpoint:/var/lib/containers/storage/overlay/3984aea71731b1e404050c64cd8e56e7b7b12fd1a0ffedb4f693705c8191b736/merged major:0 minor:271 fsType:overlay blockSize:0} overlay_0-289:{mountpoint:/var/lib/containers/storage/overlay/fa5d405c14f1b69473f43d0447ddd8a253922eb0d8e37238971637fa00a9356a/merged major:0 minor:289 fsType:overlay blockSize:0} overlay_0-291:{mountpoint:/var/lib/containers/storage/overlay/3d8f06001f11ba6ebdf925f93e1aabb4fb2488d3dd6737d7df8871f29b245139/merged major:0 minor:291 fsType:overlay blockSize:0} overlay_0-293:{mountpoint:/var/lib/containers/storage/overlay/002aedac02d2ac3a5cf4d0404348d3d931162ecc7b5493835a8142afe5531940/merged major:0 minor:293 fsType:overlay blockSize:0} overlay_0-299:{mountpoint:/var/lib/containers/storage/overlay/6e0c3dfb31ff05b9f049764eb76de6a9f094517db99bb926e6189064ba4019a2/merged major:0 minor:299 fsType:overlay blockSize:0} overlay_0-301:{mountpoint:/var/lib/containers/storage/overlay/33118cc6b02d000b04fcbc53504204efeb51aaede246f99b2cedc548861189b0/merged major:0 minor:301 fsType:overlay blockSize:0} overlay_0-311:{mountpoint:/var/lib/containers/storage/overlay/8d0935fcdb8131f85f6a0070bf532fc59775489820be031c474705a5731ed43a/merged major:0 minor:311 fsType:overlay blockSize:0} overlay_0-317:{mountpoint:/var/lib/containers/storage/overlay/a276575f43b876dcef17338a49372fb7b6b5c19d78476a4bc1b95e5f216e2ac9/merged major:0 minor:317 fsType:overlay blockSize:0} overlay_0-323:{mountpoint:/var/lib/containers/storage/overlay/f7746b1baca1eaf97d50504ec98e96a26c42df7f9f3afe626b5e7e56dffbc1f9/merged major:0 minor:323 fsType:overlay blockSize:0} overlay_0-341:{mountpoint:/var/lib/containers/storage/overlay/b863cc2c73ff27557bc63011806bb0f91eb9fa177989b420a77dffe39be1fb71/merged major:0 minor:341 fsType:overlay blockSize:0} overlay_0-343:{mountpoint:/var/lib/containers/storage/overlay/880a03bc7c3529100bcd273a6662312684d13cf2b6df60099e76a1d4d9141035/merged major:0 minor:343 fsType:overlay blockSize:0} overlay_0-347:{mountpoint:/var/lib/containers/storage/overlay/c1921c20bcc51893583a0b397f96d3bdbd841207f7286c81df37f97ae422e0f5/merged major:0 minor:347 fsType:overlay blockSize:0} overlay_0-349:{mountpoint:/var/lib/containers/storage/overlay/dc501313f6d34bec2ef8b0b39ef593c70315073ea73ab47b1780c42b6dd600b6/merged major:0 minor:349 fsType:overlay blockSize:0} overlay_0-359:{mountpoint:/var/lib/containers/storage/overlay/3b217e12206ce7ddf3ecd24754973b672bda90fee63d52209cc7dfb6318d7c65/merged major:0 minor:359 fsType:overlay blockSize:0} overlay_0-361:{mountpoint:/var/lib/containers/storage/overlay/95f57637c1e59806fcdf7ded5c4a0891c2544bd47e73d96b35c9f2aa770f0478/merged major:0 minor:361 fsType:overlay blockSize:0} overlay_0-363:{mountpoint:/var/lib/containers/storage/overlay/274f63acdb336e8b6201ed98a1c0c628f3f67bce03cdb4cde9982462a16df746/merged major:0 minor:363 fsType:overlay blockSize:0} overlay_0-368:{mountpoint:/var/lib/containers/storage/overlay/50eb759ba7aed746db5a8f5119f392d33909e5a23f1ef79eafc9ed8c9e778d59/merged major:0 minor:368 fsType:overlay blockSize:0} overlay_0-382:{mountpoint:/var/lib/containers/storage/overlay/c9791fd26983576c011c4fca539c7a07f6f4f6e6649df52a7e5a1599cf4a6ccf/merged major:0 minor:382 fsType:overlay blockSize:0} overlay_0-384:{mountpoint:/var/lib/containers/storage/overlay/80f56f8b9f63517c7d4f529d6cec214c5fc0fe978f53e12b2a0d534aa46d1f4c/merged major:0 minor:384 fsType:overlay blockSize:0} overlay_0-393:{mountpoint:/var/lib/containers/storage/overlay/6ae1f8572a3ddbf936786e072c45009d6725d014279eb69e44e36f5769ae935b/merged major:0 minor:393 fsType:overlay blockSize:0} overlay_0-395:{mountpoint:/var/lib/containers/storage/overlay/4bf4ede6197fc8b2db3a494e0103c790d41da3310e6fccd7985a453ec049c1da/merged major:0 minor:395 fsType:overlay blockSize:0} overlay_0-397:{mountpoint:/var/lib/containers/storage/overlay/46ee190cd0c56cbf372ed9a6bd8137989f194f77131036c3e827c494f8dd6d76/merged major:0 minor:397 fsType:overlay blockSize:0} overlay_0-403:{mountpoint:/var/lib/containers/storage/overlay/077ff889821a7af52baa8ce41caa08ce7342cf0d38628f6e3489b3b713d6d39c/merged major:0 minor:403 fsType:overlay blockSize:0} overlay_0-421:{mountpoint:/var/lib/containers/storage/overlay/52d033dcca822e3db36fd1b052b394742cdfad48b0963f49ff7b4b074afe627d/merged major:0 minor:421 fsType:overlay blockSize:0} overlay_0-423:{mountpoint:/var/lib/containers/storage/overlay/edc22f22abb07fbc1274720bc71eb87240428109c1b254d5876bdf6af22a705b/merged major:0 minor:423 fsType:overlay blockSize:0} overlay_0-448:{mountpoint:/var/lib/containers/storage/overlay/c2b515510316f3d98f680db071a4cbf88803be23eb77296c9feb3cb42c76a829/merged major:0 minor:448 fsType:overlay blockSize:0} overlay_0-450:{mountpoint:/var/lib/containers/storage/overlay/34b790f3c027dc67aeec5ac80a10e9d8ae7e9aef8e7583ed6c8030378df7a8ad/merged major:0 minor:450 fsType:overlay blockSize:0} overlay_0-452:{mountpoint:/var/lib/containers/storage/overlay/adf7b132c2860ac02b4e4bb1c971979fe99a6d7da0d7a7d67ce91af0ee484f1b/merged major:0 minor:452 fsType:overlay blockSize:0} overlay_0-457:{mountpoint:/var/lib/containers/storage/overlay/1ac5d7643f4630e0e99bf4a64cfb091d4aef9e0e0d014a12e45cfa862c849b2a/merged major:0 minor:457 fsType:overlay blockSize:0} overlay_0-459:{mountpoint:/var/lib/containers/storage/overlay/36e28bf99fdc0b9021b087ea71af3c808082b03a868703520dea71a3b15e48b9/merged major:0 minor:459 fsType:overlay blockSize:0} overlay_0-461:{mountpoint:/var/lib/containers/storage/overlay/f4f81d03bf34fa2c32133bb1c4557d5580f074938883532340a40549b1563c08/merged major:0 minor:461 fsType:overlay blockSize:0} overlay_0-463:{mountpoint:/var/lib/containers/storage/overlay/42b332a2fcbdc2d60a008ca0a40f337bd22861cf88e2bd5fcee93b6de4aa557f/merged major:0 minor:463 fsType:overlay blockSize:0} overlay_0-480:{mountpoint:/var/lib/containers/storage/overlay/1d60e873cf43a7de580b7fd53eff25acc290b198edf8b5fbe6eb3a8a50c48f4b/merged major:0 minor:480 fsType:overlay blockSize:0} overlay_0-482:{mountpoint:/var/lib/containers/storage/overlay/6d766af55d1f6b5fc37898e1ca55ecb421f7bca59c2d9712d63e7095e7c56c27/merged major:0 minor:482 fsType:overlay blockSize:0} overlay_0-484:{mountpoint:/var/lib/containers/storage/overlay/3b4d32cd2008240b767a64bdd71dd685d677be691a2e55f10bafb56275fd86e4/merged major:0 minor:484 fsType:overlay blockSize:0} overlay_0-486:{mountpoint:/var/lib/containers/storage/overlay/d47a9fae95fbcf57976331512b6cc3bdd7d686bd874c31dd5e6b8fbf9ad5a70c/merged major:0 minor:486 fsType:overlay blockSize:0} overlay_0-492:{mountpoint:/var/lib/containers/storage/overlay/3db01ac204ea9249116ae98df1e1ee6adda8cf137f8b7b7b2186eb3634a79651/merged major:0 minor:492 fsType:overlay blockSize:0} overlay_0-494:{mountpoint:/var/lib/containers/storage/overlay/6569c76f463ea27043c3573a4185492ddc240615e882dac6a674c3fb5fb9cf6e/merged major:0 minor:494 fsType:overlay blockSize:0} overlay_0-503:{mountpoint:/var/lib/containers/storage/overlay/32e51be3557355f527411f17807bd7833fbedeb3f856b04910d336eff96acfd0/merged major:0 minor:503 fsType:overlay blockSize:0} overlay_0-505:{mountpoint:/var/lib/containers/storage/overlay/421b8e73e6afee197516804ef6752dfc20833ebbdca1a2bf62ad5eae0d136938/merged major:0 minor:505 fsType:overlay blockSize:0} overlay_0-513:{mountpoint:/var/lib/containers/storage/overlay/07be4c3b21a134b93cb0a6a25d2db1d5f6569e5ac68b83fa5ad69a061050e791/merged major:0 minor:513 fsType:overlay blockSize:0} overlay_0-519:{mountpoint:/var/lib/containers/storage/overlay/276c57963ec4121cd52e1f4fd0dd95e9fa1572d6fdba4da49252fbb6aef72dff/merged major:0 minor:519 fsType:overlay blockSize:0} overlay_0-64:{mountpoint:/var/lib/containers/storage/overlay/d09fd160082943fdac31914c16498ccfc1e81189f6a9c72f1a01fbe7a83e2106/merged major:0 minor:64 fsType:overlay blockSize:0} overlay_0-66:{mountpoint:/var/lib/containers/storage/overlay/7c4c9f46ffb30ac58c61f94876ed0d1b63e46855e5aa7c9610aa3a018fc29eb3/merged major:0 minor:66 fsType:overlay blockSize:0} overlay_0-70:{mountpoint:/var/lib/containers/storage/overlay/84b35f024062e9cd70e3dcb552d0beefcfdc0d8cc3cc7bd396fdbd8ebcf1c16f/merged major:0 minor:70 fsType:overlay blockSize:0} overlay_0-74:{mountpoint:/var/lib/containers/storage/overlay/bc9330b50d9aaf667c8ad2bcae344cd19d056ff6f228ff8b7fa062de1a59fd99/merged major:0 minor:74 fsType:overlay blockSize:0} overlay_0-78:{mountpoint:/var/lib/containers/storage/overlay/eb339154b6e0d299b058f15322653b108b0d9d097cf954b84280304622911841/merged major:0 minor:78 fsType:overlay blockSize:0} overlay_0-82:{mountpoint:/var/lib/containers/storage/overlay/f0c973a327b7eb87a9c7fd20b6d40c8747ff010119ea318212b75b645a4d8705/merged major:0 minor:82 fsType:overlay blockSize:0} overlay_0-86:{mountpoint:/var/lib/containers/storage/overlay/1dc5c5cb0e6b2239c52ab26d64f79ee03f7f9fd0d0c15e8fed408b35d644dafe/merged major:0 minor:86 fsType:overlay blockSize:0} overlay_0-88:{mountpoint:/var/lib/containers/storage/overlay/26b03388ff690b6482113a8a5da91e8d58b8a77f2316555408c0ebb1433319f2/merged major:0 minor:88 fsType:overlay blockSize:0} overlay_0-92:{mountpoint:/var/lib/containers/storage/overlay/a9e9c98e41771d509b229b17db34271481c0ba23325aeaa36c711e7f5d7ee9b1/merged major:0 minor:92 fsType:overlay blockSize:0} overlay_0-96:{mountpoint:/var/lib/containers/storage/overlay/7fa1e50d460e2e091c67c50310f888c3eed63415525e3d04cf086e882bfa6f5a/merged major:0 minor:96 fsType:overlay blockSize:0}]
Oct 30 20:38:14.152977 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:14.152480    6004 manager.go:217] Machine: {Timestamp:2026-10-30 20:38:14.152005771 +0000 UTC m=+0.071791879 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3076924 MemoryCapacity:33164341248 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec249774129e9f58503a43148f81e109 SystemUUID:ec249774-129e-9f58-503a-43148f81e109 BootID:6a45faa9-a6bf-45fc-9942-079f160db608 Filesystems:[{Device:overlay_0-268 DeviceMajor:0 DeviceMinor:268 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/f7ba0792-faca-42fd-8d0d-3499c5b7278f/volumes/kubernetes.io~projected/kube-api-access-h8vbt DeviceMajor:0 DeviceMinor:335 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/519501c9-00d9-416f-887a-13b83aad5762/volumes/kubernetes.io~projected/kube-api-access-f2b6b DeviceMajor:0 DeviceMinor:340 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-450 DeviceMajor:0 DeviceMinor:450 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-486 DeviceMajor:0 DeviceMinor:486 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/0b7ae038-91bf-40f1-9930-8a6158706a3e/volumes/kubernetes.io~secret/ovn-node-metrics-cert DeviceMajor:0 DeviceMinor:47 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/ac7adab4-061f-4371-bc6c-96260eb988d8/volumes/kubernetes.io~projected/kube-api-access-mwd9g DeviceMajor:0 DeviceMinor:54 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/06e97711d4698ea1dbb35a81db7b4d144d621213c150dfe71a0e56eec41e586d/userdata/shm DeviceMajor:0 DeviceMinor:329 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/0f4fb48440afc04a4fe603b9f13e0c085994cfabf5d14e9f77b79bbdf9f45088/userdata/shm DeviceMajor:0 DeviceMinor:391 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/2aee32c9-f358-4ff4-9d50-c18dba9885a5/volumes/kubernetes.io~projected/registry-tls DeviceMajor:0 DeviceMinor:414 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/aaadd8de-58cb-45af-a477-384fbf1cf317/volumes/kubernetes.io~secret/metrics-tls DeviceMajor:0 DeviceMinor:434 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/16f3dda5ceedd4b983a9583d227589b440f5d269e991c5a282ba12bbfe0e5826/userdata/shm DeviceMajor:0 DeviceMinor:440 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-461 DeviceMajor:0 DeviceMinor:461 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:32 Capacity:16582172672 Type:vfs Inodes:1048576 HasInodes:true} {Device:overlay_0-182 DeviceMajor:0 DeviceMinor:182 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/09410978095d72951cc272dae5be2979d26a77b38714d8e43fbcbffb974196a1/userdata/shm DeviceMajor:0 DeviceMinor:242 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-382 DeviceMajor:0 DeviceMinor:382 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/2aee32c9-f358-4ff4-9d50-c18dba9885a5/volumes/kubernetes.io~projected/bound-sa-token DeviceMajor:0 DeviceMinor:418 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-74 DeviceMajor:0 DeviceMinor:74 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/b3bff4d5-f9a8-4302-b63d-136ed3c6be35/volumes/kubernetes.io~secret/installation-pull-secrets DeviceMajor:0 DeviceMinor:45 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/cd59fef4-66a5-471b-a8ef-18df25e44d5c/volumes/kubernetes.io~secret/stats-auth DeviceMajor:0 DeviceMinor:197 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/4dde41e2-34fe-429b-bf23-35bdb99d894e/volumes/kubernetes.io~secret/serving-cert DeviceMajor:0 DeviceMinor:207 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/ee37dd25-4ac1-474f-80b8-d04da8da560c/volumes/kubernetes.io~projected/kube-api-access-j6vtn DeviceMajor:0 DeviceMinor:218 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-492 DeviceMajor:0 DeviceMinor:492 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-494 DeviceMajor:0 DeviceMinor:494 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/0f424633-11a5-49fa-a933-f9c6ec7ca97e/volumes/kubernetes.io~projected/kube-api-access-lq6t2 DeviceMajor:0 DeviceMinor:56 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-106 DeviceMajor:0 DeviceMinor:106 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-177 DeviceMajor:0 DeviceMinor:177 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-187 DeviceMajor:0 DeviceMinor:187 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/d1fd1b0a-3831-4cb8-b6f3-ad2e67685188/volumes/kubernetes.io~projected/kube-api-access-cjbpj DeviceMajor:0 DeviceMinor:225 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/f31c8037-8b3e-4e1b-a363-fdca6686beb5/volumes/kubernetes.io~secret/signing-key DeviceMajor:0 DeviceMinor:351 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-397 DeviceMajor:0 DeviceMinor:397 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-448 DeviceMajor:0 DeviceMinor:448 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/e33ef368-1f7c-4455-beb9-a2b2c5106792/volumes/kubernetes.io~secret/serving-cert DeviceMajor:0 DeviceMinor:203 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/b3bff4d5-f9a8-4302-b63d-136ed3c6be35/volumes/kubernetes.io~projected/bound-sa-token DeviceMajor:0 DeviceMinor:223 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-271 DeviceMajor:0 DeviceMinor:271 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-363 DeviceMajor:0 DeviceMinor:363 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/adfab031b80b88534a4d34be8417010a57059812a625478a6a3b3fba56218cc3/userdata/shm DeviceMajor:0 DeviceMinor:415 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/f1a05736-0bc6-4914-981e-5524121561e4/volumes/kubernetes.io~projected/kube-api-access-lc26k DeviceMajor:0 DeviceMinor:212 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-293 DeviceMajor:0 DeviceMinor:293 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-359 DeviceMajor:0 DeviceMinor:359 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/7185e7d5c843ee0755d3c3eccc2f874e7a470f56052336f380f365847d632f37/userdata/shm DeviceMajor:0 DeviceMinor:443 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/db64c15b-58b0-4829-b702-de7b6c846ab4/volumes/kubernetes.io~projected/kube-api-access-nnz7p DeviceMajor:0 DeviceMinor:215 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-264 DeviceMajor:0 DeviceMinor:264 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-266 DeviceMajor:0 DeviceMinor:266 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/3ea28277b909832ad3750923ecd980712d3cabca4e362ad1334a773117bac35e/userdata/shm DeviceMajor:0 DeviceMinor:337 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/3d466244841d35a3c5c8bed0792fbdfc479f701a0b134bd3e9a8c1f1ad7cd7fb/userdata/shm DeviceMajor:0 DeviceMinor:380 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-132 DeviceMajor:0 DeviceMinor:132 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/780e67fb-196e-485a-8aa4-e11cecdc4b63/volumes/kubernetes.io~projected/kube-api-access-49sfp DeviceMajor:0 DeviceMinor:58 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-463 DeviceMajor:0 DeviceMinor:463 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/1dc89e41-1e32-476f-b5fc-e45945a45efd/volumes/kubernetes.io~empty-dir/tmp DeviceMajor:0 DeviceMinor:48 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/722d8048419608895a084525c22623910879d39fcee62a3b68e720e5acefbcc5/userdata/shm DeviceMajor:0 DeviceMinor:84 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/b0b15f491b8385bf9ee746cbd3985f832579b42a340c1dc6e3443af6f61f25e5/userdata/shm DeviceMajor:0 DeviceMinor:230 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-311 DeviceMajor:0 DeviceMinor:311 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-519 DeviceMajor:0 DeviceMinor:519 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-127 DeviceMajor:0 DeviceMinor:127 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/6c147cd2e985b08382d5544ea140b781216100fb882810c0ace9cb47679cdccd/userdata/shm DeviceMajor:0 DeviceMinor:80 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-291 DeviceMajor:0 DeviceMinor:291 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-323 DeviceMajor:0 DeviceMinor:323 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/2aee32c9-f358-4ff4-9d50-c18dba9885a5/volumes/kubernetes.io~projected/kube-api-access-bkhhh DeviceMajor:0 DeviceMinor:417 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-484 DeviceMajor:0 DeviceMinor:484 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-505 DeviceMajor:0 DeviceMinor:505 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/19a86db780d09c50b7bb6f7d99b809986121c52c5fbdbca19debbd58212fb6e4/userdata/shm DeviceMajor:0 DeviceMinor:98 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-157 DeviceMajor:0 DeviceMinor:157 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-167 DeviceMajor:0 DeviceMinor:167 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/e5ac6e6d-4ea4-4874-b2eb-285977a285f7/volumes/kubernetes.io~projected/kube-api-access-5tcf2 DeviceMajor:0 DeviceMinor:221 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-262 DeviceMajor:0 DeviceMinor:262 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-384 DeviceMajor:0 DeviceMinor:384 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/785ea1d56bc26d9acb8aece1b9d4d4abb385a1dc10cd092e84179201a1c55bdf/userdata/shm DeviceMajor:0 DeviceMinor:476 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-480 DeviceMajor:0 DeviceMinor:480 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/ee37dd25-4ac1-474f-80b8-d04da8da560c/volumes/kubernetes.io~secret/serving-cert DeviceMajor:0 DeviceMinor:202 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/aaadd8de-58cb-45af-a477-384fbf1cf317/volumes/kubernetes.io~projected/kube-api-access-hzklm DeviceMajor:0 DeviceMinor:213 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-421 DeviceMajor:0 DeviceMinor:421 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-452 DeviceMajor:0 DeviceMinor:452 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/4098327b09c725e4b0c5dd15ca8b971b63d1118afac841b02f631d8b8eb7e440/userdata/shm DeviceMajor:0 DeviceMinor:90 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/215a0f06b1ba627125a24388fe9d4c7883735f82bd784a859c0c6a9ae57b9599/userdata/shm DeviceMajor:0 DeviceMinor:94 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-139 DeviceMajor:0 DeviceMinor:139 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/537a9c41-5ed1-4ff5-bf9a-9d0bcb853f80/volumes/kubernetes.io~projected/kube-api-access-9hnz8 DeviceMajor:0 DeviceMinor:217 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-299 DeviceMajor:0 DeviceMinor:299 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/0df457c5-5640-4c0d-9f71-94548c11397a/volumes/kubernetes.io~projected/kube-api-access-htjnm DeviceMajor:0 DeviceMinor:339 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/d1fd1b0a-3831-4cb8-b6f3-ad2e67685188/volumes/kubernetes.io~secret/cluster-monitoring-operator-tls DeviceMajor:0 DeviceMinor:375 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/708a2c3c-e061-4bb1-b9ff-48f111b08943/volumes/kubernetes.io~secret/tls-certificates DeviceMajor:0 DeviceMinor:408 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/1dc89e41-1e32-476f-b5fc-e45945a45efd/volumes/kubernetes.io~empty-dir/etc-tuned DeviceMajor:0 DeviceMinor:50 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/2aee32c9-f358-4ff4-9d50-c18dba9885a5/volumes/kubernetes.io~secret/installation-pull-secrets DeviceMajor:0 DeviceMinor:412 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/71ed00c42bdcd0ee5d18398ebbbb1db1cc2293c018ef1b4d1a1a7b5417893be9/userdata/shm DeviceMajor:0 DeviceMinor:438 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-459 DeviceMajor:0 DeviceMinor:459 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/0f424633-11a5-49fa-a933-f9c6ec7ca97e/volumes/kubernetes.io~secret/metrics-certs DeviceMajor:0 DeviceMinor:469 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/66145fbcb03e7b18dcbe92eb181e4fb803aaee858de607365c278692a620f912/userdata/shm DeviceMajor:0 DeviceMinor:61 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/fcb69e9039ff6b8835f54db87a5c29114b148ed76f6ce48a9933d8bba63a3b4d/userdata/shm DeviceMajor:0 DeviceMinor:237 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-343 DeviceMajor:0 DeviceMinor:343 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/2aee32c9-f358-4ff4-9d50-c18dba9885a5/volumes/kubernetes.io~secret/image-registry-private-configuration DeviceMajor:0 DeviceMinor:413 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-423 DeviceMajor:0 DeviceMinor:423 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-513 DeviceMajor:0 DeviceMinor:513 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/16e71e18-453a-41bf-a3f8-9618482c9a50/volumes/kubernetes.io~projected/kube-api-access-c2w8k DeviceMajor:0 DeviceMinor:53 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-64 DeviceMajor:0 DeviceMinor:64 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/0b7ae038-91bf-40f1-9930-8a6158706a3e/volume-subpaths/run-systemd/ovnkube-controller/6 DeviceMajor:0 DeviceMinor:26 Capacity:6632869888 Type:vfs Inodes:819200 HasInodes:true} {Device:/run/containers/storage/overlay-containers/ed2c4569b0ef02ef7486d1463e75049ee89c6ad4b14a41244e5f16c0dfda8853/userdata/shm DeviceMajor:0 DeviceMinor:442 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-503 DeviceMajor:0 DeviceMinor:503 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-66 DeviceMajor:0 DeviceMinor:66 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-96 DeviceMajor:0 DeviceMinor:96 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/6cd9770e-ea54-4c33-ac1e-5643f3d8839d/volumes/kubernetes.io~projected/kube-api-access-trh2f DeviceMajor:0 DeviceMinor:210 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-317 DeviceMajor:0 DeviceMinor:317 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-403 DeviceMajor:0 DeviceMinor:403 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-134 DeviceMajor:0 DeviceMinor:134 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/ef128f2b-0a66-4c2d-a969-6197e0f82c58/volumes/kubernetes.io~secret/agent-certs DeviceMajor:0 DeviceMinor:49 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/e33ef368-1f7c-4455-beb9-a2b2c5106792/volumes/kubernetes.io~projected/kube-api-access-4r7tw DeviceMajor:0 DeviceMinor:222 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/b3bff4d5-f9a8-4302-b63d-136ed3c6be35/volumes/kubernetes.io~projected/kube-api-access-75wkc DeviceMajor:0 DeviceMinor:224 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/6c96cef7fbddfcbae2c787759d6f82c874b85287eb58630616057cdc4a1d30e8/userdata/shm DeviceMajor:0 DeviceMinor:228 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/bc0f209bfe0d8144bd3957cdb82896a69e098ce4b1ada0009dc90854b036073c/userdata/shm DeviceMajor:0 DeviceMinor:235 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/02a557dab75dfe0f6ed35c6634e8a3488f54d0eb99085daa7b5deb877d2e1ba7/userdata/shm DeviceMajor:0 DeviceMinor:243 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-256 DeviceMajor:0 DeviceMinor:256 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/7464cdd104d1f5884d27de3ec909a225235235639e60bfb30473f7d70141fa42/userdata/shm DeviceMajor:0 DeviceMinor:72 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-162 DeviceMajor:0 DeviceMinor:162 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-246 DeviceMajor:0 DeviceMinor:246 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-393 DeviceMajor:0 DeviceMinor:393 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-204 DeviceMajor:0 DeviceMinor:204 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-219 DeviceMajor:0 DeviceMinor:219 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/cd59fef4-66a5-471b-a8ef-18df25e44d5c/volumes/kubernetes.io~secret/metrics-certs DeviceMajor:0 DeviceMinor:437 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-124 DeviceMajor:0 DeviceMinor:124 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-144 DeviceMajor:0 DeviceMinor:144 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/cd59fef4-66a5-471b-a8ef-18df25e44d5c/volumes/kubernetes.io~projected/kube-api-access-rvdqt DeviceMajor:0 DeviceMinor:209 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/0d2cab1e4291094c1471865d16688f7a6546cdcf768d7493d1c4759fa3a3434d/userdata/shm DeviceMajor:0 DeviceMinor:357 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-482 DeviceMajor:0 DeviceMinor:482 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-82 DeviceMajor:0 DeviceMinor:82 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-260 DeviceMajor:0 DeviceMinor:260 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/f31c8037-8b3e-4e1b-a363-fdca6686beb5/volumes/kubernetes.io~projected/kube-api-access-ldfgb DeviceMajor:0 DeviceMinor:356 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/0df457c5-5640-4c0d-9f71-94548c11397a/volumes/kubernetes.io~secret/insights-runtime-extractor-tls DeviceMajor:0 DeviceMinor:386 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/a4cdc725-3dd0-4917-b8a0-c8ff77a40abb/volumes/kubernetes.io~secret/original-pull-secret DeviceMajor:0 DeviceMinor:475 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-86 DeviceMajor:0 DeviceMinor:86 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/793cb601-841f-4511-9b8f-ff30262611c2/volumes/kubernetes.io~projected/kube-api-access-72b4g DeviceMajor:0 DeviceMinor:211 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-289 DeviceMajor:0 DeviceMinor:289 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:overlay_0-100 DeviceMajor:0 DeviceMinor:100 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-252 DeviceMajor:0 DeviceMinor:252 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-269 DeviceMajor:0 DeviceMinor:269 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/6080982d-ff7c-47b2-8a0c-5a2fff21722b/volumes/kubernetes.io~projected/kube-api-access-7z886 DeviceMajor:0 DeviceMinor:334 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/6cd9770e-ea54-4c33-ac1e-5643f3d8839d/volumes/kubernetes.io~secret/samples-operator-tls DeviceMajor:0 DeviceMinor:436 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:composefs_0-34 DeviceMajor:0 DeviceMinor:34 Capacity:6422528 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/var/lib/kubelet/pods/0b7ae038-91bf-40f1-9930-8a6158706a3e/volumes/kubernetes.io~projected/kube-api-access-mh8k8 DeviceMajor:0 DeviceMinor:51 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/b2dae567-b378-41ed-9f7e-881153b7d03b/volumes/kubernetes.io~projected/kube-api-access-zkkqp DeviceMajor:0 DeviceMinor:52 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/2f9dd030-281c-473e-b441-9ee972019413/volumes/kubernetes.io~projected/kube-api-access-48plj DeviceMajor:0 DeviceMinor:55 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/4b0bf6d5013068d8bbb0e5ea418174eb6ed04e5fe648b32719858885afa323e1/userdata/shm DeviceMajor:0 DeviceMinor:60 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-189 DeviceMajor:0 DeviceMinor:189 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/f9d5194c08d6e2f26953231b76211dcdf3a77c719149ff159692ef748005380f/userdata/shm DeviceMajor:0 DeviceMinor:240 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/7ac2c7083eb6835289efd435b8ec60ae66457c6a19c6f3d8e64f8b02bc1190e6/userdata/shm DeviceMajor:0 DeviceMinor:345 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-102 DeviceMajor:0 DeviceMinor:102 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/cd59fef4-66a5-471b-a8ef-18df25e44d5c/volumes/kubernetes.io~secret/default-certificate DeviceMajor:0 DeviceMinor:205 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/4dde41e2-34fe-429b-bf23-35bdb99d894e/volumes/kubernetes.io~projected/kube-api-access-xp792 DeviceMajor:0 DeviceMinor:214 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/caca5f60-f777-4672-b570-faa422073cb9/volumes/kubernetes.io~projected/kube-api-access-mgww7 DeviceMajor:0 DeviceMinor:239 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/ceea8eb5df582eef6e1c92a2a0e04e96bf3dca304c816bb55b10064b00e659d4/userdata/shm DeviceMajor:0 DeviceMinor:419 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/b3bff4d5-f9a8-4302-b63d-136ed3c6be35/volumes/kubernetes.io~projected/registry-tls DeviceMajor:0 DeviceMinor:435 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/1c7cf13c5e7d97d83e2894e2fe03fec0e591c3fca850b253e4736ff5994873fd/userdata/shm DeviceMajor:0 DeviceMinor:446 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/3c4b7aa9d6b93e3bc695fb3bc709c056fa379953a683ee1028bab28928775a8b/userdata/shm DeviceMajor:0 DeviceMinor:478 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/50e37bd4-e46f-4577-b7b2-1ac7695637ea/volumes/kubernetes.io~projected/kube-api-access-7qzv8 DeviceMajor:0 DeviceMinor:278 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-152 DeviceMajor:0 DeviceMinor:152 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:24 Capacity:16582168576 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/1dc89e41-1e32-476f-b5fc-e45945a45efd/volumes/kubernetes.io~projected/kube-api-access-wc2mp DeviceMajor:0 DeviceMinor:59 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-70 DeviceMajor:0 DeviceMinor:70 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-78 DeviceMajor:0 DeviceMinor:78 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-88 DeviceMajor:0 DeviceMinor:88 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-347 DeviceMajor:0 DeviceMinor:347 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-92 DeviceMajor:0 DeviceMinor:92 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-172 DeviceMajor:0 DeviceMinor:172 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/90cd3de0-c573-41c2-bf3e-cf0e46a41d50/volumes/kubernetes.io~secret/serving-cert DeviceMajor:0 DeviceMinor:201 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:26 Capacity:6632869888 Type:vfs Inodes:819200 HasInodes:true} {Device:/run/containers/storage/overlay-containers/baeacfc304391a12cde769f20bf03da6002f7385c5a2080b0648c42526e4bc00/userdata/shm DeviceMajor:0 DeviceMinor:68 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-105 DeviceMajor:0 DeviceMinor:105 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-119 DeviceMajor:0 DeviceMinor:119 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/b3bff4d5-f9a8-4302-b63d-136ed3c6be35/volumes/kubernetes.io~secret/image-registry-private-configuration DeviceMajor:0 DeviceMinor:208 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-248 DeviceMajor:0 DeviceMinor:248 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/e606140f9254872cbc379fb7b09b46df44fb15fed7d1375637c8d2ae8239f421/userdata/shm DeviceMajor:0 DeviceMinor:287 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-250 DeviceMajor:0 DeviceMinor:250 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-258 DeviceMajor:0 DeviceMinor:258 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-349 DeviceMajor:0 DeviceMinor:349 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-361 DeviceMajor:0 DeviceMinor:361 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/caca5f60-f777-4672-b570-faa422073cb9/volumes/kubernetes.io~secret/cert DeviceMajor:0 DeviceMinor:232 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/1a172c2763bdb8dfac94e4dfe195534aca58c8414f72576402b6d15d9301741f/userdata/shm DeviceMajor:0 DeviceMinor:233 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-395 DeviceMajor:0 DeviceMinor:395 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/4179c36b-8003-46e5-82b0-67f6edea7553/volumes/kubernetes.io~projected/kube-api-access-79wpr DeviceMajor:0 DeviceMinor:57 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/3ee5674fefa80f861ac99efaff539b30317b132fd15d163a51175201cc743941/userdata/shm DeviceMajor:0 DeviceMinor:76 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/90cd3de0-c573-41c2-bf3e-cf0e46a41d50/volumes/kubernetes.io~projected/kube-api-access-tz88w DeviceMajor:0 DeviceMinor:216 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-301 DeviceMajor:0 DeviceMinor:301 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-341 DeviceMajor:0 DeviceMinor:341 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-368 DeviceMajor:0 DeviceMinor:368 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/73676585-4ea4-43cb-af99-b4716472fb15/volumes/kubernetes.io~secret/networking-console-plugin-cert DeviceMajor:0 DeviceMinor:429 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-457 DeviceMajor:0 DeviceMinor:457 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-114 DeviceMajor:0 DeviceMinor:114 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/27bf82e38841ca1e4c5e87738b53e9b60debb5bcc4d39e42c16e5fa32783cce3/userdata/shm DeviceMajor:0 DeviceMinor:226 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/4088da9d4706d1180c27fbdd893b9e7895365e1298191651e59b97cd0ae5dc29/userdata/shm DeviceMajor:0 DeviceMinor:254 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:02a557dab75dfe0 MacAddress:8a:d2:c6:a4:fa:aa Speed:10000 Mtu:8901} {Name:06e97711d4698ea MacAddress:52:62:64:7a:65:91 Speed:10000 Mtu:8901} {Name:09410978095d729 MacAddress:4e:27:de:08:01:87 Speed:10000 Mtu:8901} {Name:0d2cab1e4291094 MacAddress:d2:a9:47:49:aa:8a Speed:10000 Mtu:8901} {Name:0f4fb48440afc04 MacAddress:26:75:22:40:25:08 Speed:10000 Mtu:8901} {Name:16f3dda5ceedd4b MacAddress:ae:b9:4f:2b:0b:4a Speed:10000 Mtu:8901} {Name:1a172c2763bdb8d MacAddress:3a:dc:dc:76:27:06 Speed:10000 Mtu:8901} {Name:1c7cf13c5e7d97d MacAddress:fe:24:57:0d:a0:27 Speed:10000 Mtu:8901} {Name:27bf82e38841ca1 MacAddress:a2:9d:96:73:1a:ff Speed:10000 Mtu:8901} {Name:3c4b7aa9d6b93e3 MacAddress:c2:47:b6:33:2c:3e Speed:10000 Mtu:8901} {Name:3d466244841d35a MacAddress:06:f8:97:1b:22:f4 Speed:10000 Mtu:8901} {Name:3ea28277b909832 MacAddress:16:a1:1c:8f:15:62 Speed:10000 Mtu:8901} {Name:4088da9d4706d11 MacAddress:46:fa:81:e0:ce:10 Speed:10000 Mtu:8901} {Name:6c96cef7fbddfcb MacAddress:76:75:b9:57:e8:59 Speed:10000 Mtu:8901} {Name:7185e7d5c843ee0 MacAddress:da:a5:08:d2:29:ab Speed:10000 Mtu:8901} {Name:71ed00c42bdcd0e MacAddress:8e:4c:e4:43:c3:46 Speed:10000 Mtu:8901} {Name:785ea1d56bc26d9 MacAddress:be:ba:bf:fe:0e:6d Speed:10000 Mtu:8901} {Name:7ac2c7083eb6835 MacAddress:6e:5b:ab:ce:60:02 Speed:10000 Mtu:8901} {Name:adfab031b80b885 MacAddress:aa:14:57:de:7d:e3 Speed:10000 Mtu:8901} {Name:b0b15f491b8385b MacAddress:96:bb:61:cc:d2:3e Speed:10000 Mtu:8901} {Name:bc0f209bfe0d814 MacAddress:6a:c6:e8:15:1d:63 Speed:10000 Mtu:8901} {Name:br-ex MacAddress:02:3f:b8:00:75:6d Speed:0 Mtu:9001} {Name:br-int MacAddress:b6:49:86:65:2e:22 Speed:0 Mtu:8901} {Name:ceea8eb5df582ee MacAddress:22:6f:f2:42:ef:49 Speed:10000 Mtu:8901} {Name:e606140f9254872 MacAddress:86:54:c6:a5:cc:03 Speed:10000 Mtu:8901} {Name:ed2c4569b0ef02e MacAddress:4a:d5:e5:68:ca:75 Speed:10000 Mtu:8901} {Name:ens5 MacAddress:02:3f:b8:00:75:6d Speed:0 Mtu:9001} {Name:f9d5194c08d6e2f MacAddress:f6:16:b2:cb:d3:2f Speed:10000 Mtu:8901} {Name:fcb69e9039ff6b8 MacAddress:16:3b:92:58:2d:4d Speed:10000 Mtu:8901} {Name:genev_sys_6081 MacAddress:ee:be:10:3c:48:38 Speed:0 Mtu:65000} {Name:ovn-k8s-mp0 MacAddress:0a:58:0a:84:00:02 Speed:0 Mtu:8901} {Name:ovs-system MacAddress:b6:b6:f9:d9:b7:db Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164341248 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Oct 30 20:38:14.152977 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:14.152982    6004 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Oct 30 20:38:14.153330 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:14.153029    6004 manager.go:233] Version: {KernelVersion:5.14.0-687.60.1.el9_8.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.8.20261023-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Oct 30 20:38:14.153363 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:14.153344    6004 container_manager_linux.go:275] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Oct 30 20:38:14.153503 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:14.153368    6004 container_manager_linux.go:280] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-138-85.us-west-1.compute.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"/system.slice","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{},"system-reserved-compressible":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Oct 30 20:38:14.153544 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:14.153505    6004 topology_manager.go:143] "Creating topology manager with none policy"
Oct 30 20:38:14.153544 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:14.153513    6004 container_manager_linux.go:311] "Creating device plugin manager"
Oct 30 20:38:14.153544 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:14.153524    6004 manager.go:144] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Oct 30 20:38:14.153544 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:14.153538    6004 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Oct 30 20:38:14.153652 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:14.153557    6004 container_manager_linux.go:320] "Creating Dynamic Resource Allocation (DRA) manager"
Oct 30 20:38:14.153723 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:14.153714    6004 state_mem.go:41] "Initialized" logger="CPUManager state memory"
Oct 30 20:38:14.153823 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:14.153815    6004 server.go:1235] "Using root directory" path="/var/lib/kubelet"
Oct 30 20:38:14.153858 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:14.153850    6004 kubelet.go:493] "Attempting to sync node with API server"
Oct 30 20:38:14.153896 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:14.153862    6004 kubelet.go:394] "Adding static pod path" path="/etc/kubernetes/manifests"
Oct 30 20:38:14.153896 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:14.153876    6004 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Oct 30 20:38:14.153896 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:14.153888    6004 kubelet.go:405] "Adding apiserver pod source"
Oct 30 20:38:14.154011 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:14.153899    6004 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Oct 30 20:38:14.154712 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:14.154699    6004 state_checkpoint.go:81] "State checkpoint: restored pod resource state from checkpoint"
Oct 30 20:38:14.154712 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:14.154713    6004 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Oct 30 20:38:14.155241 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:14.155220    6004 kuberuntime_manager.go:304] "Container runtime initialized" containerRuntime="cri-o" version="1.35.10-3.rhaos4.22.git9383502.el9" apiVersion="v1"
Oct 30 20:38:14.158075 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:14.158059    6004 state_checkpoint.go:81] "State checkpoint: restored pod resource state from checkpoint"
Oct 30 20:38:14.158075 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:14.158072    6004 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Oct 30 20:38:14.158193 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:14.158183    6004 certificate_store.go:147] "Loading cert/key pair from a file" filePath="/var/lib/kubelet/pki/kubelet-server-current.pem"
Oct 30 20:38:14.158388 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:14.158377    6004 kubelet.go:963] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Oct 30 20:38:14.158419 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:14.158407    6004 kubelet.go:990] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Oct 30 20:38:14.158522 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:14.158513    6004 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Oct 30 20:38:14.158557 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:14.158529    6004 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Oct 30 20:38:14.158557 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:14.158536    6004 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Oct 30 20:38:14.158557 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:14.158544    6004 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Oct 30 20:38:14.158557 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:14.158553    6004 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Oct 30 20:38:14.158668 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:14.158564    6004 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Oct 30 20:38:14.158668 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:14.158572    6004 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Oct 30 20:38:14.158668 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:14.158578    6004 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Oct 30 20:38:14.158668 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:14.158585    6004 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Oct 30 20:38:14.158668 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:14.158591    6004 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Oct 30 20:38:14.158668 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:14.158600    6004 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Oct 30 20:38:14.158668 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:14.158610    6004 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Oct 30 20:38:14.158668 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:14.158636    6004 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Oct 30 20:38:14.158668 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:14.158645    6004 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Oct 30 20:38:14.162408 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:14.162373    6004 server.go:1263] "Started kubelet"
Oct 30 20:38:14.163133 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:14.162790    6004 server.go:182] "Starting to listen" address="0.0.0.0" port=10250
Oct 30 20:38:14.163551 ip-10-0-138-85 systemd[1]: Started Kubernetes Kubelet.
Oct 30 20:38:14.166618 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:14.163127    6004 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Oct 30 20:38:14.166618 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:14.164174    6004 server_v1.go:49] "podresources" method="list" useActivePods=true
Oct 30 20:38:14.166618 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:14.165228    6004 server.go:317] "Adding debug handlers to kubelet server"
Oct 30 20:38:14.166618 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:14.166283    6004 server.go:254] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Oct 30 20:38:14.171137 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:14.171120    6004 fs_resource_analyzer.go:69] "Starting FS ResourceAnalyzer"
Oct 30 20:38:14.171236 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:14.171216    6004 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Oct 30 20:38:14.171401 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:14.171376    6004 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-10-29 20:32:04 +0000 UTC" deadline="2028-06-21 08:03:25.38931987 +0000 UTC"
Oct 30 20:38:14.171401 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:14.171398    6004 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14387h25m11.217924979s"
Oct 30 20:38:14.171554 ip-10-0-138-85 kubenswrapper[6004]: E1030 20:38:14.171489    6004 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-138-85.us-west-1.compute.internal\" not found"
Oct 30 20:38:14.171554 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:14.171529    6004 volume_manager.go:309] "The desired_state_of_world populator starts"
Oct 30 20:38:14.171554 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:14.171538    6004 volume_manager.go:311] "Starting Kubelet Volume Manager"
Oct 30 20:38:14.171706 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:14.171622    6004 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Oct 30 20:38:14.173385 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:14.173364    6004 factory.go:153] Registering CRI-O factory
Oct 30 20:38:14.173385 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:14.173388    6004 factory.go:223] Registration of the crio container factory successfully
Oct 30 20:38:14.174284 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:14.173444    6004 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Oct 30 20:38:14.174284 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:14.173454    6004 factory.go:55] Registering systemd factory
Oct 30 20:38:14.174284 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:14.173463    6004 factory.go:223] Registration of the systemd container factory successfully
Oct 30 20:38:14.174284 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:14.173483    6004 factory.go:103] Registering Raw factory
Oct 30 20:38:14.174284 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:14.173497    6004 manager.go:1199] Started watching for new ooms in manager
Oct 30 20:38:14.174284 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:14.173848    6004 manager.go:319] Starting recovery of all containers
Oct 30 20:38:14.183953 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:14.183607    6004 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="0b7ae038-91bf-40f1-9930-8a6158706a3e" volumeName="kubernetes.io/configmap/0b7ae038-91bf-40f1-9930-8a6158706a3e-ovnkube-config" seLinuxMountContext=""
Oct 30 20:38:14.183953 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:14.183684    6004 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="50e37bd4-e46f-4577-b7b2-1ac7695637ea" volumeName="kubernetes.io/projected/50e37bd4-e46f-4577-b7b2-1ac7695637ea-kube-api-access-7qzv8" seLinuxMountContext=""
Oct 30 20:38:14.183953 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:14.183748    6004 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="aaadd8de-58cb-45af-a477-384fbf1cf317" volumeName="kubernetes.io/secret/aaadd8de-58cb-45af-a477-384fbf1cf317-metrics-tls" seLinuxMountContext=""
Oct 30 20:38:14.185385 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:14.185342    6004 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="ac7adab4-061f-4371-bc6c-96260eb988d8" volumeName="kubernetes.io/projected/ac7adab4-061f-4371-bc6c-96260eb988d8-kube-api-access-mwd9g" seLinuxMountContext=""
Oct 30 20:38:14.185475 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:14.185397    6004 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="cd59fef4-66a5-471b-a8ef-18df25e44d5c" volumeName="kubernetes.io/configmap/cd59fef4-66a5-471b-a8ef-18df25e44d5c-service-ca-bundle" seLinuxMountContext=""
Oct 30 20:38:14.185475 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:14.185415    6004 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="d1fd1b0a-3831-4cb8-b6f3-ad2e67685188" volumeName="kubernetes.io/projected/d1fd1b0a-3831-4cb8-b6f3-ad2e67685188-kube-api-access-cjbpj" seLinuxMountContext=""
Oct 30 20:38:14.185475 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:14.185446    6004 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="f31c8037-8b3e-4e1b-a363-fdca6686beb5" volumeName="kubernetes.io/secret/f31c8037-8b3e-4e1b-a363-fdca6686beb5-signing-key" seLinuxMountContext=""
Oct 30 20:38:14.185475 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:14.185464    6004 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="0df457c5-5640-4c0d-9f71-94548c11397a" volumeName="kubernetes.io/projected/0df457c5-5640-4c0d-9f71-94548c11397a-kube-api-access-htjnm" seLinuxMountContext=""
Oct 30 20:38:14.185653 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:14.185487    6004 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="2aee32c9-f358-4ff4-9d50-c18dba9885a5" volumeName="kubernetes.io/secret/2aee32c9-f358-4ff4-9d50-c18dba9885a5-installation-pull-secrets" seLinuxMountContext=""
Oct 30 20:38:14.185653 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:14.185504    6004 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="caca5f60-f777-4672-b570-faa422073cb9" volumeName="kubernetes.io/projected/caca5f60-f777-4672-b570-faa422073cb9-kube-api-access-mgww7" seLinuxMountContext=""
Oct 30 20:38:14.185653 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:14.185530    6004 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="519501c9-00d9-416f-887a-13b83aad5762" volumeName="kubernetes.io/empty-dir/519501c9-00d9-416f-887a-13b83aad5762-archives-path" seLinuxMountContext=""
Oct 30 20:38:14.185653 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:14.185547    6004 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="90cd3de0-c573-41c2-bf3e-cf0e46a41d50" volumeName="kubernetes.io/configmap/90cd3de0-c573-41c2-bf3e-cf0e46a41d50-config" seLinuxMountContext=""
Oct 30 20:38:14.185653 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:14.185563    6004 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="1dc89e41-1e32-476f-b5fc-e45945a45efd" volumeName="kubernetes.io/projected/1dc89e41-1e32-476f-b5fc-e45945a45efd-kube-api-access-wc2mp" seLinuxMountContext=""
Oct 30 20:38:14.185653 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:14.185580    6004 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="2aee32c9-f358-4ff4-9d50-c18dba9885a5" volumeName="kubernetes.io/projected/2aee32c9-f358-4ff4-9d50-c18dba9885a5-kube-api-access-bkhhh" seLinuxMountContext=""
Oct 30 20:38:14.185653 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:14.185602    6004 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="4dde41e2-34fe-429b-bf23-35bdb99d894e" volumeName="kubernetes.io/configmap/4dde41e2-34fe-429b-bf23-35bdb99d894e-trusted-ca-bundle" seLinuxMountContext=""
Oct 30 20:38:14.185653 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:14.185625    6004 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="aaadd8de-58cb-45af-a477-384fbf1cf317" volumeName="kubernetes.io/projected/aaadd8de-58cb-45af-a477-384fbf1cf317-kube-api-access-hzklm" seLinuxMountContext=""
Oct 30 20:38:14.185653 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:14.185643    6004 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="d1fd1b0a-3831-4cb8-b6f3-ad2e67685188" volumeName="kubernetes.io/secret/d1fd1b0a-3831-4cb8-b6f3-ad2e67685188-cluster-monitoring-operator-tls" seLinuxMountContext=""
Oct 30 20:38:14.186017 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:14.185663    6004 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="ee37dd25-4ac1-474f-80b8-d04da8da560c" volumeName="kubernetes.io/secret/ee37dd25-4ac1-474f-80b8-d04da8da560c-serving-cert" seLinuxMountContext=""
Oct 30 20:38:14.186017 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:14.185693    6004 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="780e67fb-196e-485a-8aa4-e11cecdc4b63" volumeName="kubernetes.io/projected/780e67fb-196e-485a-8aa4-e11cecdc4b63-kube-api-access-49sfp" seLinuxMountContext=""
Oct 30 20:38:14.186017 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:14.185709    6004 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="0df457c5-5640-4c0d-9f71-94548c11397a" volumeName="kubernetes.io/configmap/0df457c5-5640-4c0d-9f71-94548c11397a-kube-rbac-proxy-cm" seLinuxMountContext=""
Oct 30 20:38:14.186017 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:14.185724    6004 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="1dc89e41-1e32-476f-b5fc-e45945a45efd" volumeName="kubernetes.io/empty-dir/1dc89e41-1e32-476f-b5fc-e45945a45efd-tmp" seLinuxMountContext=""
Oct 30 20:38:14.186017 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:14.185740    6004 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="2aee32c9-f358-4ff4-9d50-c18dba9885a5" volumeName="kubernetes.io/projected/2aee32c9-f358-4ff4-9d50-c18dba9885a5-bound-sa-token" seLinuxMountContext=""
Oct 30 20:38:14.186017 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:14.185755    6004 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="2f9dd030-281c-473e-b441-9ee972019413" volumeName="kubernetes.io/configmap/2f9dd030-281c-473e-b441-9ee972019413-cni-binary-copy" seLinuxMountContext=""
Oct 30 20:38:14.186017 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:14.185772    6004 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="4179c36b-8003-46e5-82b0-67f6edea7553" volumeName="kubernetes.io/projected/4179c36b-8003-46e5-82b0-67f6edea7553-kube-api-access-79wpr" seLinuxMountContext=""
Oct 30 20:38:14.186017 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:14.185789    6004 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="4dde41e2-34fe-429b-bf23-35bdb99d894e" volumeName="kubernetes.io/projected/4dde41e2-34fe-429b-bf23-35bdb99d894e-kube-api-access-xp792" seLinuxMountContext=""
Oct 30 20:38:14.186017 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:14.185806    6004 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="ac7adab4-061f-4371-bc6c-96260eb988d8" volumeName="kubernetes.io/configmap/ac7adab4-061f-4371-bc6c-96260eb988d8-multus-daemon-config" seLinuxMountContext=""
Oct 30 20:38:14.186017 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:14.185820    6004 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="16e71e18-453a-41bf-a3f8-9618482c9a50" volumeName="kubernetes.io/projected/16e71e18-453a-41bf-a3f8-9618482c9a50-kube-api-access-c2w8k" seLinuxMountContext=""
Oct 30 20:38:14.186017 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:14.185849    6004 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="aaadd8de-58cb-45af-a477-384fbf1cf317" volumeName="kubernetes.io/configmap/aaadd8de-58cb-45af-a477-384fbf1cf317-config-volume" seLinuxMountContext=""
Oct 30 20:38:14.186017 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:14.185872    6004 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="b2dae567-b378-41ed-9f7e-881153b7d03b" volumeName="kubernetes.io/projected/b2dae567-b378-41ed-9f7e-881153b7d03b-kube-api-access-zkkqp" seLinuxMountContext=""
Oct 30 20:38:14.190093 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:14.190066    6004 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="b3bff4d5-f9a8-4302-b63d-136ed3c6be35" volumeName="kubernetes.io/configmap/b3bff4d5-f9a8-4302-b63d-136ed3c6be35-trusted-ca" seLinuxMountContext=""
Oct 30 20:38:14.190387 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:14.190354    6004 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="b3bff4d5-f9a8-4302-b63d-136ed3c6be35" volumeName="kubernetes.io/projected/b3bff4d5-f9a8-4302-b63d-136ed3c6be35-bound-sa-token" seLinuxMountContext=""
Oct 30 20:38:14.190452 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:14.190387    6004 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="0f424633-11a5-49fa-a933-f9c6ec7ca97e" volumeName="kubernetes.io/projected/0f424633-11a5-49fa-a933-f9c6ec7ca97e-kube-api-access-lq6t2" seLinuxMountContext=""
Oct 30 20:38:14.190452 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:14.190401    6004 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="2aee32c9-f358-4ff4-9d50-c18dba9885a5" volumeName="kubernetes.io/projected/2aee32c9-f358-4ff4-9d50-c18dba9885a5-registry-tls" seLinuxMountContext=""
Oct 30 20:38:14.190452 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:14.190422    6004 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="2aee32c9-f358-4ff4-9d50-c18dba9885a5" volumeName="kubernetes.io/secret/2aee32c9-f358-4ff4-9d50-c18dba9885a5-image-registry-private-configuration" seLinuxMountContext=""
Oct 30 20:38:14.190452 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:14.190433    6004 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="519501c9-00d9-416f-887a-13b83aad5762" volumeName="kubernetes.io/configmap/519501c9-00d9-416f-887a-13b83aad5762-service-ca-bundle" seLinuxMountContext=""
Oct 30 20:38:14.190624 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:14.190453    6004 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="b3bff4d5-f9a8-4302-b63d-136ed3c6be35" volumeName="kubernetes.io/secret/b3bff4d5-f9a8-4302-b63d-136ed3c6be35-image-registry-private-configuration" seLinuxMountContext=""
Oct 30 20:38:14.190624 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:14.190467    6004 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="e33ef368-1f7c-4455-beb9-a2b2c5106792" volumeName="kubernetes.io/projected/e33ef368-1f7c-4455-beb9-a2b2c5106792-kube-api-access-4r7tw" seLinuxMountContext=""
Oct 30 20:38:14.190624 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:14.190478    6004 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="4dde41e2-34fe-429b-bf23-35bdb99d894e" volumeName="kubernetes.io/configmap/4dde41e2-34fe-429b-bf23-35bdb99d894e-service-ca-bundle" seLinuxMountContext=""
Oct 30 20:38:14.190624 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:14.190489    6004 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="708a2c3c-e061-4bb1-b9ff-48f111b08943" volumeName="kubernetes.io/secret/708a2c3c-e061-4bb1-b9ff-48f111b08943-tls-certificates" seLinuxMountContext=""
Oct 30 20:38:14.190624 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:14.190499    6004 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="aaadd8de-58cb-45af-a477-384fbf1cf317" volumeName="kubernetes.io/empty-dir/aaadd8de-58cb-45af-a477-384fbf1cf317-tmp-dir" seLinuxMountContext=""
Oct 30 20:38:14.190624 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:14.190512    6004 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="b3bff4d5-f9a8-4302-b63d-136ed3c6be35" volumeName="kubernetes.io/secret/b3bff4d5-f9a8-4302-b63d-136ed3c6be35-installation-pull-secrets" seLinuxMountContext=""
Oct 30 20:38:14.190624 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:14.190523    6004 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="cd59fef4-66a5-471b-a8ef-18df25e44d5c" volumeName="kubernetes.io/projected/cd59fef4-66a5-471b-a8ef-18df25e44d5c-kube-api-access-rvdqt" seLinuxMountContext=""
Oct 30 20:38:14.190624 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:14.190535    6004 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="ee37dd25-4ac1-474f-80b8-d04da8da560c" volumeName="kubernetes.io/configmap/ee37dd25-4ac1-474f-80b8-d04da8da560c-config" seLinuxMountContext=""
Oct 30 20:38:14.190624 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:14.190552    6004 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="f31c8037-8b3e-4e1b-a363-fdca6686beb5" volumeName="kubernetes.io/configmap/f31c8037-8b3e-4e1b-a363-fdca6686beb5-signing-cabundle" seLinuxMountContext=""
Oct 30 20:38:14.190624 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:14.190563    6004 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="f31c8037-8b3e-4e1b-a363-fdca6686beb5" volumeName="kubernetes.io/projected/f31c8037-8b3e-4e1b-a363-fdca6686beb5-kube-api-access-ldfgb" seLinuxMountContext=""
Oct 30 20:38:14.190624 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:14.190574    6004 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="4dde41e2-34fe-429b-bf23-35bdb99d894e" volumeName="kubernetes.io/empty-dir/4dde41e2-34fe-429b-bf23-35bdb99d894e-snapshots" seLinuxMountContext=""
Oct 30 20:38:14.190624 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:14.190585    6004 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="73676585-4ea4-43cb-af99-b4716472fb15" volumeName="kubernetes.io/secret/73676585-4ea4-43cb-af99-b4716472fb15-networking-console-plugin-cert" seLinuxMountContext=""
Oct 30 20:38:14.190624 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:14.190597    6004 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="a4cdc725-3dd0-4917-b8a0-c8ff77a40abb" volumeName="kubernetes.io/secret/a4cdc725-3dd0-4917-b8a0-c8ff77a40abb-original-pull-secret" seLinuxMountContext=""
Oct 30 20:38:14.190624 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:14.190608    6004 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="cd59fef4-66a5-471b-a8ef-18df25e44d5c" volumeName="kubernetes.io/secret/cd59fef4-66a5-471b-a8ef-18df25e44d5c-stats-auth" seLinuxMountContext=""
Oct 30 20:38:14.190624 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:14.190618    6004 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="db64c15b-58b0-4829-b702-de7b6c846ab4" volumeName="kubernetes.io/projected/db64c15b-58b0-4829-b702-de7b6c846ab4-kube-api-access-nnz7p" seLinuxMountContext=""
Oct 30 20:38:14.190624 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:14.190629    6004 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="ee37dd25-4ac1-474f-80b8-d04da8da560c" volumeName="kubernetes.io/projected/ee37dd25-4ac1-474f-80b8-d04da8da560c-kube-api-access-j6vtn" seLinuxMountContext=""
Oct 30 20:38:14.191317 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:14.190640    6004 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="f1a05736-0bc6-4914-981e-5524121561e4" volumeName="kubernetes.io/projected/f1a05736-0bc6-4914-981e-5524121561e4-kube-api-access-lc26k" seLinuxMountContext=""
Oct 30 20:38:14.191317 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:14.190650    6004 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="0b7ae038-91bf-40f1-9930-8a6158706a3e" volumeName="kubernetes.io/secret/0b7ae038-91bf-40f1-9930-8a6158706a3e-ovn-node-metrics-cert" seLinuxMountContext=""
Oct 30 20:38:14.191317 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:14.190661    6004 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="0df457c5-5640-4c0d-9f71-94548c11397a" volumeName="kubernetes.io/empty-dir/0df457c5-5640-4c0d-9f71-94548c11397a-data-volume" seLinuxMountContext=""
Oct 30 20:38:14.191317 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:14.190672    6004 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="4179c36b-8003-46e5-82b0-67f6edea7553" volumeName="kubernetes.io/configmap/4179c36b-8003-46e5-82b0-67f6edea7553-serviceca" seLinuxMountContext=""
Oct 30 20:38:14.191317 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:14.190683    6004 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="4dde41e2-34fe-429b-bf23-35bdb99d894e" volumeName="kubernetes.io/secret/4dde41e2-34fe-429b-bf23-35bdb99d894e-serving-cert" seLinuxMountContext=""
Oct 30 20:38:14.191317 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:14.190713    6004 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="6080982d-ff7c-47b2-8a0c-5a2fff21722b" volumeName="kubernetes.io/projected/6080982d-ff7c-47b2-8a0c-5a2fff21722b-kube-api-access-7z886" seLinuxMountContext=""
Oct 30 20:38:14.191317 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:14.190724    6004 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="90cd3de0-c573-41c2-bf3e-cf0e46a41d50" volumeName="kubernetes.io/projected/90cd3de0-c573-41c2-bf3e-cf0e46a41d50-kube-api-access-tz88w" seLinuxMountContext=""
Oct 30 20:38:14.191317 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:14.190735    6004 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="16e71e18-453a-41bf-a3f8-9618482c9a50" volumeName="kubernetes.io/empty-dir/16e71e18-453a-41bf-a3f8-9618482c9a50-tmp-dir" seLinuxMountContext=""
Oct 30 20:38:14.191317 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:14.190746    6004 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="4dde41e2-34fe-429b-bf23-35bdb99d894e" volumeName="kubernetes.io/empty-dir/4dde41e2-34fe-429b-bf23-35bdb99d894e-tmp" seLinuxMountContext=""
Oct 30 20:38:14.191317 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:14.190758    6004 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="ac7adab4-061f-4371-bc6c-96260eb988d8" volumeName="kubernetes.io/configmap/ac7adab4-061f-4371-bc6c-96260eb988d8-cni-binary-copy" seLinuxMountContext=""
Oct 30 20:38:14.191317 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:14.190769    6004 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="b3bff4d5-f9a8-4302-b63d-136ed3c6be35" volumeName="kubernetes.io/empty-dir/b3bff4d5-f9a8-4302-b63d-136ed3c6be35-ca-trust-extracted" seLinuxMountContext=""
Oct 30 20:38:14.191317 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:14.190779    6004 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="b3bff4d5-f9a8-4302-b63d-136ed3c6be35" volumeName="kubernetes.io/projected/b3bff4d5-f9a8-4302-b63d-136ed3c6be35-kube-api-access-75wkc" seLinuxMountContext=""
Oct 30 20:38:14.191317 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:14.190790    6004 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="d1fd1b0a-3831-4cb8-b6f3-ad2e67685188" volumeName="kubernetes.io/configmap/d1fd1b0a-3831-4cb8-b6f3-ad2e67685188-telemetry-config" seLinuxMountContext=""
Oct 30 20:38:14.191317 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:14.190801    6004 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="e5ac6e6d-4ea4-4874-b2eb-285977a285f7" volumeName="kubernetes.io/projected/e5ac6e6d-4ea4-4874-b2eb-285977a285f7-kube-api-access-5tcf2" seLinuxMountContext=""
Oct 30 20:38:14.191317 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:14.190812    6004 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="ef128f2b-0a66-4c2d-a969-6197e0f82c58" volumeName="kubernetes.io/secret/ef128f2b-0a66-4c2d-a969-6197e0f82c58-agent-certs" seLinuxMountContext=""
Oct 30 20:38:14.191317 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:14.190824    6004 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="793cb601-841f-4511-9b8f-ff30262611c2" volumeName="kubernetes.io/projected/793cb601-841f-4511-9b8f-ff30262611c2-kube-api-access-72b4g" seLinuxMountContext=""
Oct 30 20:38:14.191317 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:14.190835    6004 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="6cd9770e-ea54-4c33-ac1e-5643f3d8839d" volumeName="kubernetes.io/configmap/6cd9770e-ea54-4c33-ac1e-5643f3d8839d-samples-operator-config" seLinuxMountContext=""
Oct 30 20:38:14.191317 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:14.190847    6004 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="6cd9770e-ea54-4c33-ac1e-5643f3d8839d" volumeName="kubernetes.io/secret/6cd9770e-ea54-4c33-ac1e-5643f3d8839d-samples-operator-tls" seLinuxMountContext=""
Oct 30 20:38:14.191317 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:14.190857    6004 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="0b7ae038-91bf-40f1-9930-8a6158706a3e" volumeName="kubernetes.io/projected/0b7ae038-91bf-40f1-9930-8a6158706a3e-kube-api-access-mh8k8" seLinuxMountContext=""
Oct 30 20:38:14.191317 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:14.190875    6004 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="0df457c5-5640-4c0d-9f71-94548c11397a" volumeName="kubernetes.io/secret/0df457c5-5640-4c0d-9f71-94548c11397a-insights-runtime-extractor-tls" seLinuxMountContext=""
Oct 30 20:38:14.191317 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:14.190886    6004 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="0f424633-11a5-49fa-a933-f9c6ec7ca97e" volumeName="kubernetes.io/secret/0f424633-11a5-49fa-a933-f9c6ec7ca97e-metrics-certs" seLinuxMountContext=""
Oct 30 20:38:14.191317 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:14.190898    6004 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="1dc89e41-1e32-476f-b5fc-e45945a45efd" volumeName="kubernetes.io/empty-dir/1dc89e41-1e32-476f-b5fc-e45945a45efd-etc-tuned" seLinuxMountContext=""
Oct 30 20:38:14.191317 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:14.190908    6004 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="2f9dd030-281c-473e-b441-9ee972019413" volumeName="kubernetes.io/configmap/2f9dd030-281c-473e-b441-9ee972019413-cni-sysctl-allowlist" seLinuxMountContext=""
Oct 30 20:38:14.191317 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:14.190919    6004 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="2f9dd030-281c-473e-b441-9ee972019413" volumeName="kubernetes.io/projected/2f9dd030-281c-473e-b441-9ee972019413-kube-api-access-48plj" seLinuxMountContext=""
Oct 30 20:38:14.191317 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:14.190929    6004 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="2f9dd030-281c-473e-b441-9ee972019413" volumeName="kubernetes.io/configmap/2f9dd030-281c-473e-b441-9ee972019413-whereabouts-flatfile-configmap" seLinuxMountContext=""
Oct 30 20:38:14.191317 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:14.190940    6004 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="b2dae567-b378-41ed-9f7e-881153b7d03b" volumeName="kubernetes.io/configmap/b2dae567-b378-41ed-9f7e-881153b7d03b-iptables-alerter-script" seLinuxMountContext=""
Oct 30 20:38:14.191317 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:14.190952    6004 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="caca5f60-f777-4672-b570-faa422073cb9" volumeName="kubernetes.io/secret/caca5f60-f777-4672-b570-faa422073cb9-cert" seLinuxMountContext=""
Oct 30 20:38:14.191317 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:14.190963    6004 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="cd59fef4-66a5-471b-a8ef-18df25e44d5c" volumeName="kubernetes.io/secret/cd59fef4-66a5-471b-a8ef-18df25e44d5c-metrics-certs" seLinuxMountContext=""
Oct 30 20:38:14.191317 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:14.190975    6004 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="ef128f2b-0a66-4c2d-a969-6197e0f82c58" volumeName="kubernetes.io/configmap/ef128f2b-0a66-4c2d-a969-6197e0f82c58-konnectivity-ca" seLinuxMountContext=""
Oct 30 20:38:14.191317 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:14.190987    6004 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="0b7ae038-91bf-40f1-9930-8a6158706a3e" volumeName="kubernetes.io/configmap/0b7ae038-91bf-40f1-9930-8a6158706a3e-ovnkube-script-lib" seLinuxMountContext=""
Oct 30 20:38:14.191317 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:14.190998    6004 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="0b7ae038-91bf-40f1-9930-8a6158706a3e" volumeName="kubernetes.io/configmap/0b7ae038-91bf-40f1-9930-8a6158706a3e-env-overrides" seLinuxMountContext=""
Oct 30 20:38:14.191317 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:14.191009    6004 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="2aee32c9-f358-4ff4-9d50-c18dba9885a5" volumeName="kubernetes.io/configmap/2aee32c9-f358-4ff4-9d50-c18dba9885a5-registry-certificates" seLinuxMountContext=""
Oct 30 20:38:14.191317 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:14.191022    6004 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="2aee32c9-f358-4ff4-9d50-c18dba9885a5" volumeName="kubernetes.io/empty-dir/2aee32c9-f358-4ff4-9d50-c18dba9885a5-ca-trust-extracted" seLinuxMountContext=""
Oct 30 20:38:14.191317 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:14.191033    6004 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="519501c9-00d9-416f-887a-13b83aad5762" volumeName="kubernetes.io/configmap/519501c9-00d9-416f-887a-13b83aad5762-trusted-ca-bundle" seLinuxMountContext=""
Oct 30 20:38:14.191317 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:14.191045    6004 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="f7ba0792-faca-42fd-8d0d-3499c5b7278f" volumeName="kubernetes.io/projected/f7ba0792-faca-42fd-8d0d-3499c5b7278f-kube-api-access-h8vbt" seLinuxMountContext=""
Oct 30 20:38:14.191317 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:14.191079    6004 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="2aee32c9-f358-4ff4-9d50-c18dba9885a5" volumeName="kubernetes.io/configmap/2aee32c9-f358-4ff4-9d50-c18dba9885a5-trusted-ca" seLinuxMountContext=""
Oct 30 20:38:14.191317 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:14.191091    6004 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="537a9c41-5ed1-4ff5-bf9a-9d0bcb853f80" volumeName="kubernetes.io/projected/537a9c41-5ed1-4ff5-bf9a-9d0bcb853f80-kube-api-access-9hnz8" seLinuxMountContext=""
Oct 30 20:38:14.191317 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:14.191101    6004 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="90cd3de0-c573-41c2-bf3e-cf0e46a41d50" volumeName="kubernetes.io/configmap/90cd3de0-c573-41c2-bf3e-cf0e46a41d50-trusted-ca" seLinuxMountContext=""
Oct 30 20:38:14.191317 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:14.191112    6004 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="e33ef368-1f7c-4455-beb9-a2b2c5106792" volumeName="kubernetes.io/configmap/e33ef368-1f7c-4455-beb9-a2b2c5106792-config" seLinuxMountContext=""
Oct 30 20:38:14.191317 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:14.191124    6004 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="b3bff4d5-f9a8-4302-b63d-136ed3c6be35" volumeName="kubernetes.io/projected/b3bff4d5-f9a8-4302-b63d-136ed3c6be35-registry-tls" seLinuxMountContext=""
Oct 30 20:38:14.191317 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:14.191134    6004 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="519501c9-00d9-416f-887a-13b83aad5762" volumeName="kubernetes.io/projected/519501c9-00d9-416f-887a-13b83aad5762-kube-api-access-f2b6b" seLinuxMountContext=""
Oct 30 20:38:14.191317 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:14.191144    6004 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="6cd9770e-ea54-4c33-ac1e-5643f3d8839d" volumeName="kubernetes.io/projected/6cd9770e-ea54-4c33-ac1e-5643f3d8839d-kube-api-access-trh2f" seLinuxMountContext=""
Oct 30 20:38:14.191317 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:14.191163    6004 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="73676585-4ea4-43cb-af99-b4716472fb15" volumeName="kubernetes.io/configmap/73676585-4ea4-43cb-af99-b4716472fb15-nginx-conf" seLinuxMountContext=""
Oct 30 20:38:14.191317 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:14.191174    6004 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="90cd3de0-c573-41c2-bf3e-cf0e46a41d50" volumeName="kubernetes.io/secret/90cd3de0-c573-41c2-bf3e-cf0e46a41d50-serving-cert" seLinuxMountContext=""
Oct 30 20:38:14.191317 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:14.191211    6004 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="b3bff4d5-f9a8-4302-b63d-136ed3c6be35" volumeName="kubernetes.io/configmap/b3bff4d5-f9a8-4302-b63d-136ed3c6be35-registry-certificates" seLinuxMountContext=""
Oct 30 20:38:14.191317 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:14.191225    6004 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="cd59fef4-66a5-471b-a8ef-18df25e44d5c" volumeName="kubernetes.io/secret/cd59fef4-66a5-471b-a8ef-18df25e44d5c-default-certificate" seLinuxMountContext=""
Oct 30 20:38:14.191317 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:14.191236    6004 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="e33ef368-1f7c-4455-beb9-a2b2c5106792" volumeName="kubernetes.io/secret/e33ef368-1f7c-4455-beb9-a2b2c5106792-serving-cert" seLinuxMountContext=""
Oct 30 20:38:14.191317 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:14.191246    6004 reconstruct.go:97] "Volume reconstruction finished"
Oct 30 20:38:14.191317 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:14.191253    6004 reconciler.go:29] "Reconciler: start to sync state"
Oct 30 20:38:14.219029 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:14.219000    6004 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-sb7ds_90cd3de0-c573-41c2-bf3e-cf0e46a41d50/console-operator/2.log"
Oct 30 20:38:14.220406 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:14.220377    6004 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-sb7ds_90cd3de0-c573-41c2-bf3e-cf0e46a41d50/console-operator/2.log"
Oct 30 20:38:14.222074 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:14.222028    6004 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Oct 30 20:38:14.223304 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:14.223280    6004 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Oct 30 20:38:14.223409 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:14.223323    6004 status_manager.go:249] "Starting to sync pod status with apiserver"
Oct 30 20:38:14.223409 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:14.223344    6004 kubelet.go:2521] "Starting kubelet main sync loop"
Oct 30 20:38:14.223409 ip-10-0-138-85 kubenswrapper[6004]: E1030 20:38:14.223385    6004 kubelet.go:2545] "Skipping pod synchronization" err="[container runtime status check may not have completed yet, PLEG is not healthy: pleg has yet to be successful]"
Oct 30 20:38:14.242229 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:14.242191    6004 generic.go:356] "Generic (PLEG): container finished" podID="6d131c2bf86bd4364de095ada64f40ce" containerID="e8ad48ff7218f2aa51c17dca1a57032d5a2832a3c3abb3dc3466b0c58c7a4c22" exitCode=0
Oct 30 20:38:14.271901 ip-10-0-138-85 kubenswrapper[6004]: E1030 20:38:14.271669    6004 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-138-85.us-west-1.compute.internal\" not found"
Oct 30 20:38:14.277125 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:14.277039    6004 generic.go:356] "Generic (PLEG): container finished" podID="2f9dd030-281c-473e-b441-9ee972019413" containerID="b4fe46da60d74c6e1a5806c03b9590a55b08598422b2847975ea94df956a91c3" exitCode=0
Oct 30 20:38:14.277125 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:14.277123    6004 generic.go:356] "Generic (PLEG): container finished" podID="2f9dd030-281c-473e-b441-9ee972019413" containerID="05d8adff28950689ccd51498d3bd8f98256639235ca7839379fc7ff75f1e3066" exitCode=0
Oct 30 20:38:14.277331 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:14.277133    6004 generic.go:356] "Generic (PLEG): container finished" podID="2f9dd030-281c-473e-b441-9ee972019413" containerID="6846bfad40a692e47a14e8a1a6a67df792dd1b7dffc778004962e314b1b8dcec" exitCode=0
Oct 30 20:38:14.277331 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:14.277141    6004 generic.go:356] "Generic (PLEG): container finished" podID="2f9dd030-281c-473e-b441-9ee972019413" containerID="205870f3632a68a93dbc03f52f212444ce47e0f51ca4ecebbdec4102249da1d7" exitCode=0
Oct 30 20:38:14.277331 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:14.277150    6004 generic.go:356] "Generic (PLEG): container finished" podID="2f9dd030-281c-473e-b441-9ee972019413" containerID="78be589f4c5839c29ad09ffffec86606e4c918149623b04e7fea17fa19017f83" exitCode=0
Oct 30 20:38:14.277331 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:14.277156    6004 generic.go:356] "Generic (PLEG): container finished" podID="2f9dd030-281c-473e-b441-9ee972019413" containerID="8fed799fb3e33a8df7fb78987d97a68251079eeb83eff171e6884efdd93e09db" exitCode=0
Oct 30 20:38:14.305952 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:14.305925    6004 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-sb7ds_90cd3de0-c573-41c2-bf3e-cf0e46a41d50/console-operator/2.log"
Oct 30 20:38:14.306118 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:14.305964    6004 generic.go:356] "Generic (PLEG): container finished" podID="90cd3de0-c573-41c2-bf3e-cf0e46a41d50" containerID="22e92c57dba3dc870b000562eeb828e9942a53023e03c3fc4d8722d561ea38f7" exitCode=255
Oct 30 20:38:14.323454 ip-10-0-138-85 kubenswrapper[6004]: E1030 20:38:14.323423    6004 kubelet.go:2545] "Skipping pod synchronization" err="container runtime status check may not have completed yet"
Oct 30 20:38:14.326781 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:14.326763    6004 manager.go:324] Recovery completed
Oct 30 20:38:14.351549 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:14.351525    6004 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Oct 30 20:38:14.353493 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:14.353474    6004 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-138-85.us-west-1.compute.internal" event="NodeHasSufficientMemory"
Oct 30 20:38:14.353579 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:14.353503    6004 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-138-85.us-west-1.compute.internal" event="NodeHasNoDiskPressure"
Oct 30 20:38:14.353579 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:14.353514    6004 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-138-85.us-west-1.compute.internal" event="NodeHasSufficientPID"
Oct 30 20:38:14.357988 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:14.357966    6004 cpu_manager.go:226] "Starting" policy="none"
Oct 30 20:38:14.357988 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:14.357981    6004 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Oct 30 20:38:14.358151 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:14.357983    6004 cpu_manager.go:227] "Reconciling" reconcilePeriod="10s"
Oct 30 20:38:14.358151 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:14.358114    6004 state_mem.go:41] "Initialized" logger="CPUManager state checkpoint.CPUManager state memory"
Oct 30 20:38:14.358270 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:14.358244    6004 state_mem.go:94] "Updated default CPUSet" logger="CPUManager state checkpoint.CPUManager state memory" cpuSet=""
Oct 30 20:38:14.358310 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:14.358261    6004 state_mem.go:102] "Updated CPUSet assignments" logger="CPUManager state checkpoint.CPUManager state memory" assignments={}
Oct 30 20:38:14.358310 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:14.358284    6004 state_checkpoint.go:142] "restored state from checkpoint" logger="CPUManager state checkpoint"
Oct 30 20:38:14.358310 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:14.358290    6004 state_checkpoint.go:143] "defaultCPUSet" logger="CPUManager state checkpoint" defaultCpuSet=""
Oct 30 20:38:14.358310 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:14.358296    6004 policy_none.go:50] "Start"
Oct 30 20:38:14.358310 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:14.358306    6004 memory_manager.go:187] "Starting memorymanager" policy="None"
Oct 30 20:38:14.358490 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:14.358316    6004 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Oct 30 20:38:14.358983 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:14.358963    6004 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-138-85.us-west-1.compute.internal" event="NodeHasSufficientMemory"
Oct 30 20:38:14.359094 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:14.358994    6004 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-138-85.us-west-1.compute.internal" event="NodeHasNoDiskPressure"
Oct 30 20:38:14.359094 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:14.359004    6004 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-138-85.us-west-1.compute.internal" event="NodeHasSufficientPID"
Oct 30 20:38:14.361100 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:14.361084    6004 state_mem.go:77] "Updated machine memory state" logger="Memory Manager state checkpoint"
Oct 30 20:38:14.361147 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:14.361100    6004 state_checkpoint.go:85] "State checkpoint: restored state from checkpoint" logger="Memory Manager state checkpoint"
Oct 30 20:38:14.361147 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:14.361107    6004 policy_none.go:44] "Start"
Oct 30 20:38:14.366579 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:14.366549    6004 node_container_manager_linux.go:130] "Enforcing system reserved compressible on cgroup" cgroupName="/system.slice" limits={"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"}
Oct 30 20:38:14.366817 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:14.366800    6004 reflector.go:446] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:161"
Oct 30 20:38:14.366817 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:14.366802    6004 reflector.go:446] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:161"
Oct 30 20:38:14.366947 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:14.366909    6004 reconstruct.go:205] "DevicePaths of reconstructed volumes updated"
Oct 30 20:38:14.370292 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:14.370277    6004 manager.go:341] "Starting Device Plugin manager"
Oct 30 20:38:14.370376 ip-10-0-138-85 kubenswrapper[6004]: E1030 20:38:14.370303    6004 manager.go:525] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Oct 30 20:38:14.370376 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:14.370313    6004 server.go:87] "Starting device plugin registration server"
Oct 30 20:38:14.370957 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:14.370942    6004 eviction_manager.go:194] "Eviction manager: starting control loop"
Oct 30 20:38:14.370995 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:14.370956    6004 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Oct 30 20:38:14.371089 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:14.371073    6004 plugin_watcher.go:53] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Oct 30 20:38:14.371195 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:14.371165    6004 plugin_watcher.go:201] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Oct 30 20:38:14.371299 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:14.371204    6004 plugin_manager.go:119] "The desired_state_of_world populator (plugin watcher) starts"
Oct 30 20:38:14.371299 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:14.371211    6004 plugin_manager.go:121] "Starting Kubelet Plugin Manager"
Oct 30 20:38:14.371374 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:14.371244    6004 reconciler.go:167] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-10-30T20:38:14.371190006Z","UUID":"c57b2ebe-2533-4ce0-a146-f7878cb4d182","Handler":null,"Name":"","Endpoint":""}
Oct 30 20:38:14.374495 ip-10-0-138-85 kubenswrapper[6004]: E1030 20:38:14.373418    6004 eviction_manager.go:272] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Oct 30 20:38:14.374495 ip-10-0-138-85 kubenswrapper[6004]: E1030 20:38:14.373460    6004 eviction_manager.go:297] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-138-85.us-west-1.compute.internal\" not found"
Oct 30 20:38:14.374495 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:14.373611    6004 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Oct 30 20:38:14.374495 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:14.373643    6004 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Oct 30 20:38:14.416350 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:14.416323    6004 reflector.go:446] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:161"
Oct 30 20:38:14.466807 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:14.466766    6004 reflector.go:446] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:161"
Oct 30 20:38:14.472470 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:14.472447    6004 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Oct 30 20:38:14.474553 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:14.474531    6004 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-138-85.us-west-1.compute.internal" event="NodeHasSufficientMemory"
Oct 30 20:38:14.474633 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:14.474564    6004 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-138-85.us-west-1.compute.internal" event="NodeHasNoDiskPressure"
Oct 30 20:38:14.474633 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:14.474576    6004 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-138-85.us-west-1.compute.internal" event="NodeHasSufficientPID"
Oct 30 20:38:14.474633 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:14.474622    6004 kubelet_node_status.go:77] "Attempting to register node" node="ip-10-0-138-85.us-west-1.compute.internal"
Oct 30 20:38:14.524137 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:14.524040    6004 kubelet.go:2608] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-85.us-west-1.compute.internal","kube-system/kube-apiserver-proxy-ip-10-0-138-85.us-west-1.compute.internal"]
Oct 30 20:38:14.524685 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:14.524648    6004 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-85.us-west-1.compute.internal" event={"ID":"9d0b6e5dd2bbef8c0c7895485f0fdbd3","Type":"ContainerStarted","Data":"c6ccd2f9553467ccd1133df809340b330acb33462497e0da19eaccb6cbcec801"}
Oct 30 20:38:14.524685 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:14.524694    6004 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-85.us-west-1.compute.internal" event={"ID":"9d0b6e5dd2bbef8c0c7895485f0fdbd3","Type":"ContainerStarted","Data":"baeacfc304391a12cde769f20bf03da6002f7385c5a2080b0648c42526e4bc00"}
Oct 30 20:38:14.524805 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:14.524710    6004 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-85.us-west-1.compute.internal" event={"ID":"6d131c2bf86bd4364de095ada64f40ce","Type":"ContainerStarted","Data":"51fbfee9ea577070c09bb70f1a0ba8c98892e5eaac6b2c413fdfed693f3dea5a"}
Oct 30 20:38:14.524805 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:14.524728    6004 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-85.us-west-1.compute.internal" event={"ID":"6d131c2bf86bd4364de095ada64f40ce","Type":"ContainerDied","Data":"e8ad48ff7218f2aa51c17dca1a57032d5a2832a3c3abb3dc3466b0c58c7a4c22"}
Oct 30 20:38:14.524805 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:14.524746    6004 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-85.us-west-1.compute.internal" event={"ID":"6d131c2bf86bd4364de095ada64f40ce","Type":"ContainerStarted","Data":"4b0bf6d5013068d8bbb0e5ea418174eb6ed04e5fe648b32719858885afa323e1"}
Oct 30 20:38:14.524901 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:14.524824    6004 kubelet.go:3368] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-85.us-west-1.compute.internal"
Oct 30 20:38:14.524942 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:14.524928    6004 kubelet.go:3368] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-85.us-west-1.compute.internal"
Oct 30 20:38:14.593639 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:14.593615    6004 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Oct 30 20:38:14.593753 ip-10-0-138-85 kubenswrapper[6004]: E1030 20:38:14.593658    6004 kubelet.go:3370] "Failed creating a mirror pod" err="pods \"kube-rbac-proxy-crio-ip-10-0-138-85.us-west-1.compute.internal\" already exists" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-85.us-west-1.compute.internal"
Oct 30 20:38:14.593916 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:14.593904    6004 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Oct 30 20:38:14.593990 ip-10-0-138-85 kubenswrapper[6004]: E1030 20:38:14.593926    6004 kubelet.go:3370] "Failed creating a mirror pod" err="pods \"kube-apiserver-proxy-ip-10-0-138-85.us-west-1.compute.internal\" already exists" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-85.us-west-1.compute.internal"
Oct 30 20:38:14.596575 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:14.596555    6004 kubelet_node_status.go:126] "Node was previously registered" node="ip-10-0-138-85.us-west-1.compute.internal"
Oct 30 20:38:14.596671 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:14.596620    6004 kubelet_node_status.go:80] "Successfully registered node" node="ip-10-0-138-85.us-west-1.compute.internal"
Oct 30 20:38:14.668733 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:14.668704    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/6d131c2bf86bd4364de095ada64f40ce-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-85.us-west-1.compute.internal\" (UID: \"6d131c2bf86bd4364de095ada64f40ce\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-85.us-west-1.compute.internal"
Oct 30 20:38:14.668907 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:14.668740    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6d131c2bf86bd4364de095ada64f40ce-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-85.us-west-1.compute.internal\" (UID: \"6d131c2bf86bd4364de095ada64f40ce\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-85.us-west-1.compute.internal"
Oct 30 20:38:14.668907 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:14.668760    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/9d0b6e5dd2bbef8c0c7895485f0fdbd3-config\") pod \"kube-apiserver-proxy-ip-10-0-138-85.us-west-1.compute.internal\" (UID: \"9d0b6e5dd2bbef8c0c7895485f0fdbd3\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-85.us-west-1.compute.internal"
Oct 30 20:38:14.769095 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:14.769034    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/6d131c2bf86bd4364de095ada64f40ce-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-85.us-west-1.compute.internal\" (UID: \"6d131c2bf86bd4364de095ada64f40ce\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-85.us-west-1.compute.internal"
Oct 30 20:38:14.769095 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:14.769074    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/6d131c2bf86bd4364de095ada64f40ce-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-85.us-west-1.compute.internal\" (UID: \"6d131c2bf86bd4364de095ada64f40ce\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-85.us-west-1.compute.internal"
Oct 30 20:38:14.769314 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:14.769132    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6d131c2bf86bd4364de095ada64f40ce-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-85.us-west-1.compute.internal\" (UID: \"6d131c2bf86bd4364de095ada64f40ce\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-85.us-west-1.compute.internal"
Oct 30 20:38:14.769314 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:14.769158    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/9d0b6e5dd2bbef8c0c7895485f0fdbd3-config\") pod \"kube-apiserver-proxy-ip-10-0-138-85.us-west-1.compute.internal\" (UID: \"9d0b6e5dd2bbef8c0c7895485f0fdbd3\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-85.us-west-1.compute.internal"
Oct 30 20:38:14.769314 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:14.769202    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/9d0b6e5dd2bbef8c0c7895485f0fdbd3-config\") pod \"kube-apiserver-proxy-ip-10-0-138-85.us-west-1.compute.internal\" (UID: \"9d0b6e5dd2bbef8c0c7895485f0fdbd3\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-85.us-west-1.compute.internal"
Oct 30 20:38:14.769314 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:14.769216    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6d131c2bf86bd4364de095ada64f40ce-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-85.us-west-1.compute.internal\" (UID: \"6d131c2bf86bd4364de095ada64f40ce\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-85.us-west-1.compute.internal"
Oct 30 20:38:15.154662 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.154627    6004 apiserver.go:52] "Watching apiserver"
Oct 30 20:38:15.282279 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.282252    6004 reflector.go:446] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Oct 30 20:38:15.283020 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.282989    6004 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-6489d8bf89-fqdw6","openshift-dns/node-resolver-t4227","openshift-ovn-kubernetes/ovnkube-node-mw7xm","openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-j7q2s","kube-system/konnectivity-agent-x6f58","openshift-network-operator/iptables-alerter-cll8f","kube-system/global-pull-secret-syncer-tvvd9","openshift-insights/insights-operator-7c4986d449-tvsdw","openshift-insights/periodic-gathering-c49f4-pnxgw","openshift-network-diagnostics/network-check-source-6f78d59f99-gqbfm","openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-mwm8h","openshift-monitoring/node-exporter-t4s4p","openshift-multus/multus-additional-cni-plugins-hmdcd","openshift-image-registry/node-ca-jnn4r","openshift-monitoring/cluster-monitoring-operator-884576c57-fl7nf","openshift-dns/dns-default-265zm","kube-system/kube-apiserver-proxy-ip-10-0-138-85.us-west-1.compute.internal","openshift-multus/network-metrics-daemon-mlctd","openshift-service-ca-operator/service-ca-operator-544d749c8c-gnfbh","kube-system/kas-connection-checker-685895c7c9-tvmvh","openshift-network-diagnostics/network-check-target-lqdtq","openshift-multus/multus-sxqtp","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-85.us-west-1.compute.internal","kube-system/kas-connection-checker-685895c7c9-tpsd4","openshift-kube-storage-version-migrator/migrator-66df5d496b-lnmmq","openshift-cluster-node-tuning-operator/tuned-zpr5c","openshift-kube-storage-version-migrator/migrator-66df5d496b-dpsvp","openshift-network-console/networking-console-plugin-86c478bb88-fl89x","openshift-image-registry/image-registry-57547d4649-8sjtp","kube-system/kas-connection-checker-685895c7c9-x8fpd","openshift-ingress-canary/ingress-canary-dhfg8","openshift-console-operator/console-operator-7cd56b8dbc-sb7ds","openshift-ingress/router-default-5b9d6cdd59-4g6mx","openshift-insights/insights-runtime-extractor-zz4wr","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qbnnn","openshift-image-registry/image-registry-6c5684fdcf-l5m76","openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-7d57c","openshift-service-ca/service-ca-5fffc97bdf-lswcr"]
Oct 30 20:38:15.324614 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.324584    6004 kubelet.go:3368] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-85.us-west-1.compute.internal"
Oct 30 20:38:15.324767 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.324737    6004 kubelet.go:3368] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-85.us-west-1.compute.internal"
Oct 30 20:38:15.335087 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.335041    6004 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-t4s4p"
Oct 30 20:38:15.337928 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.337907    6004 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"openshift-service-ca.crt\""
Oct 30 20:38:15.338215 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.338192    6004 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\""
Oct 30 20:38:15.338215 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.338200    6004 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\""
Oct 30 20:38:15.338335 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.338226    6004 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\""
Oct 30 20:38:15.338335 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.338239    6004 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"kube-root-ca.crt\""
Oct 30 20:38:15.338579 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.338564    6004 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\""
Oct 30 20:38:15.338759 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.338743    6004 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-config\""
Oct 30 20:38:15.338833 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.338753    6004 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\""
Oct 30 20:38:15.338833 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.338757    6004 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Oct 30 20:38:15.338833 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.338806    6004 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\""
Oct 30 20:38:15.338980 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.338927    6004 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Oct 30 20:38:15.338980 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.338966    6004 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\""
Oct 30 20:38:15.339694 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.339679    6004 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\""
Oct 30 20:38:15.340312 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.340286    6004 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\""
Oct 30 20:38:15.340312 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.340309    6004 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\""
Oct 30 20:38:15.340430 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.340327    6004 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\""
Oct 30 20:38:15.340430 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.340355    6004 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\""
Oct 30 20:38:15.340430 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.340358    6004 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\""
Oct 30 20:38:15.340617 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.340598    6004 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\""
Oct 30 20:38:15.340782 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.340620    6004 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\""
Oct 30 20:38:15.340782 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.340636    6004 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\""
Oct 30 20:38:15.340782 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.340653    6004 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Oct 30 20:38:15.340782 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.340671    6004 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\""
Oct 30 20:38:15.340782 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.340678    6004 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\""
Oct 30 20:38:15.340782 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.340690    6004 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Oct 30 20:38:15.341108 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.341091    6004 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Oct 30 20:38:15.341160 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.341117    6004 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\""
Oct 30 20:38:15.341238 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.341223    6004 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\""
Oct 30 20:38:15.342599 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.342552    6004 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\""
Oct 30 20:38:15.342662 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.342623    6004 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\""
Oct 30 20:38:15.342748 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.342731    6004 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\""
Oct 30 20:38:15.373582 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.373553    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0df457c5-5640-4c0d-9f71-94548c11397a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-zz4wr\" (UID: \"0df457c5-5640-4c0d-9f71-94548c11397a\") " pod="openshift-insights/insights-runtime-extractor-zz4wr"
Oct 30 20:38:15.373582 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.373583    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/16e71e18-453a-41bf-a3f8-9618482c9a50-tmp-dir\") pod \"node-resolver-t4227\" (UID: \"16e71e18-453a-41bf-a3f8-9618482c9a50\") " pod="openshift-dns/node-resolver-t4227"
Oct 30 20:38:15.373762 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.373600    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f2b6b\" (UniqueName: \"kubernetes.io/projected/519501c9-00d9-416f-887a-13b83aad5762-kube-api-access-f2b6b\") pod \"periodic-gathering-c49f4-pnxgw\" (UID: \"519501c9-00d9-416f-887a-13b83aad5762\") " pod="openshift-insights/periodic-gathering-c49f4-pnxgw"
Oct 30 20:38:15.373762 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.373616    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bkhhh\" (UniqueName: \"kubernetes.io/projected/2aee32c9-f358-4ff4-9d50-c18dba9885a5-kube-api-access-bkhhh\") pod \"image-registry-57547d4649-8sjtp\" (UID: \"2aee32c9-f358-4ff4-9d50-c18dba9885a5\") " pod="openshift-image-registry/image-registry-57547d4649-8sjtp"
Oct 30 20:38:15.373762 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.373632    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cd59fef4-66a5-471b-a8ef-18df25e44d5c-service-ca-bundle\") pod \"router-default-5b9d6cdd59-4g6mx\" (UID: \"cd59fef4-66a5-471b-a8ef-18df25e44d5c\") " pod="openshift-ingress/router-default-5b9d6cdd59-4g6mx"
Oct 30 20:38:15.373762 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.373651    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/d1fd1b0a-3831-4cb8-b6f3-ad2e67685188-telemetry-config\") pod \"cluster-monitoring-operator-884576c57-fl7nf\" (UID: \"d1fd1b0a-3831-4cb8-b6f3-ad2e67685188\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-fl7nf"
Oct 30 20:38:15.373762 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.373664    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/16e71e18-453a-41bf-a3f8-9618482c9a50-tmp-dir\") pod \"node-resolver-t4227\" (UID: \"16e71e18-453a-41bf-a3f8-9618482c9a50\") " pod="openshift-dns/node-resolver-t4227"
Oct 30 20:38:15.373762 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.373678    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ac7adab4-061f-4371-bc6c-96260eb988d8-multus-cni-dir\") pod \"multus-sxqtp\" (UID: \"ac7adab4-061f-4371-bc6c-96260eb988d8\") " pod="openshift-multus/multus-sxqtp"
Oct 30 20:38:15.373762 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.373746    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/ac7adab4-061f-4371-bc6c-96260eb988d8-multus-socket-dir-parent\") pod \"multus-sxqtp\" (UID: \"ac7adab4-061f-4371-bc6c-96260eb988d8\") " pod="openshift-multus/multus-sxqtp"
Oct 30 20:38:15.374098 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.373887    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cd59fef4-66a5-471b-a8ef-18df25e44d5c-service-ca-bundle\") pod \"router-default-5b9d6cdd59-4g6mx\" (UID: \"cd59fef4-66a5-471b-a8ef-18df25e44d5c\") " pod="openshift-ingress/router-default-5b9d6cdd59-4g6mx"
Oct 30 20:38:15.374098 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.373901    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mwd9g\" (UniqueName: \"kubernetes.io/projected/ac7adab4-061f-4371-bc6c-96260eb988d8-kube-api-access-mwd9g\") pod \"multus-sxqtp\" (UID: \"ac7adab4-061f-4371-bc6c-96260eb988d8\") " pod="openshift-multus/multus-sxqtp"
Oct 30 20:38:15.374098 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.373934    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0df457c5-5640-4c0d-9f71-94548c11397a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-zz4wr\" (UID: \"0df457c5-5640-4c0d-9f71-94548c11397a\") " pod="openshift-insights/insights-runtime-extractor-zz4wr"
Oct 30 20:38:15.374098 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.373953    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a4cdc725-3dd0-4917-b8a0-c8ff77a40abb-original-pull-secret\") pod \"global-pull-secret-syncer-tvvd9\" (UID: \"a4cdc725-3dd0-4917-b8a0-c8ff77a40abb\") " pod="kube-system/global-pull-secret-syncer-tvvd9"
Oct 30 20:38:15.374098 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.373990    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/16e71e18-453a-41bf-a3f8-9618482c9a50-hosts-file\") pod \"node-resolver-t4227\" (UID: \"16e71e18-453a-41bf-a3f8-9618482c9a50\") " pod="openshift-dns/node-resolver-t4227"
Oct 30 20:38:15.374378 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.374118    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/aaadd8de-58cb-45af-a477-384fbf1cf317-metrics-tls\") pod \"dns-default-265zm\" (UID: \"aaadd8de-58cb-45af-a477-384fbf1cf317\") " pod="openshift-dns/dns-default-265zm"
Oct 30 20:38:15.374378 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.374158    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5tcf2\" (UniqueName: \"kubernetes.io/projected/e5ac6e6d-4ea4-4874-b2eb-285977a285f7-kube-api-access-5tcf2\") pod \"network-check-source-6f78d59f99-gqbfm\" (UID: \"e5ac6e6d-4ea4-4874-b2eb-285977a285f7\") " pod="openshift-network-diagnostics/network-check-source-6f78d59f99-gqbfm"
Oct 30 20:38:15.374378 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.374181    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-htjnm\" (UniqueName: \"kubernetes.io/projected/0df457c5-5640-4c0d-9f71-94548c11397a-kube-api-access-htjnm\") pod \"insights-runtime-extractor-zz4wr\" (UID: \"0df457c5-5640-4c0d-9f71-94548c11397a\") " pod="openshift-insights/insights-runtime-extractor-zz4wr"
Oct 30 20:38:15.374378 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.374208    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rvdqt\" (UniqueName: \"kubernetes.io/projected/cd59fef4-66a5-471b-a8ef-18df25e44d5c-kube-api-access-rvdqt\") pod \"router-default-5b9d6cdd59-4g6mx\" (UID: \"cd59fef4-66a5-471b-a8ef-18df25e44d5c\") " pod="openshift-ingress/router-default-5b9d6cdd59-4g6mx"
Oct 30 20:38:15.374378 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.374226    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/780e67fb-196e-485a-8aa4-e11cecdc4b63-sys-fs\") pod \"aws-ebs-csi-driver-node-qbnnn\" (UID: \"780e67fb-196e-485a-8aa4-e11cecdc4b63\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qbnnn"
Oct 30 20:38:15.374378 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.374242    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ldfgb\" (UniqueName: \"kubernetes.io/projected/f31c8037-8b3e-4e1b-a363-fdca6686beb5-kube-api-access-ldfgb\") pod \"service-ca-5fffc97bdf-lswcr\" (UID: \"f31c8037-8b3e-4e1b-a363-fdca6686beb5\") " pod="openshift-service-ca/service-ca-5fffc97bdf-lswcr"
Oct 30 20:38:15.374378 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.374259    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/73676585-4ea4-43cb-af99-b4716472fb15-networking-console-plugin-cert\") pod \"networking-console-plugin-86c478bb88-fl89x\" (UID: \"73676585-4ea4-43cb-af99-b4716472fb15\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-fl89x"
Oct 30 20:38:15.374378 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.374274    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/1dc89e41-1e32-476f-b5fc-e45945a45efd-etc-modprobe-d\") pod \"tuned-zpr5c\" (UID: \"1dc89e41-1e32-476f-b5fc-e45945a45efd\") " pod="openshift-cluster-node-tuning-operator/tuned-zpr5c"
Oct 30 20:38:15.374378 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.374340    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/2aee32c9-f358-4ff4-9d50-c18dba9885a5-registry-certificates\") pod \"image-registry-57547d4649-8sjtp\" (UID: \"2aee32c9-f358-4ff4-9d50-c18dba9885a5\") " pod="openshift-image-registry/image-registry-57547d4649-8sjtp"
Oct 30 20:38:15.374718 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.374563    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j6vtn\" (UniqueName: \"kubernetes.io/projected/ee37dd25-4ac1-474f-80b8-d04da8da560c-kube-api-access-j6vtn\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-j7q2s\" (UID: \"ee37dd25-4ac1-474f-80b8-d04da8da560c\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-j7q2s"
Oct 30 20:38:15.374718 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.374616    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ac7adab4-061f-4371-bc6c-96260eb988d8-host-var-lib-kubelet\") pod \"multus-sxqtp\" (UID: \"ac7adab4-061f-4371-bc6c-96260eb988d8\") " pod="openshift-multus/multus-sxqtp"
Oct 30 20:38:15.374795 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.374777    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/0df457c5-5640-4c0d-9f71-94548c11397a-data-volume\") pod \"insights-runtime-extractor-zz4wr\" (UID: \"0df457c5-5640-4c0d-9f71-94548c11397a\") " pod="openshift-insights/insights-runtime-extractor-zz4wr"
Oct 30 20:38:15.374830 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.374808    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/cd59fef4-66a5-471b-a8ef-18df25e44d5c-stats-auth\") pod \"router-default-5b9d6cdd59-4g6mx\" (UID: \"cd59fef4-66a5-471b-a8ef-18df25e44d5c\") " pod="openshift-ingress/router-default-5b9d6cdd59-4g6mx"
Oct 30 20:38:15.374876 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.374835    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-49sfp\" (UniqueName: \"kubernetes.io/projected/780e67fb-196e-485a-8aa4-e11cecdc4b63-kube-api-access-49sfp\") pod \"aws-ebs-csi-driver-node-qbnnn\" (UID: \"780e67fb-196e-485a-8aa4-e11cecdc4b63\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qbnnn"
Oct 30 20:38:15.374876 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.374861    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1dc89e41-1e32-476f-b5fc-e45945a45efd-etc-kubernetes\") pod \"tuned-zpr5c\" (UID: \"1dc89e41-1e32-476f-b5fc-e45945a45efd\") " pod="openshift-cluster-node-tuning-operator/tuned-zpr5c"
Oct 30 20:38:15.374966 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.374897    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cjbpj\" (UniqueName: \"kubernetes.io/projected/d1fd1b0a-3831-4cb8-b6f3-ad2e67685188-kube-api-access-cjbpj\") pod \"cluster-monitoring-operator-884576c57-fl7nf\" (UID: \"d1fd1b0a-3831-4cb8-b6f3-ad2e67685188\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-fl7nf"
Oct 30 20:38:15.374966 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.374897    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/0df457c5-5640-4c0d-9f71-94548c11397a-data-volume\") pod \"insights-runtime-extractor-zz4wr\" (UID: \"0df457c5-5640-4c0d-9f71-94548c11397a\") " pod="openshift-insights/insights-runtime-extractor-zz4wr"
Oct 30 20:38:15.374966 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.374932    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hzklm\" (UniqueName: \"kubernetes.io/projected/aaadd8de-58cb-45af-a477-384fbf1cf317-kube-api-access-hzklm\") pod \"dns-default-265zm\" (UID: \"aaadd8de-58cb-45af-a477-384fbf1cf317\") " pod="openshift-dns/dns-default-265zm"
Oct 30 20:38:15.375151 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.374968    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/780e67fb-196e-485a-8aa4-e11cecdc4b63-kubelet-dir\") pod \"aws-ebs-csi-driver-node-qbnnn\" (UID: \"780e67fb-196e-485a-8aa4-e11cecdc4b63\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qbnnn"
Oct 30 20:38:15.375151 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.374997    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/1dc89e41-1e32-476f-b5fc-e45945a45efd-etc-sysctl-conf\") pod \"tuned-zpr5c\" (UID: \"1dc89e41-1e32-476f-b5fc-e45945a45efd\") " pod="openshift-cluster-node-tuning-operator/tuned-zpr5c"
Oct 30 20:38:15.375151 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.375026    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/1dc89e41-1e32-476f-b5fc-e45945a45efd-etc-systemd\") pod \"tuned-zpr5c\" (UID: \"1dc89e41-1e32-476f-b5fc-e45945a45efd\") " pod="openshift-cluster-node-tuning-operator/tuned-zpr5c"
Oct 30 20:38:15.375151 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.375088    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/cd59fef4-66a5-471b-a8ef-18df25e44d5c-stats-auth\") pod \"router-default-5b9d6cdd59-4g6mx\" (UID: \"cd59fef4-66a5-471b-a8ef-18df25e44d5c\") " pod="openshift-ingress/router-default-5b9d6cdd59-4g6mx"
Oct 30 20:38:15.375344 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.375156    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1dc89e41-1e32-476f-b5fc-e45945a45efd-var-lib-kubelet\") pod \"tuned-zpr5c\" (UID: \"1dc89e41-1e32-476f-b5fc-e45945a45efd\") " pod="openshift-cluster-node-tuning-operator/tuned-zpr5c"
Oct 30 20:38:15.375344 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.375191    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c2w8k\" (UniqueName: \"kubernetes.io/projected/16e71e18-453a-41bf-a3f8-9618482c9a50-kube-api-access-c2w8k\") pod \"node-resolver-t4227\" (UID: \"16e71e18-453a-41bf-a3f8-9618482c9a50\") " pod="openshift-dns/node-resolver-t4227"
Oct 30 20:38:15.375344 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.375332    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/1dc89e41-1e32-476f-b5fc-e45945a45efd-etc-sysconfig\") pod \"tuned-zpr5c\" (UID: \"1dc89e41-1e32-476f-b5fc-e45945a45efd\") " pod="openshift-cluster-node-tuning-operator/tuned-zpr5c"
Oct 30 20:38:15.375504 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.375355    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1dc89e41-1e32-476f-b5fc-e45945a45efd-sys\") pod \"tuned-zpr5c\" (UID: \"1dc89e41-1e32-476f-b5fc-e45945a45efd\") " pod="openshift-cluster-node-tuning-operator/tuned-zpr5c"
Oct 30 20:38:15.375504 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.375381    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ac7adab4-061f-4371-bc6c-96260eb988d8-host-var-lib-cni-bin\") pod \"multus-sxqtp\" (UID: \"ac7adab4-061f-4371-bc6c-96260eb988d8\") " pod="openshift-multus/multus-sxqtp"
Oct 30 20:38:15.375610 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.375586    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/2aee32c9-f358-4ff4-9d50-c18dba9885a5-installation-pull-secrets\") pod \"image-registry-57547d4649-8sjtp\" (UID: \"2aee32c9-f358-4ff4-9d50-c18dba9885a5\") " pod="openshift-image-registry/image-registry-57547d4649-8sjtp"
Oct 30 20:38:15.375660 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.375614    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2aee32c9-f358-4ff4-9d50-c18dba9885a5-bound-sa-token\") pod \"image-registry-57547d4649-8sjtp\" (UID: \"2aee32c9-f358-4ff4-9d50-c18dba9885a5\") " pod="openshift-image-registry/image-registry-57547d4649-8sjtp"
Oct 30 20:38:15.375660 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.375633    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ac7adab4-061f-4371-bc6c-96260eb988d8-system-cni-dir\") pod \"multus-sxqtp\" (UID: \"ac7adab4-061f-4371-bc6c-96260eb988d8\") " pod="openshift-multus/multus-sxqtp"
Oct 30 20:38:15.375734 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.375664    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/780e67fb-196e-485a-8aa4-e11cecdc4b63-socket-dir\") pod \"aws-ebs-csi-driver-node-qbnnn\" (UID: \"780e67fb-196e-485a-8aa4-e11cecdc4b63\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qbnnn"
Oct 30 20:38:15.375961 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.375946    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/2aee32c9-f358-4ff4-9d50-c18dba9885a5-ca-trust-extracted\") pod \"image-registry-57547d4649-8sjtp\" (UID: \"2aee32c9-f358-4ff4-9d50-c18dba9885a5\") " pod="openshift-image-registry/image-registry-57547d4649-8sjtp"
Oct 30 20:38:15.376076 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.376061    6004 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Oct 30 20:38:15.376129 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.376114    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/2aee32c9-f358-4ff4-9d50-c18dba9885a5-ca-trust-extracted\") pod \"image-registry-57547d4649-8sjtp\" (UID: \"2aee32c9-f358-4ff4-9d50-c18dba9885a5\") " pod="openshift-image-registry/image-registry-57547d4649-8sjtp"
Oct 30 20:38:15.376177 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.376157    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-72b4g\" (UniqueName: \"kubernetes.io/projected/793cb601-841f-4511-9b8f-ff30262611c2-kube-api-access-72b4g\") pod \"kas-connection-checker-685895c7c9-x8fpd\" (UID: \"793cb601-841f-4511-9b8f-ff30262611c2\") " pod="kube-system/kas-connection-checker-685895c7c9-x8fpd"
Oct 30 20:38:15.376208 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.376190    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/ee37dd25-4ac1-474f-80b8-d04da8da560c-serving-cert\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-j7q2s\" (UID: \"ee37dd25-4ac1-474f-80b8-d04da8da560c\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-j7q2s"
Oct 30 20:38:15.376287 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.376206    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ac7adab4-061f-4371-bc6c-96260eb988d8-host-run-netns\") pod \"multus-sxqtp\" (UID: \"ac7adab4-061f-4371-bc6c-96260eb988d8\") " pod="openshift-multus/multus-sxqtp"
Oct 30 20:38:15.376287 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.376221    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7z886\" (UniqueName: \"kubernetes.io/projected/6080982d-ff7c-47b2-8a0c-5a2fff21722b-kube-api-access-7z886\") pod \"migrator-66df5d496b-lnmmq\" (UID: \"6080982d-ff7c-47b2-8a0c-5a2fff21722b\") " pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-lnmmq"
Oct 30 20:38:15.376287 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.376243    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/519501c9-00d9-416f-887a-13b83aad5762-service-ca-bundle\") pod \"periodic-gathering-c49f4-pnxgw\" (UID: \"519501c9-00d9-416f-887a-13b83aad5762\") " pod="openshift-insights/periodic-gathering-c49f4-pnxgw"
Oct 30 20:38:15.376287 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.376280    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/f31c8037-8b3e-4e1b-a363-fdca6686beb5-signing-key\") pod \"service-ca-5fffc97bdf-lswcr\" (UID: \"f31c8037-8b3e-4e1b-a363-fdca6686beb5\") " pod="openshift-service-ca/service-ca-5fffc97bdf-lswcr"
Oct 30 20:38:15.376481 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.376353    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h8vbt\" (UniqueName: \"kubernetes.io/projected/f7ba0792-faca-42fd-8d0d-3499c5b7278f-kube-api-access-h8vbt\") pod \"migrator-66df5d496b-dpsvp\" (UID: \"f7ba0792-faca-42fd-8d0d-3499c5b7278f\") " pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-dpsvp"
Oct 30 20:38:15.376481 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.376381    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/aaadd8de-58cb-45af-a477-384fbf1cf317-config-volume\") pod \"dns-default-265zm\" (UID: \"aaadd8de-58cb-45af-a477-384fbf1cf317\") " pod="openshift-dns/dns-default-265zm"
Oct 30 20:38:15.376481 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.376408    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/cd59fef4-66a5-471b-a8ef-18df25e44d5c-default-certificate\") pod \"router-default-5b9d6cdd59-4g6mx\" (UID: \"cd59fef4-66a5-471b-a8ef-18df25e44d5c\") " pod="openshift-ingress/router-default-5b9d6cdd59-4g6mx"
Oct 30 20:38:15.376481 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.376432    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/caca5f60-f777-4672-b570-faa422073cb9-cert\") pod \"ingress-canary-dhfg8\" (UID: \"caca5f60-f777-4672-b570-faa422073cb9\") " pod="openshift-ingress-canary/ingress-canary-dhfg8"
Oct 30 20:38:15.376481 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.376457    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/519501c9-00d9-416f-887a-13b83aad5762-trusted-ca-bundle\") pod \"periodic-gathering-c49f4-pnxgw\" (UID: \"519501c9-00d9-416f-887a-13b83aad5762\") " pod="openshift-insights/periodic-gathering-c49f4-pnxgw"
Oct 30 20:38:15.376717 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.376482    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/d1fd1b0a-3831-4cb8-b6f3-ad2e67685188-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-884576c57-fl7nf\" (UID: \"d1fd1b0a-3831-4cb8-b6f3-ad2e67685188\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-fl7nf"
Oct 30 20:38:15.376717 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.376549    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2aee32c9-f358-4ff4-9d50-c18dba9885a5-registry-tls\") pod \"image-registry-57547d4649-8sjtp\" (UID: \"2aee32c9-f358-4ff4-9d50-c18dba9885a5\") " pod="openshift-image-registry/image-registry-57547d4649-8sjtp"
Oct 30 20:38:15.376717 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.376574    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/aaadd8de-58cb-45af-a477-384fbf1cf317-tmp-dir\") pod \"dns-default-265zm\" (UID: \"aaadd8de-58cb-45af-a477-384fbf1cf317\") " pod="openshift-dns/dns-default-265zm"
Oct 30 20:38:15.376717 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.376593    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/ac7adab4-061f-4371-bc6c-96260eb988d8-host-run-multus-certs\") pod \"multus-sxqtp\" (UID: \"ac7adab4-061f-4371-bc6c-96260eb988d8\") " pod="openshift-multus/multus-sxqtp"
Oct 30 20:38:15.376717 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.376609    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/780e67fb-196e-485a-8aa4-e11cecdc4b63-device-dir\") pod \"aws-ebs-csi-driver-node-qbnnn\" (UID: \"780e67fb-196e-485a-8aa4-e11cecdc4b63\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qbnnn"
Oct 30 20:38:15.376717 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.376623    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/ee37dd25-4ac1-474f-80b8-d04da8da560c-serving-cert\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-j7q2s\" (UID: \"ee37dd25-4ac1-474f-80b8-d04da8da560c\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-j7q2s"
Oct 30 20:38:15.376717 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.376633    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/2aee32c9-f358-4ff4-9d50-c18dba9885a5-trusted-ca\") pod \"image-registry-57547d4649-8sjtp\" (UID: \"2aee32c9-f358-4ff4-9d50-c18dba9885a5\") " pod="openshift-image-registry/image-registry-57547d4649-8sjtp"
Oct 30 20:38:15.376717 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.376659    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nnz7p\" (UniqueName: \"kubernetes.io/projected/db64c15b-58b0-4829-b702-de7b6c846ab4-kube-api-access-nnz7p\") pod \"kas-connection-checker-685895c7c9-tpsd4\" (UID: \"db64c15b-58b0-4829-b702-de7b6c846ab4\") " pod="kube-system/kas-connection-checker-685895c7c9-tpsd4"
Oct 30 20:38:15.376717 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.376659    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/aaadd8de-58cb-45af-a477-384fbf1cf317-tmp-dir\") pod \"dns-default-265zm\" (UID: \"aaadd8de-58cb-45af-a477-384fbf1cf317\") " pod="openshift-dns/dns-default-265zm"
Oct 30 20:38:15.376717 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.376677    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/a4cdc725-3dd0-4917-b8a0-c8ff77a40abb-dbus\") pod \"global-pull-secret-syncer-tvvd9\" (UID: \"a4cdc725-3dd0-4917-b8a0-c8ff77a40abb\") " pod="kube-system/global-pull-secret-syncer-tvvd9"
Oct 30 20:38:15.376717 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.376679    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/cd59fef4-66a5-471b-a8ef-18df25e44d5c-default-certificate\") pod \"router-default-5b9d6cdd59-4g6mx\" (UID: \"cd59fef4-66a5-471b-a8ef-18df25e44d5c\") " pod="openshift-ingress/router-default-5b9d6cdd59-4g6mx"
Oct 30 20:38:15.376717 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.376713    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cd59fef4-66a5-471b-a8ef-18df25e44d5c-metrics-certs\") pod \"router-default-5b9d6cdd59-4g6mx\" (UID: \"cd59fef4-66a5-471b-a8ef-18df25e44d5c\") " pod="openshift-ingress/router-default-5b9d6cdd59-4g6mx"
Oct 30 20:38:15.377131 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.376743    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/1dc89e41-1e32-476f-b5fc-e45945a45efd-etc-sysctl-d\") pod \"tuned-zpr5c\" (UID: \"1dc89e41-1e32-476f-b5fc-e45945a45efd\") " pod="openshift-cluster-node-tuning-operator/tuned-zpr5c"
Oct 30 20:38:15.377131 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.376771    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/ee37dd25-4ac1-474f-80b8-d04da8da560c-config\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-j7q2s\" (UID: \"ee37dd25-4ac1-474f-80b8-d04da8da560c\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-j7q2s"
Oct 30 20:38:15.377131 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.376815    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/ac7adab4-061f-4371-bc6c-96260eb988d8-host-var-lib-cni-multus\") pod \"multus-sxqtp\" (UID: \"ac7adab4-061f-4371-bc6c-96260eb988d8\") " pod="openshift-multus/multus-sxqtp"
Oct 30 20:38:15.377131 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.376852    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/519501c9-00d9-416f-887a-13b83aad5762-service-ca-bundle\") pod \"periodic-gathering-c49f4-pnxgw\" (UID: \"519501c9-00d9-416f-887a-13b83aad5762\") " pod="openshift-insights/periodic-gathering-c49f4-pnxgw"
Oct 30 20:38:15.377131 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.376857    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mgww7\" (UniqueName: \"kubernetes.io/projected/caca5f60-f777-4672-b570-faa422073cb9-kube-api-access-mgww7\") pod \"ingress-canary-dhfg8\" (UID: \"caca5f60-f777-4672-b570-faa422073cb9\") " pod="openshift-ingress-canary/ingress-canary-dhfg8"
Oct 30 20:38:15.377131 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.376895    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/73676585-4ea4-43cb-af99-b4716472fb15-nginx-conf\") pod \"networking-console-plugin-86c478bb88-fl89x\" (UID: \"73676585-4ea4-43cb-af99-b4716472fb15\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-fl89x"
Oct 30 20:38:15.377131 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.376936    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cd59fef4-66a5-471b-a8ef-18df25e44d5c-metrics-certs\") pod \"router-default-5b9d6cdd59-4g6mx\" (UID: \"cd59fef4-66a5-471b-a8ef-18df25e44d5c\") " pod="openshift-ingress/router-default-5b9d6cdd59-4g6mx"
Oct 30 20:38:15.377131 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.376944    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/1dc89e41-1e32-476f-b5fc-e45945a45efd-run\") pod \"tuned-zpr5c\" (UID: \"1dc89e41-1e32-476f-b5fc-e45945a45efd\") " pod="openshift-cluster-node-tuning-operator/tuned-zpr5c"
Oct 30 20:38:15.377131 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.376964    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/ee37dd25-4ac1-474f-80b8-d04da8da560c-config\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-j7q2s\" (UID: \"ee37dd25-4ac1-474f-80b8-d04da8da560c\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-j7q2s"
Oct 30 20:38:15.377131 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.376987    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/ac7adab4-061f-4371-bc6c-96260eb988d8-hostroot\") pod \"multus-sxqtp\" (UID: \"ac7adab4-061f-4371-bc6c-96260eb988d8\") " pod="openshift-multus/multus-sxqtp"
Oct 30 20:38:15.377131 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.377030    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ac7adab4-061f-4371-bc6c-96260eb988d8-etc-kubernetes\") pod \"multus-sxqtp\" (UID: \"ac7adab4-061f-4371-bc6c-96260eb988d8\") " pod="openshift-multus/multus-sxqtp"
Oct 30 20:38:15.377131 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.377085    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/a4cdc725-3dd0-4917-b8a0-c8ff77a40abb-kubelet-config\") pod \"global-pull-secret-syncer-tvvd9\" (UID: \"a4cdc725-3dd0-4917-b8a0-c8ff77a40abb\") " pod="kube-system/global-pull-secret-syncer-tvvd9"
Oct 30 20:38:15.377131 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.377112    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/780e67fb-196e-485a-8aa4-e11cecdc4b63-etc-selinux\") pod \"aws-ebs-csi-driver-node-qbnnn\" (UID: \"780e67fb-196e-485a-8aa4-e11cecdc4b63\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qbnnn"
Oct 30 20:38:15.377131 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.377131    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/f31c8037-8b3e-4e1b-a363-fdca6686beb5-signing-cabundle\") pod \"service-ca-5fffc97bdf-lswcr\" (UID: \"f31c8037-8b3e-4e1b-a363-fdca6686beb5\") " pod="openshift-service-ca/service-ca-5fffc97bdf-lswcr"
Oct 30 20:38:15.377723 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.377213    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1dc89e41-1e32-476f-b5fc-e45945a45efd-lib-modules\") pod \"tuned-zpr5c\" (UID: \"1dc89e41-1e32-476f-b5fc-e45945a45efd\") " pod="openshift-cluster-node-tuning-operator/tuned-zpr5c"
Oct 30 20:38:15.377723 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.377251    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/0df457c5-5640-4c0d-9f71-94548c11397a-crio-socket\") pod \"insights-runtime-extractor-zz4wr\" (UID: \"0df457c5-5640-4c0d-9f71-94548c11397a\") " pod="openshift-insights/insights-runtime-extractor-zz4wr"
Oct 30 20:38:15.377723 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.377292    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/2aee32c9-f358-4ff4-9d50-c18dba9885a5-image-registry-private-configuration\") pod \"image-registry-57547d4649-8sjtp\" (UID: \"2aee32c9-f358-4ff4-9d50-c18dba9885a5\") " pod="openshift-image-registry/image-registry-57547d4649-8sjtp"
Oct 30 20:38:15.377723 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.377352    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ac7adab4-061f-4371-bc6c-96260eb988d8-cnibin\") pod \"multus-sxqtp\" (UID: \"ac7adab4-061f-4371-bc6c-96260eb988d8\") " pod="openshift-multus/multus-sxqtp"
Oct 30 20:38:15.377723 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.377408    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/ac7adab4-061f-4371-bc6c-96260eb988d8-multus-daemon-config\") pod \"multus-sxqtp\" (UID: \"ac7adab4-061f-4371-bc6c-96260eb988d8\") " pod="openshift-multus/multus-sxqtp"
Oct 30 20:38:15.377723 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.377444    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/780e67fb-196e-485a-8aa4-e11cecdc4b63-registration-dir\") pod \"aws-ebs-csi-driver-node-qbnnn\" (UID: \"780e67fb-196e-485a-8aa4-e11cecdc4b63\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qbnnn"
Oct 30 20:38:15.377723 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.377487    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"archives-path\" (UniqueName: \"kubernetes.io/empty-dir/519501c9-00d9-416f-887a-13b83aad5762-archives-path\") pod \"periodic-gathering-c49f4-pnxgw\" (UID: \"519501c9-00d9-416f-887a-13b83aad5762\") " pod="openshift-insights/periodic-gathering-c49f4-pnxgw"
Oct 30 20:38:15.377723 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.377542    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"archives-path\" (UniqueName: \"kubernetes.io/empty-dir/519501c9-00d9-416f-887a-13b83aad5762-archives-path\") pod \"periodic-gathering-c49f4-pnxgw\" (UID: \"519501c9-00d9-416f-887a-13b83aad5762\") " pod="openshift-insights/periodic-gathering-c49f4-pnxgw"
Oct 30 20:38:15.377723 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.377564    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7qzv8\" (UniqueName: \"kubernetes.io/projected/50e37bd4-e46f-4577-b7b2-1ac7695637ea-kube-api-access-7qzv8\") pod \"network-check-target-lqdtq\" (UID: \"50e37bd4-e46f-4577-b7b2-1ac7695637ea\") " pod="openshift-network-diagnostics/network-check-target-lqdtq"
Oct 30 20:38:15.377723 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.377593    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ac7adab4-061f-4371-bc6c-96260eb988d8-cni-binary-copy\") pod \"multus-sxqtp\" (UID: \"ac7adab4-061f-4371-bc6c-96260eb988d8\") " pod="openshift-multus/multus-sxqtp"
Oct 30 20:38:15.377723 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.377620    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/ac7adab4-061f-4371-bc6c-96260eb988d8-host-run-k8s-cni-cncf-io\") pod \"multus-sxqtp\" (UID: \"ac7adab4-061f-4371-bc6c-96260eb988d8\") " pod="openshift-multus/multus-sxqtp"
Oct 30 20:38:15.377723 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.377654    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ac7adab4-061f-4371-bc6c-96260eb988d8-multus-conf-dir\") pod \"multus-sxqtp\" (UID: \"ac7adab4-061f-4371-bc6c-96260eb988d8\") " pod="openshift-multus/multus-sxqtp"
Oct 30 20:38:15.389018 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.388993    6004 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\""
Oct 30 20:38:15.389226 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.389203    6004 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\""
Oct 30 20:38:15.389338 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.389258    6004 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Oct 30 20:38:15.389418 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.389404    6004 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Oct 30 20:38:15.389467 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.389447    6004 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Oct 30 20:38:15.389771 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.389754    6004 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Oct 30 20:38:15.389829 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.389803    6004 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Oct 30 20:38:15.389898 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.389885    6004 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-bhpnj\""
Oct 30 20:38:15.389933 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.389903    6004 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Oct 30 20:38:15.390217 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.390201    6004 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\""
Oct 30 20:38:15.390654 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.390639    6004 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\""
Oct 30 20:38:15.390699 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.390655    6004 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-95cqb\""
Oct 30 20:38:15.390952 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.390939    6004 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-86vxf\""
Oct 30 20:38:15.391041 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.390954    6004 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-4lpn7\""
Oct 30 20:38:15.391041 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.390965    6004 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-bmpds\""
Oct 30 20:38:15.391041 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.390982    6004 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Oct 30 20:38:15.391041 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.391000    6004 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-jwfqc\""
Oct 30 20:38:15.391041 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.391015    6004 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-wsjv8\""
Oct 30 20:38:15.391041 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.391018    6004 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-2srwc\""
Oct 30 20:38:15.391041 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.391020    6004 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-lqzxz\""
Oct 30 20:38:15.391373 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.391093    6004 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"ingress-canary-dockercfg-h8n42\""
Oct 30 20:38:15.391373 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.391102    6004 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-dockercfg-9qsb8\""
Oct 30 20:38:15.391373 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.391108    6004 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Oct 30 20:38:15.391373 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.391152    6004 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\""
Oct 30 20:38:15.391373 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.391209    6004 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-node-identity-dockercfg-rv75s\""
Oct 30 20:38:15.391373 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.391252    6004 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-check-target-dockercfg-hjmcj\""
Oct 30 20:38:15.391373 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.391259    6004 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent-dockercfg-c5chh\""
Oct 30 20:38:15.391645 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.391391    6004 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-nvzwj\""
Oct 30 20:38:15.391645 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.391404    6004 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Oct 30 20:38:15.391645 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.391413    6004 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Oct 30 20:38:15.391645 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.391500    6004 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-g2pwr\""
Oct 30 20:38:15.391645 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.391549    6004 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-94s75\""
Oct 30 20:38:15.391645 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.391610    6004 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"global-pull-secret-syncer-dockercfg-49f2v\""
Oct 30 20:38:15.391823 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.391661    6004 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-sr85n\""
Oct 30 20:38:15.391823 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.391713    6004 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\""
Oct 30 20:38:15.394327 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.394312    6004 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Oct 30 20:38:15.394382 ip-10-0-138-85 kubenswrapper[6004]: E1030 20:38:15.394373    6004 kubelet.go:3370] "Failed creating a mirror pod" err="pods \"kube-apiserver-proxy-ip-10-0-138-85.us-west-1.compute.internal\" already exists" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-85.us-west-1.compute.internal"
Oct 30 20:38:15.394451 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.394434    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/aaadd8de-58cb-45af-a477-384fbf1cf317-metrics-tls\") pod \"dns-default-265zm\" (UID: \"aaadd8de-58cb-45af-a477-384fbf1cf317\") " pod="openshift-dns/dns-default-265zm"
Oct 30 20:38:15.394537 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.394521    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0df457c5-5640-4c0d-9f71-94548c11397a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-zz4wr\" (UID: \"0df457c5-5640-4c0d-9f71-94548c11397a\") " pod="openshift-insights/insights-runtime-extractor-zz4wr"
Oct 30 20:38:15.394583 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.394537    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a4cdc725-3dd0-4917-b8a0-c8ff77a40abb-original-pull-secret\") pod \"global-pull-secret-syncer-tvvd9\" (UID: \"a4cdc725-3dd0-4917-b8a0-c8ff77a40abb\") " pod="kube-system/global-pull-secret-syncer-tvvd9"
Oct 30 20:38:15.394616 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.394609    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/73676585-4ea4-43cb-af99-b4716472fb15-networking-console-plugin-cert\") pod \"networking-console-plugin-86c478bb88-fl89x\" (UID: \"73676585-4ea4-43cb-af99-b4716472fb15\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-fl89x"
Oct 30 20:38:15.394821 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.394804    6004 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Oct 30 20:38:15.394864 ip-10-0-138-85 kubenswrapper[6004]: E1030 20:38:15.394852    6004 kubelet.go:3370] "Failed creating a mirror pod" err="pods \"kube-rbac-proxy-crio-ip-10-0-138-85.us-west-1.compute.internal\" already exists" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-85.us-west-1.compute.internal"
Oct 30 20:38:15.397129 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.397113    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/f31c8037-8b3e-4e1b-a363-fdca6686beb5-signing-key\") pod \"service-ca-5fffc97bdf-lswcr\" (UID: \"f31c8037-8b3e-4e1b-a363-fdca6686beb5\") " pod="openshift-service-ca/service-ca-5fffc97bdf-lswcr"
Oct 30 20:38:15.397201 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.397184    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2aee32c9-f358-4ff4-9d50-c18dba9885a5-registry-tls\") pod \"image-registry-57547d4649-8sjtp\" (UID: \"2aee32c9-f358-4ff4-9d50-c18dba9885a5\") " pod="openshift-image-registry/image-registry-57547d4649-8sjtp"
Oct 30 20:38:15.397242 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.397217    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/d1fd1b0a-3831-4cb8-b6f3-ad2e67685188-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-884576c57-fl7nf\" (UID: \"d1fd1b0a-3831-4cb8-b6f3-ad2e67685188\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-fl7nf"
Oct 30 20:38:15.397296 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.397274    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/caca5f60-f777-4672-b570-faa422073cb9-cert\") pod \"ingress-canary-dhfg8\" (UID: \"caca5f60-f777-4672-b570-faa422073cb9\") " pod="openshift-ingress-canary/ingress-canary-dhfg8"
Oct 30 20:38:15.397352 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.397338    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/519501c9-00d9-416f-887a-13b83aad5762-trusted-ca-bundle\") pod \"periodic-gathering-c49f4-pnxgw\" (UID: \"519501c9-00d9-416f-887a-13b83aad5762\") " pod="openshift-insights/periodic-gathering-c49f4-pnxgw"
Oct 30 20:38:15.398422 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.398407    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/2aee32c9-f358-4ff4-9d50-c18dba9885a5-image-registry-private-configuration\") pod \"image-registry-57547d4649-8sjtp\" (UID: \"2aee32c9-f358-4ff4-9d50-c18dba9885a5\") " pod="openshift-image-registry/image-registry-57547d4649-8sjtp"
Oct 30 20:38:15.431093 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.431073    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-htjnm\" (UniqueName: \"kubernetes.io/projected/0df457c5-5640-4c0d-9f71-94548c11397a-kube-api-access-htjnm\") pod \"insights-runtime-extractor-zz4wr\" (UID: \"0df457c5-5640-4c0d-9f71-94548c11397a\") " pod="openshift-insights/insights-runtime-extractor-zz4wr"
Oct 30 20:38:15.431486 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.431463    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rvdqt\" (UniqueName: \"kubernetes.io/projected/cd59fef4-66a5-471b-a8ef-18df25e44d5c-kube-api-access-rvdqt\") pod \"router-default-5b9d6cdd59-4g6mx\" (UID: \"cd59fef4-66a5-471b-a8ef-18df25e44d5c\") " pod="openshift-ingress/router-default-5b9d6cdd59-4g6mx"
Oct 30 20:38:15.431702 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.431689    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f2b6b\" (UniqueName: \"kubernetes.io/projected/519501c9-00d9-416f-887a-13b83aad5762-kube-api-access-f2b6b\") pod \"periodic-gathering-c49f4-pnxgw\" (UID: \"519501c9-00d9-416f-887a-13b83aad5762\") " pod="openshift-insights/periodic-gathering-c49f4-pnxgw"
Oct 30 20:38:15.433645 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.433619    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j6vtn\" (UniqueName: \"kubernetes.io/projected/ee37dd25-4ac1-474f-80b8-d04da8da560c-kube-api-access-j6vtn\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-j7q2s\" (UID: \"ee37dd25-4ac1-474f-80b8-d04da8da560c\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-j7q2s"
Oct 30 20:38:15.433923 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.433907    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2aee32c9-f358-4ff4-9d50-c18dba9885a5-bound-sa-token\") pod \"image-registry-57547d4649-8sjtp\" (UID: \"2aee32c9-f358-4ff4-9d50-c18dba9885a5\") " pod="openshift-image-registry/image-registry-57547d4649-8sjtp"
Oct 30 20:38:15.433984 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.433971    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-72b4g\" (UniqueName: \"kubernetes.io/projected/793cb601-841f-4511-9b8f-ff30262611c2-kube-api-access-72b4g\") pod \"kas-connection-checker-685895c7c9-x8fpd\" (UID: \"793cb601-841f-4511-9b8f-ff30262611c2\") " pod="kube-system/kas-connection-checker-685895c7c9-x8fpd"
Oct 30 20:38:15.442807 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.442786    6004 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Oct 30 20:38:15.442902 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.442848    6004 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Oct 30 20:38:15.442902 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.442848    6004 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Oct 30 20:38:15.442902 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.442852    6004 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Oct 30 20:38:15.442902 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.442873    6004 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Oct 30 20:38:15.443136 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.442944    6004 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Oct 30 20:38:15.443136 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.442973    6004 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Oct 30 20:38:15.443136 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.443000    6004 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Oct 30 20:38:15.443136 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.443008    6004 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Oct 30 20:38:15.443136 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.443012    6004 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Oct 30 20:38:15.443136 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.443105    6004 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Oct 30 20:38:15.443136 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.443116    6004 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Oct 30 20:38:15.443136 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.443119    6004 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Oct 30 20:38:15.443487 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.443154    6004 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Oct 30 20:38:15.443487 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.443162    6004 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\""
Oct 30 20:38:15.443487 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.443193    6004 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\""
Oct 30 20:38:15.443487 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.443215    6004 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Oct 30 20:38:15.443487 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.443210    6004 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Oct 30 20:38:15.443487 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.443223    6004 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\""
Oct 30 20:38:15.443487 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.443316    6004 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\""
Oct 30 20:38:15.443487 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.443359    6004 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\""
Oct 30 20:38:15.443487 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.443463    6004 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Oct 30 20:38:15.443487 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.443484    6004 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Oct 30 20:38:15.443487 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.443492    6004 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Oct 30 20:38:15.443859 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.443492    6004 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Oct 30 20:38:15.443859 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.443498    6004 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Oct 30 20:38:15.443859 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.443519    6004 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Oct 30 20:38:15.443859 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.443530    6004 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Oct 30 20:38:15.443859 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.443535    6004 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Oct 30 20:38:15.443859 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.443532    6004 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Oct 30 20:38:15.443859 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.443759    6004 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Oct 30 20:38:15.443859 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.443827    6004 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Oct 30 20:38:15.444271 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.443876    6004 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Oct 30 20:38:15.444271 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.443878    6004 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-2xphj\""
Oct 30 20:38:15.444271 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.443915    6004 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Oct 30 20:38:15.444271 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.443964    6004 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Oct 30 20:38:15.444271 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.443967    6004 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-gdl6w\""
Oct 30 20:38:15.444271 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.444017    6004 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Oct 30 20:38:15.444271 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.444068    6004 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Oct 30 20:38:15.444271 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.444092    6004 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Oct 30 20:38:15.444271 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.444137    6004 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Oct 30 20:38:15.444271 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.444137    6004 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\""
Oct 30 20:38:15.444271 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.444170    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-49sfp\" (UniqueName: \"kubernetes.io/projected/780e67fb-196e-485a-8aa4-e11cecdc4b63-kube-api-access-49sfp\") pod \"aws-ebs-csi-driver-node-qbnnn\" (UID: \"780e67fb-196e-485a-8aa4-e11cecdc4b63\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qbnnn"
Oct 30 20:38:15.444764 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.444573    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c2w8k\" (UniqueName: \"kubernetes.io/projected/16e71e18-453a-41bf-a3f8-9618482c9a50-kube-api-access-c2w8k\") pod \"node-resolver-t4227\" (UID: \"16e71e18-453a-41bf-a3f8-9618482c9a50\") " pod="openshift-dns/node-resolver-t4227"
Oct 30 20:38:15.444764 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.444651    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cjbpj\" (UniqueName: \"kubernetes.io/projected/d1fd1b0a-3831-4cb8-b6f3-ad2e67685188-kube-api-access-cjbpj\") pod \"cluster-monitoring-operator-884576c57-fl7nf\" (UID: \"d1fd1b0a-3831-4cb8-b6f3-ad2e67685188\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-fl7nf"
Oct 30 20:38:15.444764 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.444722    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/2aee32c9-f358-4ff4-9d50-c18dba9885a5-registry-certificates\") pod \"image-registry-57547d4649-8sjtp\" (UID: \"2aee32c9-f358-4ff4-9d50-c18dba9885a5\") " pod="openshift-image-registry/image-registry-57547d4649-8sjtp"
Oct 30 20:38:15.444933 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.444914    6004 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-dmr5l\""
Oct 30 20:38:15.445085 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.444629    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hzklm\" (UniqueName: \"kubernetes.io/projected/aaadd8de-58cb-45af-a477-384fbf1cf317-kube-api-access-hzklm\") pod \"dns-default-265zm\" (UID: \"aaadd8de-58cb-45af-a477-384fbf1cf317\") " pod="openshift-dns/dns-default-265zm"
Oct 30 20:38:15.445285 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.445271    6004 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Oct 30 20:38:15.445326 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.445281    6004 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\""
Oct 30 20:38:15.445326 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.445322    6004 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Oct 30 20:38:15.445541 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.445528    6004 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Oct 30 20:38:15.446110 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.446093    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/2aee32c9-f358-4ff4-9d50-c18dba9885a5-installation-pull-secrets\") pod \"image-registry-57547d4649-8sjtp\" (UID: \"2aee32c9-f358-4ff4-9d50-c18dba9885a5\") " pod="openshift-image-registry/image-registry-57547d4649-8sjtp"
Oct 30 20:38:15.446595 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.446574    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7z886\" (UniqueName: \"kubernetes.io/projected/6080982d-ff7c-47b2-8a0c-5a2fff21722b-kube-api-access-7z886\") pod \"migrator-66df5d496b-lnmmq\" (UID: \"6080982d-ff7c-47b2-8a0c-5a2fff21722b\") " pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-lnmmq"
Oct 30 20:38:15.446595 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.446583    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nnz7p\" (UniqueName: \"kubernetes.io/projected/db64c15b-58b0-4829-b702-de7b6c846ab4-kube-api-access-nnz7p\") pod \"kas-connection-checker-685895c7c9-tpsd4\" (UID: \"db64c15b-58b0-4829-b702-de7b6c846ab4\") " pod="kube-system/kas-connection-checker-685895c7c9-tpsd4"
Oct 30 20:38:15.446686 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.446622    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/aaadd8de-58cb-45af-a477-384fbf1cf317-config-volume\") pod \"dns-default-265zm\" (UID: \"aaadd8de-58cb-45af-a477-384fbf1cf317\") " pod="openshift-dns/dns-default-265zm"
Oct 30 20:38:15.446899 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.446881    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h8vbt\" (UniqueName: \"kubernetes.io/projected/f7ba0792-faca-42fd-8d0d-3499c5b7278f-kube-api-access-h8vbt\") pod \"migrator-66df5d496b-dpsvp\" (UID: \"f7ba0792-faca-42fd-8d0d-3499c5b7278f\") " pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-dpsvp"
Oct 30 20:38:15.447396 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.447380    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7qzv8\" (UniqueName: \"kubernetes.io/projected/50e37bd4-e46f-4577-b7b2-1ac7695637ea-kube-api-access-7qzv8\") pod \"network-check-target-lqdtq\" (UID: \"50e37bd4-e46f-4577-b7b2-1ac7695637ea\") " pod="openshift-network-diagnostics/network-check-target-lqdtq"
Oct 30 20:38:15.447473 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.447457    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/2aee32c9-f358-4ff4-9d50-c18dba9885a5-trusted-ca\") pod \"image-registry-57547d4649-8sjtp\" (UID: \"2aee32c9-f358-4ff4-9d50-c18dba9885a5\") " pod="openshift-image-registry/image-registry-57547d4649-8sjtp"
Oct 30 20:38:15.447591 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.447566    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/f31c8037-8b3e-4e1b-a363-fdca6686beb5-signing-cabundle\") pod \"service-ca-5fffc97bdf-lswcr\" (UID: \"f31c8037-8b3e-4e1b-a363-fdca6686beb5\") " pod="openshift-service-ca/service-ca-5fffc97bdf-lswcr"
Oct 30 20:38:15.447681 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.447626    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/73676585-4ea4-43cb-af99-b4716472fb15-nginx-conf\") pod \"networking-console-plugin-86c478bb88-fl89x\" (UID: \"73676585-4ea4-43cb-af99-b4716472fb15\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-fl89x"
Oct 30 20:38:15.447681 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.447666    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/ac7adab4-061f-4371-bc6c-96260eb988d8-multus-daemon-config\") pod \"multus-sxqtp\" (UID: \"ac7adab4-061f-4371-bc6c-96260eb988d8\") " pod="openshift-multus/multus-sxqtp"
Oct 30 20:38:15.447785 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.447773    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ac7adab4-061f-4371-bc6c-96260eb988d8-cni-binary-copy\") pod \"multus-sxqtp\" (UID: \"ac7adab4-061f-4371-bc6c-96260eb988d8\") " pod="openshift-multus/multus-sxqtp"
Oct 30 20:38:15.449259 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.449239    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mgww7\" (UniqueName: \"kubernetes.io/projected/caca5f60-f777-4672-b570-faa422073cb9-kube-api-access-mgww7\") pod \"ingress-canary-dhfg8\" (UID: \"caca5f60-f777-4672-b570-faa422073cb9\") " pod="openshift-ingress-canary/ingress-canary-dhfg8"
Oct 30 20:38:15.451436 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.451414    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mwd9g\" (UniqueName: \"kubernetes.io/projected/ac7adab4-061f-4371-bc6c-96260eb988d8-kube-api-access-mwd9g\") pod \"multus-sxqtp\" (UID: \"ac7adab4-061f-4371-bc6c-96260eb988d8\") " pod="openshift-multus/multus-sxqtp"
Oct 30 20:38:15.451507 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.451423    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ldfgb\" (UniqueName: \"kubernetes.io/projected/f31c8037-8b3e-4e1b-a363-fdca6686beb5-kube-api-access-ldfgb\") pod \"service-ca-5fffc97bdf-lswcr\" (UID: \"f31c8037-8b3e-4e1b-a363-fdca6686beb5\") " pod="openshift-service-ca/service-ca-5fffc97bdf-lswcr"
Oct 30 20:38:15.451612 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.451597    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bkhhh\" (UniqueName: \"kubernetes.io/projected/2aee32c9-f358-4ff4-9d50-c18dba9885a5-kube-api-access-bkhhh\") pod \"image-registry-57547d4649-8sjtp\" (UID: \"2aee32c9-f358-4ff4-9d50-c18dba9885a5\") " pod="openshift-image-registry/image-registry-57547d4649-8sjtp"
Oct 30 20:38:15.453618 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.453596    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5tcf2\" (UniqueName: \"kubernetes.io/projected/e5ac6e6d-4ea4-4874-b2eb-285977a285f7-kube-api-access-5tcf2\") pod \"network-check-source-6f78d59f99-gqbfm\" (UID: \"e5ac6e6d-4ea4-4874-b2eb-285977a285f7\") " pod="openshift-network-diagnostics/network-check-source-6f78d59f99-gqbfm"
Oct 30 20:38:15.454421 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.454398    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0df457c5-5640-4c0d-9f71-94548c11397a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-zz4wr\" (UID: \"0df457c5-5640-4c0d-9f71-94548c11397a\") " pod="openshift-insights/insights-runtime-extractor-zz4wr"
Oct 30 20:38:15.454495 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.454447    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/d1fd1b0a-3831-4cb8-b6f3-ad2e67685188-telemetry-config\") pod \"cluster-monitoring-operator-884576c57-fl7nf\" (UID: \"d1fd1b0a-3831-4cb8-b6f3-ad2e67685188\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-fl7nf"
Oct 30 20:38:15.478189 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.478164    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0b7ae038-91bf-40f1-9930-8a6158706a3e-run-openvswitch\") pod \"ovnkube-node-mw7xm\" (UID: \"0b7ae038-91bf-40f1-9930-8a6158706a3e\") " pod="openshift-ovn-kubernetes/ovnkube-node-mw7xm"
Oct 30 20:38:15.478280 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.478192    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/0b7ae038-91bf-40f1-9930-8a6158706a3e-host-cni-netd\") pod \"ovnkube-node-mw7xm\" (UID: \"0b7ae038-91bf-40f1-9930-8a6158706a3e\") " pod="openshift-ovn-kubernetes/ovnkube-node-mw7xm"
Oct 30 20:38:15.478280 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.478209    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/18d56389-8b1b-45d7-ac47-cd2b6c19c5dd-sys\") pod \"node-exporter-t4s4p\" (UID: \"18d56389-8b1b-45d7-ac47-cd2b6c19c5dd\") " pod="openshift-monitoring/node-exporter-t4s4p"
Oct 30 20:38:15.478280 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.478226    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b3bff4d5-f9a8-4302-b63d-136ed3c6be35-trusted-ca\") pod \"image-registry-6c5684fdcf-l5m76\" (UID: \"b3bff4d5-f9a8-4302-b63d-136ed3c6be35\") " pod="openshift-image-registry/image-registry-6c5684fdcf-l5m76"
Oct 30 20:38:15.478280 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.478270    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/ac7adab4-061f-4371-bc6c-96260eb988d8-host-var-lib-cni-multus\") pod \"multus-sxqtp\" (UID: \"ac7adab4-061f-4371-bc6c-96260eb988d8\") " pod="openshift-multus/multus-sxqtp"
Oct 30 20:38:15.478457 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.478327    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/b2dae567-b378-41ed-9f7e-881153b7d03b-iptables-alerter-script\") pod \"iptables-alerter-cll8f\" (UID: \"b2dae567-b378-41ed-9f7e-881153b7d03b\") " pod="openshift-network-operator/iptables-alerter-cll8f"
Oct 30 20:38:15.478457 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.478351    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/ac7adab4-061f-4371-bc6c-96260eb988d8-host-var-lib-cni-multus\") pod \"multus-sxqtp\" (UID: \"ac7adab4-061f-4371-bc6c-96260eb988d8\") " pod="openshift-multus/multus-sxqtp"
Oct 30 20:38:15.478457 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.478357    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0b7ae038-91bf-40f1-9930-8a6158706a3e-host-slash\") pod \"ovnkube-node-mw7xm\" (UID: \"0b7ae038-91bf-40f1-9930-8a6158706a3e\") " pod="openshift-ovn-kubernetes/ovnkube-node-mw7xm"
Oct 30 20:38:15.478457 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.478388    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/18d56389-8b1b-45d7-ac47-cd2b6c19c5dd-node-exporter-tls\") pod \"node-exporter-t4s4p\" (UID: \"18d56389-8b1b-45d7-ac47-cd2b6c19c5dd\") " pod="openshift-monitoring/node-exporter-t4s4p"
Oct 30 20:38:15.478457 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.478436    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/b3bff4d5-f9a8-4302-b63d-136ed3c6be35-image-registry-private-configuration\") pod \"image-registry-6c5684fdcf-l5m76\" (UID: \"b3bff4d5-f9a8-4302-b63d-136ed3c6be35\") " pod="openshift-image-registry/image-registry-6c5684fdcf-l5m76"
Oct 30 20:38:15.478661 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.478502    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1dc89e41-1e32-476f-b5fc-e45945a45efd-lib-modules\") pod \"tuned-zpr5c\" (UID: \"1dc89e41-1e32-476f-b5fc-e45945a45efd\") " pod="openshift-cluster-node-tuning-operator/tuned-zpr5c"
Oct 30 20:38:15.478661 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.478514    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/b2dae567-b378-41ed-9f7e-881153b7d03b-iptables-alerter-script\") pod \"iptables-alerter-cll8f\" (UID: \"b2dae567-b378-41ed-9f7e-881153b7d03b\") " pod="openshift-network-operator/iptables-alerter-cll8f"
Oct 30 20:38:15.478661 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.478578    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/0b7ae038-91bf-40f1-9930-8a6158706a3e-host-kubelet\") pod \"ovnkube-node-mw7xm\" (UID: \"0b7ae038-91bf-40f1-9930-8a6158706a3e\") " pod="openshift-ovn-kubernetes/ovnkube-node-mw7xm"
Oct 30 20:38:15.478661 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.478607    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0b7ae038-91bf-40f1-9930-8a6158706a3e-host-run-ovn-kubernetes\") pod \"ovnkube-node-mw7xm\" (UID: \"0b7ae038-91bf-40f1-9930-8a6158706a3e\") " pod="openshift-ovn-kubernetes/ovnkube-node-mw7xm"
Oct 30 20:38:15.478661 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.478610    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b3bff4d5-f9a8-4302-b63d-136ed3c6be35-trusted-ca\") pod \"image-registry-6c5684fdcf-l5m76\" (UID: \"b3bff4d5-f9a8-4302-b63d-136ed3c6be35\") " pod="openshift-image-registry/image-registry-6c5684fdcf-l5m76"
Oct 30 20:38:15.478661 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.478632    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/0df457c5-5640-4c0d-9f71-94548c11397a-crio-socket\") pod \"insights-runtime-extractor-zz4wr\" (UID: \"0df457c5-5640-4c0d-9f71-94548c11397a\") " pod="openshift-insights/insights-runtime-extractor-zz4wr"
Oct 30 20:38:15.478661 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.478654    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1dc89e41-1e32-476f-b5fc-e45945a45efd-lib-modules\") pod \"tuned-zpr5c\" (UID: \"1dc89e41-1e32-476f-b5fc-e45945a45efd\") " pod="openshift-cluster-node-tuning-operator/tuned-zpr5c"
Oct 30 20:38:15.478925 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.478689    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/b3bff4d5-f9a8-4302-b63d-136ed3c6be35-image-registry-private-configuration\") pod \"image-registry-6c5684fdcf-l5m76\" (UID: \"b3bff4d5-f9a8-4302-b63d-136ed3c6be35\") " pod="openshift-image-registry/image-registry-6c5684fdcf-l5m76"
Oct 30 20:38:15.478925 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.478694    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xp792\" (UniqueName: \"kubernetes.io/projected/4dde41e2-34fe-429b-bf23-35bdb99d894e-kube-api-access-xp792\") pod \"insights-operator-7c4986d449-tvsdw\" (UID: \"4dde41e2-34fe-429b-bf23-35bdb99d894e\") " pod="openshift-insights/insights-operator-7c4986d449-tvsdw"
Oct 30 20:38:15.478925 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.478712    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/0df457c5-5640-4c0d-9f71-94548c11397a-crio-socket\") pod \"insights-runtime-extractor-zz4wr\" (UID: \"0df457c5-5640-4c0d-9f71-94548c11397a\") " pod="openshift-insights/insights-runtime-extractor-zz4wr"
Oct 30 20:38:15.478925 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.478731    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9hnz8\" (UniqueName: \"kubernetes.io/projected/537a9c41-5ed1-4ff5-bf9a-9d0bcb853f80-kube-api-access-9hnz8\") pod \"volume-data-source-validator-58c9f5f46d-mwm8h\" (UID: \"537a9c41-5ed1-4ff5-bf9a-9d0bcb853f80\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-mwm8h"
Oct 30 20:38:15.478925 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.478758    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2f9dd030-281c-473e-b441-9ee972019413-cni-binary-copy\") pod \"multus-additional-cni-plugins-hmdcd\" (UID: \"2f9dd030-281c-473e-b441-9ee972019413\") " pod="openshift-multus/multus-additional-cni-plugins-hmdcd"
Oct 30 20:38:15.478925 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.478782    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ac7adab4-061f-4371-bc6c-96260eb988d8-multus-conf-dir\") pod \"multus-sxqtp\" (UID: \"ac7adab4-061f-4371-bc6c-96260eb988d8\") " pod="openshift-multus/multus-sxqtp"
Oct 30 20:38:15.478925 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.478809    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/18d56389-8b1b-45d7-ac47-cd2b6c19c5dd-root\") pod \"node-exporter-t4s4p\" (UID: \"18d56389-8b1b-45d7-ac47-cd2b6c19c5dd\") " pod="openshift-monitoring/node-exporter-t4s4p"
Oct 30 20:38:15.478925 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.478835    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/18d56389-8b1b-45d7-ac47-cd2b6c19c5dd-node-exporter-wtmp\") pod \"node-exporter-t4s4p\" (UID: \"18d56389-8b1b-45d7-ac47-cd2b6c19c5dd\") " pod="openshift-monitoring/node-exporter-t4s4p"
Oct 30 20:38:15.478925 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.478859    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lc26k\" (UniqueName: \"kubernetes.io/projected/f1a05736-0bc6-4914-981e-5524121561e4-kube-api-access-lc26k\") pod \"kas-connection-checker-685895c7c9-tvmvh\" (UID: \"f1a05736-0bc6-4914-981e-5524121561e4\") " pod="kube-system/kas-connection-checker-685895c7c9-tvmvh"
Oct 30 20:38:15.478925 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.478876    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ac7adab4-061f-4371-bc6c-96260eb988d8-multus-conf-dir\") pod \"multus-sxqtp\" (UID: \"ac7adab4-061f-4371-bc6c-96260eb988d8\") " pod="openshift-multus/multus-sxqtp"
Oct 30 20:38:15.478925 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.478896    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zkkqp\" (UniqueName: \"kubernetes.io/projected/b2dae567-b378-41ed-9f7e-881153b7d03b-kube-api-access-zkkqp\") pod \"iptables-alerter-cll8f\" (UID: \"b2dae567-b378-41ed-9f7e-881153b7d03b\") " pod="openshift-network-operator/iptables-alerter-cll8f"
Oct 30 20:38:15.479441 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.478928    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ac7adab4-061f-4371-bc6c-96260eb988d8-multus-cni-dir\") pod \"multus-sxqtp\" (UID: \"ac7adab4-061f-4371-bc6c-96260eb988d8\") " pod="openshift-multus/multus-sxqtp"
Oct 30 20:38:15.479441 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.478954    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/ac7adab4-061f-4371-bc6c-96260eb988d8-multus-socket-dir-parent\") pod \"multus-sxqtp\" (UID: \"ac7adab4-061f-4371-bc6c-96260eb988d8\") " pod="openshift-multus/multus-sxqtp"
Oct 30 20:38:15.479441 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.478945    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2f9dd030-281c-473e-b441-9ee972019413-cni-binary-copy\") pod \"multus-additional-cni-plugins-hmdcd\" (UID: \"2f9dd030-281c-473e-b441-9ee972019413\") " pod="openshift-multus/multus-additional-cni-plugins-hmdcd"
Oct 30 20:38:15.479441 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.478984    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/16e71e18-453a-41bf-a3f8-9618482c9a50-hosts-file\") pod \"node-resolver-t4227\" (UID: \"16e71e18-453a-41bf-a3f8-9618482c9a50\") " pod="openshift-dns/node-resolver-t4227"
Oct 30 20:38:15.479441 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.479008    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1dc89e41-1e32-476f-b5fc-e45945a45efd-etc-kubernetes\") pod \"tuned-zpr5c\" (UID: \"1dc89e41-1e32-476f-b5fc-e45945a45efd\") " pod="openshift-cluster-node-tuning-operator/tuned-zpr5c"
Oct 30 20:38:15.479441 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.479004    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ac7adab4-061f-4371-bc6c-96260eb988d8-multus-cni-dir\") pod \"multus-sxqtp\" (UID: \"ac7adab4-061f-4371-bc6c-96260eb988d8\") " pod="openshift-multus/multus-sxqtp"
Oct 30 20:38:15.479441 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.479023    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lq6t2\" (UniqueName: \"kubernetes.io/projected/0f424633-11a5-49fa-a933-f9c6ec7ca97e-kube-api-access-lq6t2\") pod \"network-metrics-daemon-mlctd\" (UID: \"0f424633-11a5-49fa-a933-f9c6ec7ca97e\") " pod="openshift-multus/network-metrics-daemon-mlctd"
Oct 30 20:38:15.479441 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.479022    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/ac7adab4-061f-4371-bc6c-96260eb988d8-multus-socket-dir-parent\") pod \"multus-sxqtp\" (UID: \"ac7adab4-061f-4371-bc6c-96260eb988d8\") " pod="openshift-multus/multus-sxqtp"
Oct 30 20:38:15.479441 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.479079    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/16e71e18-453a-41bf-a3f8-9618482c9a50-hosts-file\") pod \"node-resolver-t4227\" (UID: \"16e71e18-453a-41bf-a3f8-9618482c9a50\") " pod="openshift-dns/node-resolver-t4227"
Oct 30 20:38:15.479441 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.479096    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1dc89e41-1e32-476f-b5fc-e45945a45efd-etc-kubernetes\") pod \"tuned-zpr5c\" (UID: \"1dc89e41-1e32-476f-b5fc-e45945a45efd\") " pod="openshift-cluster-node-tuning-operator/tuned-zpr5c"
Oct 30 20:38:15.479441 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.479130    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/0b7ae038-91bf-40f1-9930-8a6158706a3e-run-ovn\") pod \"ovnkube-node-mw7xm\" (UID: \"0b7ae038-91bf-40f1-9930-8a6158706a3e\") " pod="openshift-ovn-kubernetes/ovnkube-node-mw7xm"
Oct 30 20:38:15.479441 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.479160    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-48plj\" (UniqueName: \"kubernetes.io/projected/2f9dd030-281c-473e-b441-9ee972019413-kube-api-access-48plj\") pod \"multus-additional-cni-plugins-hmdcd\" (UID: \"2f9dd030-281c-473e-b441-9ee972019413\") " pod="openshift-multus/multus-additional-cni-plugins-hmdcd"
Oct 30 20:38:15.479441 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.479187    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/b3bff4d5-f9a8-4302-b63d-136ed3c6be35-installation-pull-secrets\") pod \"image-registry-6c5684fdcf-l5m76\" (UID: \"b3bff4d5-f9a8-4302-b63d-136ed3c6be35\") " pod="openshift-image-registry/image-registry-6c5684fdcf-l5m76"
Oct 30 20:38:15.479441 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.479214    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-config\" (UniqueName: \"kubernetes.io/configmap/6cd9770e-ea54-4c33-ac1e-5643f3d8839d-samples-operator-config\") pod \"cluster-samples-operator-6ddb6c8b94-7d57c\" (UID: \"6cd9770e-ea54-4c33-ac1e-5643f3d8839d\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-7d57c"
Oct 30 20:38:15.479441 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.479321    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1dc89e41-1e32-476f-b5fc-e45945a45efd-var-lib-kubelet\") pod \"tuned-zpr5c\" (UID: \"1dc89e41-1e32-476f-b5fc-e45945a45efd\") " pod="openshift-cluster-node-tuning-operator/tuned-zpr5c"
Oct 30 20:38:15.479441 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.479342    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4dde41e2-34fe-429b-bf23-35bdb99d894e-service-ca-bundle\") pod \"insights-operator-7c4986d449-tvsdw\" (UID: \"4dde41e2-34fe-429b-bf23-35bdb99d894e\") " pod="openshift-insights/insights-operator-7c4986d449-tvsdw"
Oct 30 20:38:15.479441 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.479358    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-79wpr\" (UniqueName: \"kubernetes.io/projected/4179c36b-8003-46e5-82b0-67f6edea7553-kube-api-access-79wpr\") pod \"node-ca-jnn4r\" (UID: \"4179c36b-8003-46e5-82b0-67f6edea7553\") " pod="openshift-image-registry/node-ca-jnn4r"
Oct 30 20:38:15.479441 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.479376    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/780e67fb-196e-485a-8aa4-e11cecdc4b63-kubelet-dir\") pod \"aws-ebs-csi-driver-node-qbnnn\" (UID: \"780e67fb-196e-485a-8aa4-e11cecdc4b63\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qbnnn"
Oct 30 20:38:15.479441 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.479378    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/b3bff4d5-f9a8-4302-b63d-136ed3c6be35-installation-pull-secrets\") pod \"image-registry-6c5684fdcf-l5m76\" (UID: \"b3bff4d5-f9a8-4302-b63d-136ed3c6be35\") " pod="openshift-image-registry/image-registry-6c5684fdcf-l5m76"
Oct 30 20:38:15.479441 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.479395    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/1dc89e41-1e32-476f-b5fc-e45945a45efd-etc-sysctl-conf\") pod \"tuned-zpr5c\" (UID: \"1dc89e41-1e32-476f-b5fc-e45945a45efd\") " pod="openshift-cluster-node-tuning-operator/tuned-zpr5c"
Oct 30 20:38:15.479441 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.479399    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1dc89e41-1e32-476f-b5fc-e45945a45efd-var-lib-kubelet\") pod \"tuned-zpr5c\" (UID: \"1dc89e41-1e32-476f-b5fc-e45945a45efd\") " pod="openshift-cluster-node-tuning-operator/tuned-zpr5c"
Oct 30 20:38:15.479441 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.479413    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-config\" (UniqueName: \"kubernetes.io/configmap/6cd9770e-ea54-4c33-ac1e-5643f3d8839d-samples-operator-config\") pod \"cluster-samples-operator-6ddb6c8b94-7d57c\" (UID: \"6cd9770e-ea54-4c33-ac1e-5643f3d8839d\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-7d57c"
Oct 30 20:38:15.479441 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.479437    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/ef128f2b-0a66-4c2d-a969-6197e0f82c58-agent-certs\") pod \"konnectivity-agent-x6f58\" (UID: \"ef128f2b-0a66-4c2d-a969-6197e0f82c58\") " pod="kube-system/konnectivity-agent-x6f58"
Oct 30 20:38:15.479441 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.479468    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1dc89e41-1e32-476f-b5fc-e45945a45efd-sys\") pod \"tuned-zpr5c\" (UID: \"1dc89e41-1e32-476f-b5fc-e45945a45efd\") " pod="openshift-cluster-node-tuning-operator/tuned-zpr5c"
Oct 30 20:38:15.479441 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.479491    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/ef128f2b-0a66-4c2d-a969-6197e0f82c58-konnectivity-ca\") pod \"konnectivity-agent-x6f58\" (UID: \"ef128f2b-0a66-4c2d-a969-6197e0f82c58\") " pod="kube-system/konnectivity-agent-x6f58"
Oct 30 20:38:15.479441 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.479516    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/b3bff4d5-f9a8-4302-b63d-136ed3c6be35-registry-certificates\") pod \"image-registry-6c5684fdcf-l5m76\" (UID: \"b3bff4d5-f9a8-4302-b63d-136ed3c6be35\") " pod="openshift-image-registry/image-registry-6c5684fdcf-l5m76"
Oct 30 20:38:15.479441 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.479538    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/1dc89e41-1e32-476f-b5fc-e45945a45efd-etc-sysctl-conf\") pod \"tuned-zpr5c\" (UID: \"1dc89e41-1e32-476f-b5fc-e45945a45efd\") " pod="openshift-cluster-node-tuning-operator/tuned-zpr5c"
Oct 30 20:38:15.479441 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.479557    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1dc89e41-1e32-476f-b5fc-e45945a45efd-sys\") pod \"tuned-zpr5c\" (UID: \"1dc89e41-1e32-476f-b5fc-e45945a45efd\") " pod="openshift-cluster-node-tuning-operator/tuned-zpr5c"
Oct 30 20:38:15.479441 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.479542    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/0b7ae038-91bf-40f1-9930-8a6158706a3e-systemd-units\") pod \"ovnkube-node-mw7xm\" (UID: \"0b7ae038-91bf-40f1-9930-8a6158706a3e\") " pod="openshift-ovn-kubernetes/ovnkube-node-mw7xm"
Oct 30 20:38:15.479441 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.479608    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ac7adab4-061f-4371-bc6c-96260eb988d8-host-var-lib-cni-bin\") pod \"multus-sxqtp\" (UID: \"ac7adab4-061f-4371-bc6c-96260eb988d8\") " pod="openshift-multus/multus-sxqtp"
Oct 30 20:38:15.479441 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.479633    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ac7adab4-061f-4371-bc6c-96260eb988d8-system-cni-dir\") pod \"multus-sxqtp\" (UID: \"ac7adab4-061f-4371-bc6c-96260eb988d8\") " pod="openshift-multus/multus-sxqtp"
Oct 30 20:38:15.479441 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.479439    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/780e67fb-196e-485a-8aa4-e11cecdc4b63-kubelet-dir\") pod \"aws-ebs-csi-driver-node-qbnnn\" (UID: \"780e67fb-196e-485a-8aa4-e11cecdc4b63\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qbnnn"
Oct 30 20:38:15.481073 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.479665    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4dde41e2-34fe-429b-bf23-35bdb99d894e-tmp\") pod \"insights-operator-7c4986d449-tvsdw\" (UID: \"4dde41e2-34fe-429b-bf23-35bdb99d894e\") " pod="openshift-insights/insights-operator-7c4986d449-tvsdw"
Oct 30 20:38:15.481073 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.479692    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4r7tw\" (UniqueName: \"kubernetes.io/projected/e33ef368-1f7c-4455-beb9-a2b2c5106792-kube-api-access-4r7tw\") pod \"service-ca-operator-544d749c8c-gnfbh\" (UID: \"e33ef368-1f7c-4455-beb9-a2b2c5106792\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-gnfbh"
Oct 30 20:38:15.481073 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.479697    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/ef128f2b-0a66-4c2d-a969-6197e0f82c58-agent-certs\") pod \"konnectivity-agent-x6f58\" (UID: \"ef128f2b-0a66-4c2d-a969-6197e0f82c58\") " pod="kube-system/konnectivity-agent-x6f58"
Oct 30 20:38:15.481073 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.479715    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ac7adab4-061f-4371-bc6c-96260eb988d8-host-var-lib-cni-bin\") pod \"multus-sxqtp\" (UID: \"ac7adab4-061f-4371-bc6c-96260eb988d8\") " pod="openshift-multus/multus-sxqtp"
Oct 30 20:38:15.481073 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.479719    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dn4n8\" (UniqueName: \"kubernetes.io/projected/18d56389-8b1b-45d7-ac47-cd2b6c19c5dd-kube-api-access-dn4n8\") pod \"node-exporter-t4s4p\" (UID: \"18d56389-8b1b-45d7-ac47-cd2b6c19c5dd\") " pod="openshift-monitoring/node-exporter-t4s4p"
Oct 30 20:38:15.481073 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.479722    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ac7adab4-061f-4371-bc6c-96260eb988d8-system-cni-dir\") pod \"multus-sxqtp\" (UID: \"ac7adab4-061f-4371-bc6c-96260eb988d8\") " pod="openshift-multus/multus-sxqtp"
Oct 30 20:38:15.481073 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.479738    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/ef128f2b-0a66-4c2d-a969-6197e0f82c58-konnectivity-ca\") pod \"konnectivity-agent-x6f58\" (UID: \"ef128f2b-0a66-4c2d-a969-6197e0f82c58\") " pod="kube-system/konnectivity-agent-x6f58"
Oct 30 20:38:15.481073 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.479747    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tz88w\" (UniqueName: \"kubernetes.io/projected/90cd3de0-c573-41c2-bf3e-cf0e46a41d50-kube-api-access-tz88w\") pod \"console-operator-7cd56b8dbc-sb7ds\" (UID: \"90cd3de0-c573-41c2-bf3e-cf0e46a41d50\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-sb7ds"
Oct 30 20:38:15.481073 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.479778    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4dde41e2-34fe-429b-bf23-35bdb99d894e-tmp\") pod \"insights-operator-7c4986d449-tvsdw\" (UID: \"4dde41e2-34fe-429b-bf23-35bdb99d894e\") " pod="openshift-insights/insights-operator-7c4986d449-tvsdw"
Oct 30 20:38:15.481073 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.479796    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ac7adab4-061f-4371-bc6c-96260eb988d8-host-run-netns\") pod \"multus-sxqtp\" (UID: \"ac7adab4-061f-4371-bc6c-96260eb988d8\") " pod="openshift-multus/multus-sxqtp"
Oct 30 20:38:15.481073 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.479833    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ac7adab4-061f-4371-bc6c-96260eb988d8-host-run-netns\") pod \"multus-sxqtp\" (UID: \"ac7adab4-061f-4371-bc6c-96260eb988d8\") " pod="openshift-multus/multus-sxqtp"
Oct 30 20:38:15.481073 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.479837    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/4dde41e2-34fe-429b-bf23-35bdb99d894e-snapshots\") pod \"insights-operator-7c4986d449-tvsdw\" (UID: \"4dde41e2-34fe-429b-bf23-35bdb99d894e\") " pod="openshift-insights/insights-operator-7c4986d449-tvsdw"
Oct 30 20:38:15.481073 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.479841    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/b3bff4d5-f9a8-4302-b63d-136ed3c6be35-registry-certificates\") pod \"image-registry-6c5684fdcf-l5m76\" (UID: \"b3bff4d5-f9a8-4302-b63d-136ed3c6be35\") " pod="openshift-image-registry/image-registry-6c5684fdcf-l5m76"
Oct 30 20:38:15.481073 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.479864    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2f9dd030-281c-473e-b441-9ee972019413-system-cni-dir\") pod \"multus-additional-cni-plugins-hmdcd\" (UID: \"2f9dd030-281c-473e-b441-9ee972019413\") " pod="openshift-multus/multus-additional-cni-plugins-hmdcd"
Oct 30 20:38:15.481073 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.479894    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/0b7ae038-91bf-40f1-9930-8a6158706a3e-ovnkube-script-lib\") pod \"ovnkube-node-mw7xm\" (UID: \"0b7ae038-91bf-40f1-9930-8a6158706a3e\") " pod="openshift-ovn-kubernetes/ovnkube-node-mw7xm"
Oct 30 20:38:15.481073 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.479912    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/4dde41e2-34fe-429b-bf23-35bdb99d894e-snapshots\") pod \"insights-operator-7c4986d449-tvsdw\" (UID: \"4dde41e2-34fe-429b-bf23-35bdb99d894e\") " pod="openshift-insights/insights-operator-7c4986d449-tvsdw"
Oct 30 20:38:15.481073 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.479935    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e33ef368-1f7c-4455-beb9-a2b2c5106792-serving-cert\") pod \"service-ca-operator-544d749c8c-gnfbh\" (UID: \"e33ef368-1f7c-4455-beb9-a2b2c5106792\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-gnfbh"
Oct 30 20:38:15.481073 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.480030    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4dde41e2-34fe-429b-bf23-35bdb99d894e-service-ca-bundle\") pod \"insights-operator-7c4986d449-tvsdw\" (UID: \"4dde41e2-34fe-429b-bf23-35bdb99d894e\") " pod="openshift-insights/insights-operator-7c4986d449-tvsdw"
Oct 30 20:38:15.481073 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.480085    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-trh2f\" (UniqueName: \"kubernetes.io/projected/6cd9770e-ea54-4c33-ac1e-5643f3d8839d-kube-api-access-trh2f\") pod \"cluster-samples-operator-6ddb6c8b94-7d57c\" (UID: \"6cd9770e-ea54-4c33-ac1e-5643f3d8839d\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-7d57c"
Oct 30 20:38:15.481073 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.480144    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/0b7ae038-91bf-40f1-9930-8a6158706a3e-ovnkube-script-lib\") pod \"ovnkube-node-mw7xm\" (UID: \"0b7ae038-91bf-40f1-9930-8a6158706a3e\") " pod="openshift-ovn-kubernetes/ovnkube-node-mw7xm"
Oct 30 20:38:15.481073 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.480159    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/90cd3de0-c573-41c2-bf3e-cf0e46a41d50-config\") pod \"console-operator-7cd56b8dbc-sb7ds\" (UID: \"90cd3de0-c573-41c2-bf3e-cf0e46a41d50\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-sb7ds"
Oct 30 20:38:15.481073 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.480195    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0b7ae038-91bf-40f1-9930-8a6158706a3e-etc-openvswitch\") pod \"ovnkube-node-mw7xm\" (UID: \"0b7ae038-91bf-40f1-9930-8a6158706a3e\") " pod="openshift-ovn-kubernetes/ovnkube-node-mw7xm"
Oct 30 20:38:15.481073 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.480215    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0b7ae038-91bf-40f1-9930-8a6158706a3e-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-mw7xm\" (UID: \"0b7ae038-91bf-40f1-9930-8a6158706a3e\") " pod="openshift-ovn-kubernetes/ovnkube-node-mw7xm"
Oct 30 20:38:15.481073 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.480233    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/18d56389-8b1b-45d7-ac47-cd2b6c19c5dd-node-exporter-accelerators-collector-config\") pod \"node-exporter-t4s4p\" (UID: \"18d56389-8b1b-45d7-ac47-cd2b6c19c5dd\") " pod="openshift-monitoring/node-exporter-t4s4p"
Oct 30 20:38:15.481073 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.480273    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e33ef368-1f7c-4455-beb9-a2b2c5106792-serving-cert\") pod \"service-ca-operator-544d749c8c-gnfbh\" (UID: \"e33ef368-1f7c-4455-beb9-a2b2c5106792\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-gnfbh"
Oct 30 20:38:15.481073 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.480278    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/1dc89e41-1e32-476f-b5fc-e45945a45efd-etc-sysctl-d\") pod \"tuned-zpr5c\" (UID: \"1dc89e41-1e32-476f-b5fc-e45945a45efd\") " pod="openshift-cluster-node-tuning-operator/tuned-zpr5c"
Oct 30 20:38:15.481073 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.480317    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/90cd3de0-c573-41c2-bf3e-cf0e46a41d50-config\") pod \"console-operator-7cd56b8dbc-sb7ds\" (UID: \"90cd3de0-c573-41c2-bf3e-cf0e46a41d50\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-sb7ds"
Oct 30 20:38:15.481073 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.480320    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wc2mp\" (UniqueName: \"kubernetes.io/projected/1dc89e41-1e32-476f-b5fc-e45945a45efd-kube-api-access-wc2mp\") pod \"tuned-zpr5c\" (UID: \"1dc89e41-1e32-476f-b5fc-e45945a45efd\") " pod="openshift-cluster-node-tuning-operator/tuned-zpr5c"
Oct 30 20:38:15.481073 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.480361    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/708a2c3c-e061-4bb1-b9ff-48f111b08943-tls-certificates\") pod \"prometheus-operator-admission-webhook-6489d8bf89-fqdw6\" (UID: \"708a2c3c-e061-4bb1-b9ff-48f111b08943\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-6489d8bf89-fqdw6"
Oct 30 20:38:15.481073 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.480374    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/1dc89e41-1e32-476f-b5fc-e45945a45efd-etc-sysctl-d\") pod \"tuned-zpr5c\" (UID: \"1dc89e41-1e32-476f-b5fc-e45945a45efd\") " pod="openshift-cluster-node-tuning-operator/tuned-zpr5c"
Oct 30 20:38:15.481073 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.480389    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/1dc89e41-1e32-476f-b5fc-e45945a45efd-run\") pod \"tuned-zpr5c\" (UID: \"1dc89e41-1e32-476f-b5fc-e45945a45efd\") " pod="openshift-cluster-node-tuning-operator/tuned-zpr5c"
Oct 30 20:38:15.481073 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.480415    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/90cd3de0-c573-41c2-bf3e-cf0e46a41d50-serving-cert\") pod \"console-operator-7cd56b8dbc-sb7ds\" (UID: \"90cd3de0-c573-41c2-bf3e-cf0e46a41d50\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-sb7ds"
Oct 30 20:38:15.481073 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.480439    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/ac7adab4-061f-4371-bc6c-96260eb988d8-hostroot\") pod \"multus-sxqtp\" (UID: \"ac7adab4-061f-4371-bc6c-96260eb988d8\") " pod="openshift-multus/multus-sxqtp"
Oct 30 20:38:15.481073 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.480462    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ac7adab4-061f-4371-bc6c-96260eb988d8-etc-kubernetes\") pod \"multus-sxqtp\" (UID: \"ac7adab4-061f-4371-bc6c-96260eb988d8\") " pod="openshift-multus/multus-sxqtp"
Oct 30 20:38:15.481073 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.480487    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/1dc89e41-1e32-476f-b5fc-e45945a45efd-run\") pod \"tuned-zpr5c\" (UID: \"1dc89e41-1e32-476f-b5fc-e45945a45efd\") " pod="openshift-cluster-node-tuning-operator/tuned-zpr5c"
Oct 30 20:38:15.481073 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.480502    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/ac7adab4-061f-4371-bc6c-96260eb988d8-hostroot\") pod \"multus-sxqtp\" (UID: \"ac7adab4-061f-4371-bc6c-96260eb988d8\") " pod="openshift-multus/multus-sxqtp"
Oct 30 20:38:15.481073 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.480513    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ac7adab4-061f-4371-bc6c-96260eb988d8-etc-kubernetes\") pod \"multus-sxqtp\" (UID: \"ac7adab4-061f-4371-bc6c-96260eb988d8\") " pod="openshift-multus/multus-sxqtp"
Oct 30 20:38:15.481073 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.480540    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/a4cdc725-3dd0-4917-b8a0-c8ff77a40abb-kubelet-config\") pod \"global-pull-secret-syncer-tvvd9\" (UID: \"a4cdc725-3dd0-4917-b8a0-c8ff77a40abb\") " pod="kube-system/global-pull-secret-syncer-tvvd9"
Oct 30 20:38:15.481073 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.480566    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/780e67fb-196e-485a-8aa4-e11cecdc4b63-etc-selinux\") pod \"aws-ebs-csi-driver-node-qbnnn\" (UID: \"780e67fb-196e-485a-8aa4-e11cecdc4b63\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qbnnn"
Oct 30 20:38:15.481073 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.480571    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/708a2c3c-e061-4bb1-b9ff-48f111b08943-tls-certificates\") pod \"prometheus-operator-admission-webhook-6489d8bf89-fqdw6\" (UID: \"708a2c3c-e061-4bb1-b9ff-48f111b08943\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-6489d8bf89-fqdw6"
Oct 30 20:38:15.481073 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.480589    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1dc89e41-1e32-476f-b5fc-e45945a45efd-tmp\") pod \"tuned-zpr5c\" (UID: \"1dc89e41-1e32-476f-b5fc-e45945a45efd\") " pod="openshift-cluster-node-tuning-operator/tuned-zpr5c"
Oct 30 20:38:15.481073 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.480592    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/a4cdc725-3dd0-4917-b8a0-c8ff77a40abb-kubelet-config\") pod \"global-pull-secret-syncer-tvvd9\" (UID: \"a4cdc725-3dd0-4917-b8a0-c8ff77a40abb\") " pod="kube-system/global-pull-secret-syncer-tvvd9"
Oct 30 20:38:15.481073 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.480600    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/90cd3de0-c573-41c2-bf3e-cf0e46a41d50-serving-cert\") pod \"console-operator-7cd56b8dbc-sb7ds\" (UID: \"90cd3de0-c573-41c2-bf3e-cf0e46a41d50\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-sb7ds"
Oct 30 20:38:15.481073 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.480616    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0b7ae038-91bf-40f1-9930-8a6158706a3e-host-run-netns\") pod \"ovnkube-node-mw7xm\" (UID: \"0b7ae038-91bf-40f1-9930-8a6158706a3e\") " pod="openshift-ovn-kubernetes/ovnkube-node-mw7xm"
Oct 30 20:38:15.481073 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.480628    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/780e67fb-196e-485a-8aa4-e11cecdc4b63-etc-selinux\") pod \"aws-ebs-csi-driver-node-qbnnn\" (UID: \"780e67fb-196e-485a-8aa4-e11cecdc4b63\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qbnnn"
Oct 30 20:38:15.481073 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.480641    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ac7adab4-061f-4371-bc6c-96260eb988d8-cnibin\") pod \"multus-sxqtp\" (UID: \"ac7adab4-061f-4371-bc6c-96260eb988d8\") " pod="openshift-multus/multus-sxqtp"
Oct 30 20:38:15.481073 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.480655    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1dc89e41-1e32-476f-b5fc-e45945a45efd-tmp\") pod \"tuned-zpr5c\" (UID: \"1dc89e41-1e32-476f-b5fc-e45945a45efd\") " pod="openshift-cluster-node-tuning-operator/tuned-zpr5c"
Oct 30 20:38:15.481073 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.480660    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/780e67fb-196e-485a-8aa4-e11cecdc4b63-registration-dir\") pod \"aws-ebs-csi-driver-node-qbnnn\" (UID: \"780e67fb-196e-485a-8aa4-e11cecdc4b63\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qbnnn"
Oct 30 20:38:15.481073 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.480693    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b2dae567-b378-41ed-9f7e-881153b7d03b-host-slash\") pod \"iptables-alerter-cll8f\" (UID: \"b2dae567-b378-41ed-9f7e-881153b7d03b\") " pod="openshift-network-operator/iptables-alerter-cll8f"
Oct 30 20:38:15.481073 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.480696    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/780e67fb-196e-485a-8aa4-e11cecdc4b63-registration-dir\") pod \"aws-ebs-csi-driver-node-qbnnn\" (UID: \"780e67fb-196e-485a-8aa4-e11cecdc4b63\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qbnnn"
Oct 30 20:38:15.481073 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.480711    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/0b7ae038-91bf-40f1-9930-8a6158706a3e-ovnkube-config\") pod \"ovnkube-node-mw7xm\" (UID: \"0b7ae038-91bf-40f1-9930-8a6158706a3e\") " pod="openshift-ovn-kubernetes/ovnkube-node-mw7xm"
Oct 30 20:38:15.481073 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.480726    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/0b7ae038-91bf-40f1-9930-8a6158706a3e-env-overrides\") pod \"ovnkube-node-mw7xm\" (UID: \"0b7ae038-91bf-40f1-9930-8a6158706a3e\") " pod="openshift-ovn-kubernetes/ovnkube-node-mw7xm"
Oct 30 20:38:15.481073 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.480710    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ac7adab4-061f-4371-bc6c-96260eb988d8-cnibin\") pod \"multus-sxqtp\" (UID: \"ac7adab4-061f-4371-bc6c-96260eb988d8\") " pod="openshift-multus/multus-sxqtp"
Oct 30 20:38:15.481073 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.480743    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/ac7adab4-061f-4371-bc6c-96260eb988d8-host-run-k8s-cni-cncf-io\") pod \"multus-sxqtp\" (UID: \"ac7adab4-061f-4371-bc6c-96260eb988d8\") " pod="openshift-multus/multus-sxqtp"
Oct 30 20:38:15.481073 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.480760    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0b7ae038-91bf-40f1-9930-8a6158706a3e-host-cni-bin\") pod \"ovnkube-node-mw7xm\" (UID: \"0b7ae038-91bf-40f1-9930-8a6158706a3e\") " pod="openshift-ovn-kubernetes/ovnkube-node-mw7xm"
Oct 30 20:38:15.481073 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.480776    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/b3bff4d5-f9a8-4302-b63d-136ed3c6be35-ca-trust-extracted\") pod \"image-registry-6c5684fdcf-l5m76\" (UID: \"b3bff4d5-f9a8-4302-b63d-136ed3c6be35\") " pod="openshift-image-registry/image-registry-6c5684fdcf-l5m76"
Oct 30 20:38:15.481073 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.480792    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-75wkc\" (UniqueName: \"kubernetes.io/projected/b3bff4d5-f9a8-4302-b63d-136ed3c6be35-kube-api-access-75wkc\") pod \"image-registry-6c5684fdcf-l5m76\" (UID: \"b3bff4d5-f9a8-4302-b63d-136ed3c6be35\") " pod="openshift-image-registry/image-registry-6c5684fdcf-l5m76"
Oct 30 20:38:15.481073 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.480827    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mh8k8\" (UniqueName: \"kubernetes.io/projected/0b7ae038-91bf-40f1-9930-8a6158706a3e-kube-api-access-mh8k8\") pod \"ovnkube-node-mw7xm\" (UID: \"0b7ae038-91bf-40f1-9930-8a6158706a3e\") " pod="openshift-ovn-kubernetes/ovnkube-node-mw7xm"
Oct 30 20:38:15.481073 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.480813    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/ac7adab4-061f-4371-bc6c-96260eb988d8-host-run-k8s-cni-cncf-io\") pod \"multus-sxqtp\" (UID: \"ac7adab4-061f-4371-bc6c-96260eb988d8\") " pod="openshift-multus/multus-sxqtp"
Oct 30 20:38:15.481073 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.480856    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/b3bff4d5-f9a8-4302-b63d-136ed3c6be35-ca-trust-extracted\") pod \"image-registry-6c5684fdcf-l5m76\" (UID: \"b3bff4d5-f9a8-4302-b63d-136ed3c6be35\") " pod="openshift-image-registry/image-registry-6c5684fdcf-l5m76"
Oct 30 20:38:15.481073 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.480857    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/780e67fb-196e-485a-8aa4-e11cecdc4b63-sys-fs\") pod \"aws-ebs-csi-driver-node-qbnnn\" (UID: \"780e67fb-196e-485a-8aa4-e11cecdc4b63\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qbnnn"
Oct 30 20:38:15.481073 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.480878    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/0b7ae038-91bf-40f1-9930-8a6158706a3e-env-overrides\") pod \"ovnkube-node-mw7xm\" (UID: \"0b7ae038-91bf-40f1-9930-8a6158706a3e\") " pod="openshift-ovn-kubernetes/ovnkube-node-mw7xm"
Oct 30 20:38:15.481073 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.480895    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/0b7ae038-91bf-40f1-9930-8a6158706a3e-ovn-node-metrics-cert\") pod \"ovnkube-node-mw7xm\" (UID: \"0b7ae038-91bf-40f1-9930-8a6158706a3e\") " pod="openshift-ovn-kubernetes/ovnkube-node-mw7xm"
Oct 30 20:38:15.481073 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.480899    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/780e67fb-196e-485a-8aa4-e11cecdc4b63-sys-fs\") pod \"aws-ebs-csi-driver-node-qbnnn\" (UID: \"780e67fb-196e-485a-8aa4-e11cecdc4b63\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qbnnn"
Oct 30 20:38:15.481073 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.480910    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/0b7ae038-91bf-40f1-9930-8a6158706a3e-ovnkube-config\") pod \"ovnkube-node-mw7xm\" (UID: \"0b7ae038-91bf-40f1-9930-8a6158706a3e\") " pod="openshift-ovn-kubernetes/ovnkube-node-mw7xm"
Oct 30 20:38:15.481073 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.480921    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/2f9dd030-281c-473e-b441-9ee972019413-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-hmdcd\" (UID: \"2f9dd030-281c-473e-b441-9ee972019413\") " pod="openshift-multus/multus-additional-cni-plugins-hmdcd"
Oct 30 20:38:15.481073 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.480947    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/2f9dd030-281c-473e-b441-9ee972019413-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-hmdcd\" (UID: \"2f9dd030-281c-473e-b441-9ee972019413\") " pod="openshift-multus/multus-additional-cni-plugins-hmdcd"
Oct 30 20:38:15.481073 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.480983    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/18d56389-8b1b-45d7-ac47-cd2b6c19c5dd-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-t4s4p\" (UID: \"18d56389-8b1b-45d7-ac47-cd2b6c19c5dd\") " pod="openshift-monitoring/node-exporter-t4s4p"
Oct 30 20:38:15.481073 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.481014    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/1dc89e41-1e32-476f-b5fc-e45945a45efd-etc-modprobe-d\") pod \"tuned-zpr5c\" (UID: \"1dc89e41-1e32-476f-b5fc-e45945a45efd\") " pod="openshift-cluster-node-tuning-operator/tuned-zpr5c"
Oct 30 20:38:15.481073 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.481042    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/1dc89e41-1e32-476f-b5fc-e45945a45efd-etc-tuned\") pod \"tuned-zpr5c\" (UID: \"1dc89e41-1e32-476f-b5fc-e45945a45efd\") " pod="openshift-cluster-node-tuning-operator/tuned-zpr5c"
Oct 30 20:38:15.481073 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.481083    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0f424633-11a5-49fa-a933-f9c6ec7ca97e-metrics-certs\") pod \"network-metrics-daemon-mlctd\" (UID: \"0f424633-11a5-49fa-a933-f9c6ec7ca97e\") " pod="openshift-multus/network-metrics-daemon-mlctd"
Oct 30 20:38:15.481073 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.481106    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/4179c36b-8003-46e5-82b0-67f6edea7553-serviceca\") pod \"node-ca-jnn4r\" (UID: \"4179c36b-8003-46e5-82b0-67f6edea7553\") " pod="openshift-image-registry/node-ca-jnn4r"
Oct 30 20:38:15.481073 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.481129    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/0b7ae038-91bf-40f1-9930-8a6158706a3e-node-log\") pod \"ovnkube-node-mw7xm\" (UID: \"0b7ae038-91bf-40f1-9930-8a6158706a3e\") " pod="openshift-ovn-kubernetes/ovnkube-node-mw7xm"
Oct 30 20:38:15.483496 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.481127    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/1dc89e41-1e32-476f-b5fc-e45945a45efd-etc-tuned\") pod \"tuned-zpr5c\" (UID: \"1dc89e41-1e32-476f-b5fc-e45945a45efd\") " pod="openshift-cluster-node-tuning-operator/tuned-zpr5c"
Oct 30 20:38:15.483496 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.481149    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/1dc89e41-1e32-476f-b5fc-e45945a45efd-etc-modprobe-d\") pod \"tuned-zpr5c\" (UID: \"1dc89e41-1e32-476f-b5fc-e45945a45efd\") " pod="openshift-cluster-node-tuning-operator/tuned-zpr5c"
Oct 30 20:38:15.483496 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.481157    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ac7adab4-061f-4371-bc6c-96260eb988d8-host-var-lib-kubelet\") pod \"multus-sxqtp\" (UID: \"ac7adab4-061f-4371-bc6c-96260eb988d8\") " pod="openshift-multus/multus-sxqtp"
Oct 30 20:38:15.483496 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.481104    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/2f9dd030-281c-473e-b441-9ee972019413-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-hmdcd\" (UID: \"2f9dd030-281c-473e-b441-9ee972019413\") " pod="openshift-multus/multus-additional-cni-plugins-hmdcd"
Oct 30 20:38:15.483496 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.481139    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/2f9dd030-281c-473e-b441-9ee972019413-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-hmdcd\" (UID: \"2f9dd030-281c-473e-b441-9ee972019413\") " pod="openshift-multus/multus-additional-cni-plugins-hmdcd"
Oct 30 20:38:15.483496 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.481179    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/0b7ae038-91bf-40f1-9930-8a6158706a3e-ovn-node-metrics-cert\") pod \"ovnkube-node-mw7xm\" (UID: \"0b7ae038-91bf-40f1-9930-8a6158706a3e\") " pod="openshift-ovn-kubernetes/ovnkube-node-mw7xm"
Oct 30 20:38:15.483496 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.481193    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/1dc89e41-1e32-476f-b5fc-e45945a45efd-etc-systemd\") pod \"tuned-zpr5c\" (UID: \"1dc89e41-1e32-476f-b5fc-e45945a45efd\") " pod="openshift-cluster-node-tuning-operator/tuned-zpr5c"
Oct 30 20:38:15.483496 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.481198    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ac7adab4-061f-4371-bc6c-96260eb988d8-host-var-lib-kubelet\") pod \"multus-sxqtp\" (UID: \"ac7adab4-061f-4371-bc6c-96260eb988d8\") " pod="openshift-multus/multus-sxqtp"
Oct 30 20:38:15.483496 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.481224    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4dde41e2-34fe-429b-bf23-35bdb99d894e-trusted-ca-bundle\") pod \"insights-operator-7c4986d449-tvsdw\" (UID: \"4dde41e2-34fe-429b-bf23-35bdb99d894e\") " pod="openshift-insights/insights-operator-7c4986d449-tvsdw"
Oct 30 20:38:15.483496 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.481231    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/1dc89e41-1e32-476f-b5fc-e45945a45efd-etc-systemd\") pod \"tuned-zpr5c\" (UID: \"1dc89e41-1e32-476f-b5fc-e45945a45efd\") " pod="openshift-cluster-node-tuning-operator/tuned-zpr5c"
Oct 30 20:38:15.483496 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.481249    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/0b7ae038-91bf-40f1-9930-8a6158706a3e-run-systemd\") pod \"ovnkube-node-mw7xm\" (UID: \"0b7ae038-91bf-40f1-9930-8a6158706a3e\") " pod="openshift-ovn-kubernetes/ovnkube-node-mw7xm"
Oct 30 20:38:15.483496 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.481298    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/e33ef368-1f7c-4455-beb9-a2b2c5106792-config\") pod \"service-ca-operator-544d749c8c-gnfbh\" (UID: \"e33ef368-1f7c-4455-beb9-a2b2c5106792\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-gnfbh"
Oct 30 20:38:15.483496 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.481296    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0f424633-11a5-49fa-a933-f9c6ec7ca97e-metrics-certs\") pod \"network-metrics-daemon-mlctd\" (UID: \"0f424633-11a5-49fa-a933-f9c6ec7ca97e\") " pod="openshift-multus/network-metrics-daemon-mlctd"
Oct 30 20:38:15.483496 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.481367    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b3bff4d5-f9a8-4302-b63d-136ed3c6be35-registry-tls\") pod \"image-registry-6c5684fdcf-l5m76\" (UID: \"b3bff4d5-f9a8-4302-b63d-136ed3c6be35\") " pod="openshift-image-registry/image-registry-6c5684fdcf-l5m76"
Oct 30 20:38:15.483496 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.481446    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/90cd3de0-c573-41c2-bf3e-cf0e46a41d50-trusted-ca\") pod \"console-operator-7cd56b8dbc-sb7ds\" (UID: \"90cd3de0-c573-41c2-bf3e-cf0e46a41d50\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-sb7ds"
Oct 30 20:38:15.483496 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.481479    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/1dc89e41-1e32-476f-b5fc-e45945a45efd-etc-sysconfig\") pod \"tuned-zpr5c\" (UID: \"1dc89e41-1e32-476f-b5fc-e45945a45efd\") " pod="openshift-cluster-node-tuning-operator/tuned-zpr5c"
Oct 30 20:38:15.483496 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.481510    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2f9dd030-281c-473e-b441-9ee972019413-tuning-conf-dir\") pod \"multus-additional-cni-plugins-hmdcd\" (UID: \"2f9dd030-281c-473e-b441-9ee972019413\") " pod="openshift-multus/multus-additional-cni-plugins-hmdcd"
Oct 30 20:38:15.483496 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.481534    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b3bff4d5-f9a8-4302-b63d-136ed3c6be35-registry-tls\") pod \"image-registry-6c5684fdcf-l5m76\" (UID: \"b3bff4d5-f9a8-4302-b63d-136ed3c6be35\") " pod="openshift-image-registry/image-registry-6c5684fdcf-l5m76"
Oct 30 20:38:15.483496 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.481541    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/780e67fb-196e-485a-8aa4-e11cecdc4b63-socket-dir\") pod \"aws-ebs-csi-driver-node-qbnnn\" (UID: \"780e67fb-196e-485a-8aa4-e11cecdc4b63\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qbnnn"
Oct 30 20:38:15.483496 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.481559    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/e33ef368-1f7c-4455-beb9-a2b2c5106792-config\") pod \"service-ca-operator-544d749c8c-gnfbh\" (UID: \"e33ef368-1f7c-4455-beb9-a2b2c5106792\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-gnfbh"
Oct 30 20:38:15.483496 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.481567    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b3bff4d5-f9a8-4302-b63d-136ed3c6be35-bound-sa-token\") pod \"image-registry-6c5684fdcf-l5m76\" (UID: \"b3bff4d5-f9a8-4302-b63d-136ed3c6be35\") " pod="openshift-image-registry/image-registry-6c5684fdcf-l5m76"
Oct 30 20:38:15.483496 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.481602    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/6cd9770e-ea54-4c33-ac1e-5643f3d8839d-samples-operator-tls\") pod \"cluster-samples-operator-6ddb6c8b94-7d57c\" (UID: \"6cd9770e-ea54-4c33-ac1e-5643f3d8839d\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-7d57c"
Oct 30 20:38:15.483496 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.481636    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0b7ae038-91bf-40f1-9930-8a6158706a3e-var-lib-openvswitch\") pod \"ovnkube-node-mw7xm\" (UID: \"0b7ae038-91bf-40f1-9930-8a6158706a3e\") " pod="openshift-ovn-kubernetes/ovnkube-node-mw7xm"
Oct 30 20:38:15.483496 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.481647    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/780e67fb-196e-485a-8aa4-e11cecdc4b63-socket-dir\") pod \"aws-ebs-csi-driver-node-qbnnn\" (UID: \"780e67fb-196e-485a-8aa4-e11cecdc4b63\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qbnnn"
Oct 30 20:38:15.483496 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.481569    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/1dc89e41-1e32-476f-b5fc-e45945a45efd-etc-sysconfig\") pod \"tuned-zpr5c\" (UID: \"1dc89e41-1e32-476f-b5fc-e45945a45efd\") " pod="openshift-cluster-node-tuning-operator/tuned-zpr5c"
Oct 30 20:38:15.483496 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.481663    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2f9dd030-281c-473e-b441-9ee972019413-cnibin\") pod \"multus-additional-cni-plugins-hmdcd\" (UID: \"2f9dd030-281c-473e-b441-9ee972019413\") " pod="openshift-multus/multus-additional-cni-plugins-hmdcd"
Oct 30 20:38:15.483496 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.481762    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/18d56389-8b1b-45d7-ac47-cd2b6c19c5dd-metrics-client-ca\") pod \"node-exporter-t4s4p\" (UID: \"18d56389-8b1b-45d7-ac47-cd2b6c19c5dd\") " pod="openshift-monitoring/node-exporter-t4s4p"
Oct 30 20:38:15.483496 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.481783    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4179c36b-8003-46e5-82b0-67f6edea7553-host\") pod \"node-ca-jnn4r\" (UID: \"4179c36b-8003-46e5-82b0-67f6edea7553\") " pod="openshift-image-registry/node-ca-jnn4r"
Oct 30 20:38:15.483496 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.481798    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/18d56389-8b1b-45d7-ac47-cd2b6c19c5dd-node-exporter-textfile\") pod \"node-exporter-t4s4p\" (UID: \"18d56389-8b1b-45d7-ac47-cd2b6c19c5dd\") " pod="openshift-monitoring/node-exporter-t4s4p"
Oct 30 20:38:15.483496 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.481820    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/0b7ae038-91bf-40f1-9930-8a6158706a3e-log-socket\") pod \"ovnkube-node-mw7xm\" (UID: \"0b7ae038-91bf-40f1-9930-8a6158706a3e\") " pod="openshift-ovn-kubernetes/ovnkube-node-mw7xm"
Oct 30 20:38:15.483496 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.481837    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/ac7adab4-061f-4371-bc6c-96260eb988d8-host-run-multus-certs\") pod \"multus-sxqtp\" (UID: \"ac7adab4-061f-4371-bc6c-96260eb988d8\") " pod="openshift-multus/multus-sxqtp"
Oct 30 20:38:15.483496 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.481839    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/6cd9770e-ea54-4c33-ac1e-5643f3d8839d-samples-operator-tls\") pod \"cluster-samples-operator-6ddb6c8b94-7d57c\" (UID: \"6cd9770e-ea54-4c33-ac1e-5643f3d8839d\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-7d57c"
Oct 30 20:38:15.483496 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.481869    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/780e67fb-196e-485a-8aa4-e11cecdc4b63-device-dir\") pod \"aws-ebs-csi-driver-node-qbnnn\" (UID: \"780e67fb-196e-485a-8aa4-e11cecdc4b63\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qbnnn"
Oct 30 20:38:15.483496 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.481892    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1dc89e41-1e32-476f-b5fc-e45945a45efd-host\") pod \"tuned-zpr5c\" (UID: \"1dc89e41-1e32-476f-b5fc-e45945a45efd\") " pod="openshift-cluster-node-tuning-operator/tuned-zpr5c"
Oct 30 20:38:15.483496 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.481913    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/a4cdc725-3dd0-4917-b8a0-c8ff77a40abb-dbus\") pod \"global-pull-secret-syncer-tvvd9\" (UID: \"a4cdc725-3dd0-4917-b8a0-c8ff77a40abb\") " pod="kube-system/global-pull-secret-syncer-tvvd9"
Oct 30 20:38:15.483496 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.481913    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/780e67fb-196e-485a-8aa4-e11cecdc4b63-device-dir\") pod \"aws-ebs-csi-driver-node-qbnnn\" (UID: \"780e67fb-196e-485a-8aa4-e11cecdc4b63\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qbnnn"
Oct 30 20:38:15.483496 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.481960    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/ac7adab4-061f-4371-bc6c-96260eb988d8-host-run-multus-certs\") pod \"multus-sxqtp\" (UID: \"ac7adab4-061f-4371-bc6c-96260eb988d8\") " pod="openshift-multus/multus-sxqtp"
Oct 30 20:38:15.483496 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.481964    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/a4cdc725-3dd0-4917-b8a0-c8ff77a40abb-dbus\") pod \"global-pull-secret-syncer-tvvd9\" (UID: \"a4cdc725-3dd0-4917-b8a0-c8ff77a40abb\") " pod="kube-system/global-pull-secret-syncer-tvvd9"
Oct 30 20:38:15.483496 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.481963    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/4dde41e2-34fe-429b-bf23-35bdb99d894e-serving-cert\") pod \"insights-operator-7c4986d449-tvsdw\" (UID: \"4dde41e2-34fe-429b-bf23-35bdb99d894e\") " pod="openshift-insights/insights-operator-7c4986d449-tvsdw"
Oct 30 20:38:15.483496 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.482159    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4dde41e2-34fe-429b-bf23-35bdb99d894e-trusted-ca-bundle\") pod \"insights-operator-7c4986d449-tvsdw\" (UID: \"4dde41e2-34fe-429b-bf23-35bdb99d894e\") " pod="openshift-insights/insights-operator-7c4986d449-tvsdw"
Oct 30 20:38:15.483496 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.482302    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/4dde41e2-34fe-429b-bf23-35bdb99d894e-serving-cert\") pod \"insights-operator-7c4986d449-tvsdw\" (UID: \"4dde41e2-34fe-429b-bf23-35bdb99d894e\") " pod="openshift-insights/insights-operator-7c4986d449-tvsdw"
Oct 30 20:38:15.483496 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.482291    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/4179c36b-8003-46e5-82b0-67f6edea7553-serviceca\") pod \"node-ca-jnn4r\" (UID: \"4179c36b-8003-46e5-82b0-67f6edea7553\") " pod="openshift-image-registry/node-ca-jnn4r"
Oct 30 20:38:15.483496 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.482322    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/90cd3de0-c573-41c2-bf3e-cf0e46a41d50-trusted-ca\") pod \"console-operator-7cd56b8dbc-sb7ds\" (UID: \"90cd3de0-c573-41c2-bf3e-cf0e46a41d50\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-sb7ds"
Oct 30 20:38:15.536239 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.536215    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-79wpr\" (UniqueName: \"kubernetes.io/projected/4179c36b-8003-46e5-82b0-67f6edea7553-kube-api-access-79wpr\") pod \"node-ca-jnn4r\" (UID: \"4179c36b-8003-46e5-82b0-67f6edea7553\") " pod="openshift-image-registry/node-ca-jnn4r"
Oct 30 20:38:15.536848 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.536824    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wc2mp\" (UniqueName: \"kubernetes.io/projected/1dc89e41-1e32-476f-b5fc-e45945a45efd-kube-api-access-wc2mp\") pod \"tuned-zpr5c\" (UID: \"1dc89e41-1e32-476f-b5fc-e45945a45efd\") " pod="openshift-cluster-node-tuning-operator/tuned-zpr5c"
Oct 30 20:38:15.536963 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.536873    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-48plj\" (UniqueName: \"kubernetes.io/projected/2f9dd030-281c-473e-b441-9ee972019413-kube-api-access-48plj\") pod \"multus-additional-cni-plugins-hmdcd\" (UID: \"2f9dd030-281c-473e-b441-9ee972019413\") " pod="openshift-multus/multus-additional-cni-plugins-hmdcd"
Oct 30 20:38:15.537291 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.537271    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-trh2f\" (UniqueName: \"kubernetes.io/projected/6cd9770e-ea54-4c33-ac1e-5643f3d8839d-kube-api-access-trh2f\") pod \"cluster-samples-operator-6ddb6c8b94-7d57c\" (UID: \"6cd9770e-ea54-4c33-ac1e-5643f3d8839d\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-7d57c"
Oct 30 20:38:15.537426 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.537406    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xp792\" (UniqueName: \"kubernetes.io/projected/4dde41e2-34fe-429b-bf23-35bdb99d894e-kube-api-access-xp792\") pod \"insights-operator-7c4986d449-tvsdw\" (UID: \"4dde41e2-34fe-429b-bf23-35bdb99d894e\") " pod="openshift-insights/insights-operator-7c4986d449-tvsdw"
Oct 30 20:38:15.537463 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.537411    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9hnz8\" (UniqueName: \"kubernetes.io/projected/537a9c41-5ed1-4ff5-bf9a-9d0bcb853f80-kube-api-access-9hnz8\") pod \"volume-data-source-validator-58c9f5f46d-mwm8h\" (UID: \"537a9c41-5ed1-4ff5-bf9a-9d0bcb853f80\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-mwm8h"
Oct 30 20:38:15.537516 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.537499    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4r7tw\" (UniqueName: \"kubernetes.io/projected/e33ef368-1f7c-4455-beb9-a2b2c5106792-kube-api-access-4r7tw\") pod \"service-ca-operator-544d749c8c-gnfbh\" (UID: \"e33ef368-1f7c-4455-beb9-a2b2c5106792\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-gnfbh"
Oct 30 20:38:15.537683 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.537668    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zkkqp\" (UniqueName: \"kubernetes.io/projected/b2dae567-b378-41ed-9f7e-881153b7d03b-kube-api-access-zkkqp\") pod \"iptables-alerter-cll8f\" (UID: \"b2dae567-b378-41ed-9f7e-881153b7d03b\") " pod="openshift-network-operator/iptables-alerter-cll8f"
Oct 30 20:38:15.537931 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.537916    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mh8k8\" (UniqueName: \"kubernetes.io/projected/0b7ae038-91bf-40f1-9930-8a6158706a3e-kube-api-access-mh8k8\") pod \"ovnkube-node-mw7xm\" (UID: \"0b7ae038-91bf-40f1-9930-8a6158706a3e\") " pod="openshift-ovn-kubernetes/ovnkube-node-mw7xm"
Oct 30 20:38:15.539249 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.539228    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b3bff4d5-f9a8-4302-b63d-136ed3c6be35-bound-sa-token\") pod \"image-registry-6c5684fdcf-l5m76\" (UID: \"b3bff4d5-f9a8-4302-b63d-136ed3c6be35\") " pod="openshift-image-registry/image-registry-6c5684fdcf-l5m76"
Oct 30 20:38:15.539299 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.539280    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tz88w\" (UniqueName: \"kubernetes.io/projected/90cd3de0-c573-41c2-bf3e-cf0e46a41d50-kube-api-access-tz88w\") pod \"console-operator-7cd56b8dbc-sb7ds\" (UID: \"90cd3de0-c573-41c2-bf3e-cf0e46a41d50\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-sb7ds"
Oct 30 20:38:15.539430 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.539415    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-75wkc\" (UniqueName: \"kubernetes.io/projected/b3bff4d5-f9a8-4302-b63d-136ed3c6be35-kube-api-access-75wkc\") pod \"image-registry-6c5684fdcf-l5m76\" (UID: \"b3bff4d5-f9a8-4302-b63d-136ed3c6be35\") " pod="openshift-image-registry/image-registry-6c5684fdcf-l5m76"
Oct 30 20:38:15.540124 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.540105    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lc26k\" (UniqueName: \"kubernetes.io/projected/f1a05736-0bc6-4914-981e-5524121561e4-kube-api-access-lc26k\") pod \"kas-connection-checker-685895c7c9-tvmvh\" (UID: \"f1a05736-0bc6-4914-981e-5524121561e4\") " pod="kube-system/kas-connection-checker-685895c7c9-tvmvh"
Oct 30 20:38:15.541495 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.541478    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lq6t2\" (UniqueName: \"kubernetes.io/projected/0f424633-11a5-49fa-a933-f9c6ec7ca97e-kube-api-access-lq6t2\") pod \"network-metrics-daemon-mlctd\" (UID: \"0f424633-11a5-49fa-a933-f9c6ec7ca97e\") " pod="openshift-multus/network-metrics-daemon-mlctd"
Oct 30 20:38:15.582879 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.582853    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/0b7ae038-91bf-40f1-9930-8a6158706a3e-run-systemd\") pod \"ovnkube-node-mw7xm\" (UID: \"0b7ae038-91bf-40f1-9930-8a6158706a3e\") " pod="openshift-ovn-kubernetes/ovnkube-node-mw7xm"
Oct 30 20:38:15.582990 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.582886    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2f9dd030-281c-473e-b441-9ee972019413-tuning-conf-dir\") pod \"multus-additional-cni-plugins-hmdcd\" (UID: \"2f9dd030-281c-473e-b441-9ee972019413\") " pod="openshift-multus/multus-additional-cni-plugins-hmdcd"
Oct 30 20:38:15.582990 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.582905    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0b7ae038-91bf-40f1-9930-8a6158706a3e-var-lib-openvswitch\") pod \"ovnkube-node-mw7xm\" (UID: \"0b7ae038-91bf-40f1-9930-8a6158706a3e\") " pod="openshift-ovn-kubernetes/ovnkube-node-mw7xm"
Oct 30 20:38:15.582990 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.582921    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2f9dd030-281c-473e-b441-9ee972019413-cnibin\") pod \"multus-additional-cni-plugins-hmdcd\" (UID: \"2f9dd030-281c-473e-b441-9ee972019413\") " pod="openshift-multus/multus-additional-cni-plugins-hmdcd"
Oct 30 20:38:15.582990 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.582945    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/18d56389-8b1b-45d7-ac47-cd2b6c19c5dd-metrics-client-ca\") pod \"node-exporter-t4s4p\" (UID: \"18d56389-8b1b-45d7-ac47-cd2b6c19c5dd\") " pod="openshift-monitoring/node-exporter-t4s4p"
Oct 30 20:38:15.582990 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.582967    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4179c36b-8003-46e5-82b0-67f6edea7553-host\") pod \"node-ca-jnn4r\" (UID: \"4179c36b-8003-46e5-82b0-67f6edea7553\") " pod="openshift-image-registry/node-ca-jnn4r"
Oct 30 20:38:15.582990 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.582982    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/0b7ae038-91bf-40f1-9930-8a6158706a3e-run-systemd\") pod \"ovnkube-node-mw7xm\" (UID: \"0b7ae038-91bf-40f1-9930-8a6158706a3e\") " pod="openshift-ovn-kubernetes/ovnkube-node-mw7xm"
Oct 30 20:38:15.583305 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.582997    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0b7ae038-91bf-40f1-9930-8a6158706a3e-var-lib-openvswitch\") pod \"ovnkube-node-mw7xm\" (UID: \"0b7ae038-91bf-40f1-9930-8a6158706a3e\") " pod="openshift-ovn-kubernetes/ovnkube-node-mw7xm"
Oct 30 20:38:15.583305 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.583010    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4179c36b-8003-46e5-82b0-67f6edea7553-host\") pod \"node-ca-jnn4r\" (UID: \"4179c36b-8003-46e5-82b0-67f6edea7553\") " pod="openshift-image-registry/node-ca-jnn4r"
Oct 30 20:38:15.583305 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.582981    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2f9dd030-281c-473e-b441-9ee972019413-tuning-conf-dir\") pod \"multus-additional-cni-plugins-hmdcd\" (UID: \"2f9dd030-281c-473e-b441-9ee972019413\") " pod="openshift-multus/multus-additional-cni-plugins-hmdcd"
Oct 30 20:38:15.583305 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.583009    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2f9dd030-281c-473e-b441-9ee972019413-cnibin\") pod \"multus-additional-cni-plugins-hmdcd\" (UID: \"2f9dd030-281c-473e-b441-9ee972019413\") " pod="openshift-multus/multus-additional-cni-plugins-hmdcd"
Oct 30 20:38:15.583305 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.583034    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/18d56389-8b1b-45d7-ac47-cd2b6c19c5dd-node-exporter-textfile\") pod \"node-exporter-t4s4p\" (UID: \"18d56389-8b1b-45d7-ac47-cd2b6c19c5dd\") " pod="openshift-monitoring/node-exporter-t4s4p"
Oct 30 20:38:15.583305 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.583085    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/0b7ae038-91bf-40f1-9930-8a6158706a3e-log-socket\") pod \"ovnkube-node-mw7xm\" (UID: \"0b7ae038-91bf-40f1-9930-8a6158706a3e\") " pod="openshift-ovn-kubernetes/ovnkube-node-mw7xm"
Oct 30 20:38:15.583305 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.583111    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/0b7ae038-91bf-40f1-9930-8a6158706a3e-log-socket\") pod \"ovnkube-node-mw7xm\" (UID: \"0b7ae038-91bf-40f1-9930-8a6158706a3e\") " pod="openshift-ovn-kubernetes/ovnkube-node-mw7xm"
Oct 30 20:38:15.583305 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.583112    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1dc89e41-1e32-476f-b5fc-e45945a45efd-host\") pod \"tuned-zpr5c\" (UID: \"1dc89e41-1e32-476f-b5fc-e45945a45efd\") " pod="openshift-cluster-node-tuning-operator/tuned-zpr5c"
Oct 30 20:38:15.583305 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.583145    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1dc89e41-1e32-476f-b5fc-e45945a45efd-host\") pod \"tuned-zpr5c\" (UID: \"1dc89e41-1e32-476f-b5fc-e45945a45efd\") " pod="openshift-cluster-node-tuning-operator/tuned-zpr5c"
Oct 30 20:38:15.583305 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.583144    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0b7ae038-91bf-40f1-9930-8a6158706a3e-run-openvswitch\") pod \"ovnkube-node-mw7xm\" (UID: \"0b7ae038-91bf-40f1-9930-8a6158706a3e\") " pod="openshift-ovn-kubernetes/ovnkube-node-mw7xm"
Oct 30 20:38:15.583305 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.583166    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/0b7ae038-91bf-40f1-9930-8a6158706a3e-host-cni-netd\") pod \"ovnkube-node-mw7xm\" (UID: \"0b7ae038-91bf-40f1-9930-8a6158706a3e\") " pod="openshift-ovn-kubernetes/ovnkube-node-mw7xm"
Oct 30 20:38:15.583305 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.583171    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0b7ae038-91bf-40f1-9930-8a6158706a3e-run-openvswitch\") pod \"ovnkube-node-mw7xm\" (UID: \"0b7ae038-91bf-40f1-9930-8a6158706a3e\") " pod="openshift-ovn-kubernetes/ovnkube-node-mw7xm"
Oct 30 20:38:15.583305 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.583182    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/18d56389-8b1b-45d7-ac47-cd2b6c19c5dd-sys\") pod \"node-exporter-t4s4p\" (UID: \"18d56389-8b1b-45d7-ac47-cd2b6c19c5dd\") " pod="openshift-monitoring/node-exporter-t4s4p"
Oct 30 20:38:15.583305 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.583220    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0b7ae038-91bf-40f1-9930-8a6158706a3e-host-slash\") pod \"ovnkube-node-mw7xm\" (UID: \"0b7ae038-91bf-40f1-9930-8a6158706a3e\") " pod="openshift-ovn-kubernetes/ovnkube-node-mw7xm"
Oct 30 20:38:15.583305 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.583225    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/0b7ae038-91bf-40f1-9930-8a6158706a3e-host-cni-netd\") pod \"ovnkube-node-mw7xm\" (UID: \"0b7ae038-91bf-40f1-9930-8a6158706a3e\") " pod="openshift-ovn-kubernetes/ovnkube-node-mw7xm"
Oct 30 20:38:15.583305 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.583231    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/18d56389-8b1b-45d7-ac47-cd2b6c19c5dd-sys\") pod \"node-exporter-t4s4p\" (UID: \"18d56389-8b1b-45d7-ac47-cd2b6c19c5dd\") " pod="openshift-monitoring/node-exporter-t4s4p"
Oct 30 20:38:15.583305 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.583272    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0b7ae038-91bf-40f1-9930-8a6158706a3e-host-slash\") pod \"ovnkube-node-mw7xm\" (UID: \"0b7ae038-91bf-40f1-9930-8a6158706a3e\") " pod="openshift-ovn-kubernetes/ovnkube-node-mw7xm"
Oct 30 20:38:15.583305 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.583248    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/18d56389-8b1b-45d7-ac47-cd2b6c19c5dd-node-exporter-tls\") pod \"node-exporter-t4s4p\" (UID: \"18d56389-8b1b-45d7-ac47-cd2b6c19c5dd\") " pod="openshift-monitoring/node-exporter-t4s4p"
Oct 30 20:38:15.583305 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.583301    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/0b7ae038-91bf-40f1-9930-8a6158706a3e-host-kubelet\") pod \"ovnkube-node-mw7xm\" (UID: \"0b7ae038-91bf-40f1-9930-8a6158706a3e\") " pod="openshift-ovn-kubernetes/ovnkube-node-mw7xm"
Oct 30 20:38:15.584154 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.583332    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/0b7ae038-91bf-40f1-9930-8a6158706a3e-host-kubelet\") pod \"ovnkube-node-mw7xm\" (UID: \"0b7ae038-91bf-40f1-9930-8a6158706a3e\") " pod="openshift-ovn-kubernetes/ovnkube-node-mw7xm"
Oct 30 20:38:15.584154 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.583334    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0b7ae038-91bf-40f1-9930-8a6158706a3e-host-run-ovn-kubernetes\") pod \"ovnkube-node-mw7xm\" (UID: \"0b7ae038-91bf-40f1-9930-8a6158706a3e\") " pod="openshift-ovn-kubernetes/ovnkube-node-mw7xm"
Oct 30 20:38:15.584154 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.583367    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0b7ae038-91bf-40f1-9930-8a6158706a3e-host-run-ovn-kubernetes\") pod \"ovnkube-node-mw7xm\" (UID: \"0b7ae038-91bf-40f1-9930-8a6158706a3e\") " pod="openshift-ovn-kubernetes/ovnkube-node-mw7xm"
Oct 30 20:38:15.584154 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.583372    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/18d56389-8b1b-45d7-ac47-cd2b6c19c5dd-root\") pod \"node-exporter-t4s4p\" (UID: \"18d56389-8b1b-45d7-ac47-cd2b6c19c5dd\") " pod="openshift-monitoring/node-exporter-t4s4p"
Oct 30 20:38:15.584154 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.583368    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/18d56389-8b1b-45d7-ac47-cd2b6c19c5dd-node-exporter-textfile\") pod \"node-exporter-t4s4p\" (UID: \"18d56389-8b1b-45d7-ac47-cd2b6c19c5dd\") " pod="openshift-monitoring/node-exporter-t4s4p"
Oct 30 20:38:15.584154 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.583397    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/18d56389-8b1b-45d7-ac47-cd2b6c19c5dd-node-exporter-wtmp\") pod \"node-exporter-t4s4p\" (UID: \"18d56389-8b1b-45d7-ac47-cd2b6c19c5dd\") " pod="openshift-monitoring/node-exporter-t4s4p"
Oct 30 20:38:15.584154 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.583419    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/18d56389-8b1b-45d7-ac47-cd2b6c19c5dd-root\") pod \"node-exporter-t4s4p\" (UID: \"18d56389-8b1b-45d7-ac47-cd2b6c19c5dd\") " pod="openshift-monitoring/node-exporter-t4s4p"
Oct 30 20:38:15.584154 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.583432    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/0b7ae038-91bf-40f1-9930-8a6158706a3e-run-ovn\") pod \"ovnkube-node-mw7xm\" (UID: \"0b7ae038-91bf-40f1-9930-8a6158706a3e\") " pod="openshift-ovn-kubernetes/ovnkube-node-mw7xm"
Oct 30 20:38:15.584154 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.583471    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/0b7ae038-91bf-40f1-9930-8a6158706a3e-systemd-units\") pod \"ovnkube-node-mw7xm\" (UID: \"0b7ae038-91bf-40f1-9930-8a6158706a3e\") " pod="openshift-ovn-kubernetes/ovnkube-node-mw7xm"
Oct 30 20:38:15.584154 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.583495    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dn4n8\" (UniqueName: \"kubernetes.io/projected/18d56389-8b1b-45d7-ac47-cd2b6c19c5dd-kube-api-access-dn4n8\") pod \"node-exporter-t4s4p\" (UID: \"18d56389-8b1b-45d7-ac47-cd2b6c19c5dd\") " pod="openshift-monitoring/node-exporter-t4s4p"
Oct 30 20:38:15.584154 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.583519    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/0b7ae038-91bf-40f1-9930-8a6158706a3e-run-ovn\") pod \"ovnkube-node-mw7xm\" (UID: \"0b7ae038-91bf-40f1-9930-8a6158706a3e\") " pod="openshift-ovn-kubernetes/ovnkube-node-mw7xm"
Oct 30 20:38:15.584154 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.583525    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2f9dd030-281c-473e-b441-9ee972019413-system-cni-dir\") pod \"multus-additional-cni-plugins-hmdcd\" (UID: \"2f9dd030-281c-473e-b441-9ee972019413\") " pod="openshift-multus/multus-additional-cni-plugins-hmdcd"
Oct 30 20:38:15.584154 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.583536    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/18d56389-8b1b-45d7-ac47-cd2b6c19c5dd-node-exporter-wtmp\") pod \"node-exporter-t4s4p\" (UID: \"18d56389-8b1b-45d7-ac47-cd2b6c19c5dd\") " pod="openshift-monitoring/node-exporter-t4s4p"
Oct 30 20:38:15.584154 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.583555    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2f9dd030-281c-473e-b441-9ee972019413-system-cni-dir\") pod \"multus-additional-cni-plugins-hmdcd\" (UID: \"2f9dd030-281c-473e-b441-9ee972019413\") " pod="openshift-multus/multus-additional-cni-plugins-hmdcd"
Oct 30 20:38:15.584154 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.583548    6004 swap_util.go:78] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Oct 30 20:38:15.584154 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.583572    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0b7ae038-91bf-40f1-9930-8a6158706a3e-etc-openvswitch\") pod \"ovnkube-node-mw7xm\" (UID: \"0b7ae038-91bf-40f1-9930-8a6158706a3e\") " pod="openshift-ovn-kubernetes/ovnkube-node-mw7xm"
Oct 30 20:38:15.584154 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.583599    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0b7ae038-91bf-40f1-9930-8a6158706a3e-etc-openvswitch\") pod \"ovnkube-node-mw7xm\" (UID: \"0b7ae038-91bf-40f1-9930-8a6158706a3e\") " pod="openshift-ovn-kubernetes/ovnkube-node-mw7xm"
Oct 30 20:38:15.584154 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.583554    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/0b7ae038-91bf-40f1-9930-8a6158706a3e-systemd-units\") pod \"ovnkube-node-mw7xm\" (UID: \"0b7ae038-91bf-40f1-9930-8a6158706a3e\") " pod="openshift-ovn-kubernetes/ovnkube-node-mw7xm"
Oct 30 20:38:15.584154 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.583935    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/18d56389-8b1b-45d7-ac47-cd2b6c19c5dd-metrics-client-ca\") pod \"node-exporter-t4s4p\" (UID: \"18d56389-8b1b-45d7-ac47-cd2b6c19c5dd\") " pod="openshift-monitoring/node-exporter-t4s4p"
Oct 30 20:38:15.584154 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.583602    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0b7ae038-91bf-40f1-9930-8a6158706a3e-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-mw7xm\" (UID: \"0b7ae038-91bf-40f1-9930-8a6158706a3e\") " pod="openshift-ovn-kubernetes/ovnkube-node-mw7xm"
Oct 30 20:38:15.584154 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.584032    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0b7ae038-91bf-40f1-9930-8a6158706a3e-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-mw7xm\" (UID: \"0b7ae038-91bf-40f1-9930-8a6158706a3e\") " pod="openshift-ovn-kubernetes/ovnkube-node-mw7xm"
Oct 30 20:38:15.584154 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.584084    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/18d56389-8b1b-45d7-ac47-cd2b6c19c5dd-node-exporter-accelerators-collector-config\") pod \"node-exporter-t4s4p\" (UID: \"18d56389-8b1b-45d7-ac47-cd2b6c19c5dd\") " pod="openshift-monitoring/node-exporter-t4s4p"
Oct 30 20:38:15.584154 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.584162    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0b7ae038-91bf-40f1-9930-8a6158706a3e-host-run-netns\") pod \"ovnkube-node-mw7xm\" (UID: \"0b7ae038-91bf-40f1-9930-8a6158706a3e\") " pod="openshift-ovn-kubernetes/ovnkube-node-mw7xm"
Oct 30 20:38:15.585255 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.584208    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b2dae567-b378-41ed-9f7e-881153b7d03b-host-slash\") pod \"iptables-alerter-cll8f\" (UID: \"b2dae567-b378-41ed-9f7e-881153b7d03b\") " pod="openshift-network-operator/iptables-alerter-cll8f"
Oct 30 20:38:15.585255 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.584250    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0b7ae038-91bf-40f1-9930-8a6158706a3e-host-cni-bin\") pod \"ovnkube-node-mw7xm\" (UID: \"0b7ae038-91bf-40f1-9930-8a6158706a3e\") " pod="openshift-ovn-kubernetes/ovnkube-node-mw7xm"
Oct 30 20:38:15.585255 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.584309    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/18d56389-8b1b-45d7-ac47-cd2b6c19c5dd-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-t4s4p\" (UID: \"18d56389-8b1b-45d7-ac47-cd2b6c19c5dd\") " pod="openshift-monitoring/node-exporter-t4s4p"
Oct 30 20:38:15.585255 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.584364    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/0b7ae038-91bf-40f1-9930-8a6158706a3e-node-log\") pod \"ovnkube-node-mw7xm\" (UID: \"0b7ae038-91bf-40f1-9930-8a6158706a3e\") " pod="openshift-ovn-kubernetes/ovnkube-node-mw7xm"
Oct 30 20:38:15.585255 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.584367    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b2dae567-b378-41ed-9f7e-881153b7d03b-host-slash\") pod \"iptables-alerter-cll8f\" (UID: \"b2dae567-b378-41ed-9f7e-881153b7d03b\") " pod="openshift-network-operator/iptables-alerter-cll8f"
Oct 30 20:38:15.585255 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.584663    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/18d56389-8b1b-45d7-ac47-cd2b6c19c5dd-node-exporter-accelerators-collector-config\") pod \"node-exporter-t4s4p\" (UID: \"18d56389-8b1b-45d7-ac47-cd2b6c19c5dd\") " pod="openshift-monitoring/node-exporter-t4s4p"
Oct 30 20:38:15.585255 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.584821    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/0b7ae038-91bf-40f1-9930-8a6158706a3e-node-log\") pod \"ovnkube-node-mw7xm\" (UID: \"0b7ae038-91bf-40f1-9930-8a6158706a3e\") " pod="openshift-ovn-kubernetes/ovnkube-node-mw7xm"
Oct 30 20:38:15.585255 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.585171    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0b7ae038-91bf-40f1-9930-8a6158706a3e-host-run-netns\") pod \"ovnkube-node-mw7xm\" (UID: \"0b7ae038-91bf-40f1-9930-8a6158706a3e\") " pod="openshift-ovn-kubernetes/ovnkube-node-mw7xm"
Oct 30 20:38:15.585255 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.585222    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0b7ae038-91bf-40f1-9930-8a6158706a3e-host-cni-bin\") pod \"ovnkube-node-mw7xm\" (UID: \"0b7ae038-91bf-40f1-9930-8a6158706a3e\") " pod="openshift-ovn-kubernetes/ovnkube-node-mw7xm"
Oct 30 20:38:15.585726 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.585500    6004 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-5b9d6cdd59-4g6mx"
Oct 30 20:38:15.586628 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.586119    6004 scope.go:122] "RemoveContainer" containerID="22e92c57dba3dc870b000562eeb828e9942a53023e03c3fc4d8722d561ea38f7"
Oct 30 20:38:15.586628 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.586550    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/18d56389-8b1b-45d7-ac47-cd2b6c19c5dd-node-exporter-tls\") pod \"node-exporter-t4s4p\" (UID: \"18d56389-8b1b-45d7-ac47-cd2b6c19c5dd\") " pod="openshift-monitoring/node-exporter-t4s4p"
Oct 30 20:38:15.589695 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.587568    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/18d56389-8b1b-45d7-ac47-cd2b6c19c5dd-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-t4s4p\" (UID: \"18d56389-8b1b-45d7-ac47-cd2b6c19c5dd\") " pod="openshift-monitoring/node-exporter-t4s4p"
Oct 30 20:38:15.644783 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.644757    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dn4n8\" (UniqueName: \"kubernetes.io/projected/18d56389-8b1b-45d7-ac47-cd2b6c19c5dd-kube-api-access-dn4n8\") pod \"node-exporter-t4s4p\" (UID: \"18d56389-8b1b-45d7-ac47-cd2b6c19c5dd\") " pod="openshift-monitoring/node-exporter-t4s4p"
Oct 30 20:38:15.694113 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.694017    6004 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-t4s4p"
Oct 30 20:38:15.727757 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:15.727728    6004 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod18d56389_8b1b_45d7_ac47_cd2b6c19c5dd.slice/crio-5cce71c1b2ce4bea4d63103586ab55ca5afa53a9b7da0ca36539071d92070074 WatchSource:0}: Error finding container 5cce71c1b2ce4bea4d63103586ab55ca5afa53a9b7da0ca36539071d92070074: Status 404 returned error can't find the container with id 5cce71c1b2ce4bea4d63103586ab55ca5afa53a9b7da0ca36539071d92070074
Oct 30 20:38:15.729593 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:15.729576    6004 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Oct 30 20:38:16.330085 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:16.330034    6004 generic.go:356] "Generic (PLEG): container finished" podID="ee37dd25-4ac1-474f-80b8-d04da8da560c" containerID="7f847c009231ad38087375d9151e3fcaadac4d6a84c47211683dc5d0bebc0e02" exitCode=0
Oct 30 20:38:16.330460 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:16.330090    6004 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-j7q2s" event={"ID":"ee37dd25-4ac1-474f-80b8-d04da8da560c","Type":"ContainerDied","Data":"7f847c009231ad38087375d9151e3fcaadac4d6a84c47211683dc5d0bebc0e02"}
Oct 30 20:38:16.330534 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:16.330479    6004 scope.go:122] "RemoveContainer" containerID="7f847c009231ad38087375d9151e3fcaadac4d6a84c47211683dc5d0bebc0e02"
Oct 30 20:38:16.332323 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:16.332303    6004 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-sb7ds_90cd3de0-c573-41c2-bf3e-cf0e46a41d50/console-operator/2.log"
Oct 30 20:38:16.332437 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:16.332416    6004 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7cd56b8dbc-sb7ds" event={"ID":"90cd3de0-c573-41c2-bf3e-cf0e46a41d50","Type":"ContainerStarted","Data":"dedfb764e391cda79316dae3bba4bb776b40fff6bed008fdbab6ebdcffe9e96b"}
Oct 30 20:38:16.334154 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:16.334130    6004 generic.go:356] "Generic (PLEG): container finished" podID="4dde41e2-34fe-429b-bf23-35bdb99d894e" containerID="87fb172d2018fb8af934e3e754c5b80e94d153407d1dec4defc3cb111f61afc2" exitCode=0
Oct 30 20:38:16.334247 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:16.334204    6004 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-7c4986d449-tvsdw" event={"ID":"4dde41e2-34fe-429b-bf23-35bdb99d894e","Type":"ContainerDied","Data":"87fb172d2018fb8af934e3e754c5b80e94d153407d1dec4defc3cb111f61afc2"}
Oct 30 20:38:16.334497 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:16.334482    6004 scope.go:122] "RemoveContainer" containerID="87fb172d2018fb8af934e3e754c5b80e94d153407d1dec4defc3cb111f61afc2"
Oct 30 20:38:16.335515 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:16.335495    6004 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-t4s4p" event={"ID":"18d56389-8b1b-45d7-ac47-cd2b6c19c5dd","Type":"ContainerStarted","Data":"5cce71c1b2ce4bea4d63103586ab55ca5afa53a9b7da0ca36539071d92070074"}
Oct 30 20:38:16.565627 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:16.565555    6004 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-265zm"
Oct 30 20:38:16.587564 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:16.587530    6004 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-5b9d6cdd59-4g6mx"
Oct 30 20:38:16.985925 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:16.985897    6004 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-mw7xm"
Oct 30 20:38:17.345615 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:17.345532    6004 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-j7q2s" event={"ID":"ee37dd25-4ac1-474f-80b8-d04da8da560c","Type":"ContainerStarted","Data":"d7cbe555f73b04a6475d0da9999b5e517e6a660ad26b5ac13c836d22085cbd21"}
Oct 30 20:38:17.347239 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:17.347206    6004 generic.go:356] "Generic (PLEG): container finished" podID="e33ef368-1f7c-4455-beb9-a2b2c5106792" containerID="7fc9ee7ed72e74b95eedce1763293fd97eaad1e1fd13a2febb3256895a23020b" exitCode=0
Oct 30 20:38:17.347357 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:17.347324    6004 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-gnfbh" event={"ID":"e33ef368-1f7c-4455-beb9-a2b2c5106792","Type":"ContainerDied","Data":"7fc9ee7ed72e74b95eedce1763293fd97eaad1e1fd13a2febb3256895a23020b"}
Oct 30 20:38:17.347661 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:17.347643    6004 scope.go:122] "RemoveContainer" containerID="7fc9ee7ed72e74b95eedce1763293fd97eaad1e1fd13a2febb3256895a23020b"
Oct 30 20:38:17.349723 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:17.349699    6004 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-7c4986d449-tvsdw" event={"ID":"4dde41e2-34fe-429b-bf23-35bdb99d894e","Type":"ContainerStarted","Data":"8c5f042b6a33e55268804cedc126ad70da574412334c21da2ee52299d021a71f"}
Oct 30 20:38:17.765673 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:17.765652    6004 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-mw7xm"
Oct 30 20:38:17.765849 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:17.765837    6004 prober_manager.go:356] "Failed to trigger a manual run" probe="Readiness"
Oct 30 20:38:17.849681 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:17.849644    6004 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-insights/periodic-gathering-s5zd4-r8bqt"]
Oct 30 20:38:17.875146 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:17.875116    6004 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/periodic-gathering-s5zd4-r8bqt"
Oct 30 20:38:17.905481 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:17.905452    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"archives-path\" (UniqueName: \"kubernetes.io/empty-dir/43784843-b8c8-4a5e-a079-bf03f4a50fc1-archives-path\") pod \"periodic-gathering-s5zd4-r8bqt\" (UID: \"43784843-b8c8-4a5e-a079-bf03f4a50fc1\") " pod="openshift-insights/periodic-gathering-s5zd4-r8bqt"
Oct 30 20:38:17.905606 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:17.905494    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/43784843-b8c8-4a5e-a079-bf03f4a50fc1-service-ca-bundle\") pod \"periodic-gathering-s5zd4-r8bqt\" (UID: \"43784843-b8c8-4a5e-a079-bf03f4a50fc1\") " pod="openshift-insights/periodic-gathering-s5zd4-r8bqt"
Oct 30 20:38:17.905642 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:17.905607    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-658tt\" (UniqueName: \"kubernetes.io/projected/43784843-b8c8-4a5e-a079-bf03f4a50fc1-kube-api-access-658tt\") pod \"periodic-gathering-s5zd4-r8bqt\" (UID: \"43784843-b8c8-4a5e-a079-bf03f4a50fc1\") " pod="openshift-insights/periodic-gathering-s5zd4-r8bqt"
Oct 30 20:38:17.905672 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:17.905647    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/43784843-b8c8-4a5e-a079-bf03f4a50fc1-trusted-ca-bundle\") pod \"periodic-gathering-s5zd4-r8bqt\" (UID: \"43784843-b8c8-4a5e-a079-bf03f4a50fc1\") " pod="openshift-insights/periodic-gathering-s5zd4-r8bqt"
Oct 30 20:38:17.913441 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:17.913417    6004 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-insights/periodic-gathering-s5zd4-r8bqt"]
Oct 30 20:38:17.993361 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:17.993328    6004 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-6489d8bf89-fqdw6"
Oct 30 20:38:17.997120 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:17.997096    6004 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-6489d8bf89-fqdw6"
Oct 30 20:38:18.006922 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:18.006903    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-658tt\" (UniqueName: \"kubernetes.io/projected/43784843-b8c8-4a5e-a079-bf03f4a50fc1-kube-api-access-658tt\") pod \"periodic-gathering-s5zd4-r8bqt\" (UID: \"43784843-b8c8-4a5e-a079-bf03f4a50fc1\") " pod="openshift-insights/periodic-gathering-s5zd4-r8bqt"
Oct 30 20:38:18.007000 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:18.006947    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/43784843-b8c8-4a5e-a079-bf03f4a50fc1-trusted-ca-bundle\") pod \"periodic-gathering-s5zd4-r8bqt\" (UID: \"43784843-b8c8-4a5e-a079-bf03f4a50fc1\") " pod="openshift-insights/periodic-gathering-s5zd4-r8bqt"
Oct 30 20:38:18.007000 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:18.006971    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"archives-path\" (UniqueName: \"kubernetes.io/empty-dir/43784843-b8c8-4a5e-a079-bf03f4a50fc1-archives-path\") pod \"periodic-gathering-s5zd4-r8bqt\" (UID: \"43784843-b8c8-4a5e-a079-bf03f4a50fc1\") " pod="openshift-insights/periodic-gathering-s5zd4-r8bqt"
Oct 30 20:38:18.007135 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:18.007006    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/43784843-b8c8-4a5e-a079-bf03f4a50fc1-service-ca-bundle\") pod \"periodic-gathering-s5zd4-r8bqt\" (UID: \"43784843-b8c8-4a5e-a079-bf03f4a50fc1\") " pod="openshift-insights/periodic-gathering-s5zd4-r8bqt"
Oct 30 20:38:18.007824 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:18.007793    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"archives-path\" (UniqueName: \"kubernetes.io/empty-dir/43784843-b8c8-4a5e-a079-bf03f4a50fc1-archives-path\") pod \"periodic-gathering-s5zd4-r8bqt\" (UID: \"43784843-b8c8-4a5e-a079-bf03f4a50fc1\") " pod="openshift-insights/periodic-gathering-s5zd4-r8bqt"
Oct 30 20:38:18.008335 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:18.008282    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/43784843-b8c8-4a5e-a079-bf03f4a50fc1-service-ca-bundle\") pod \"periodic-gathering-s5zd4-r8bqt\" (UID: \"43784843-b8c8-4a5e-a079-bf03f4a50fc1\") " pod="openshift-insights/periodic-gathering-s5zd4-r8bqt"
Oct 30 20:38:18.008438 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:18.008379    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/43784843-b8c8-4a5e-a079-bf03f4a50fc1-trusted-ca-bundle\") pod \"periodic-gathering-s5zd4-r8bqt\" (UID: \"43784843-b8c8-4a5e-a079-bf03f4a50fc1\") " pod="openshift-insights/periodic-gathering-s5zd4-r8bqt"
Oct 30 20:38:18.067906 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:18.067878    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-658tt\" (UniqueName: \"kubernetes.io/projected/43784843-b8c8-4a5e-a079-bf03f4a50fc1-kube-api-access-658tt\") pod \"periodic-gathering-s5zd4-r8bqt\" (UID: \"43784843-b8c8-4a5e-a079-bf03f4a50fc1\") " pod="openshift-insights/periodic-gathering-s5zd4-r8bqt"
Oct 30 20:38:18.111808 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:18.111774    6004 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-5b9d6cdd59-4g6mx"
Oct 30 20:38:18.113092 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:18.113067    6004 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-5b9d6cdd59-4g6mx"
Oct 30 20:38:18.251674 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:18.251647    6004 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/periodic-gathering-s5zd4-r8bqt"
Oct 30 20:38:18.360593 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:18.360562    6004 generic.go:356] "Generic (PLEG): container finished" podID="18d56389-8b1b-45d7-ac47-cd2b6c19c5dd" containerID="4eef95da0cadf440d3313662e40e972413f42faa6e0944f6e5cb03c2b881d247" exitCode=0
Oct 30 20:38:18.360967 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:18.360657    6004 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-t4s4p" event={"ID":"18d56389-8b1b-45d7-ac47-cd2b6c19c5dd","Type":"ContainerDied","Data":"4eef95da0cadf440d3313662e40e972413f42faa6e0944f6e5cb03c2b881d247"}
Oct 30 20:38:18.364177 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:18.363329    6004 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-gnfbh" event={"ID":"e33ef368-1f7c-4455-beb9-a2b2c5106792","Type":"ContainerStarted","Data":"3814964fe0bd9a1d674287006f63c4f3d6756d2148b962703e23475667f784c6"}
Oct 30 20:38:18.640965 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:18.640939    6004 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-insights/periodic-gathering-s5zd4-r8bqt"]
Oct 30 20:38:18.643864 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:38:18.643834    6004 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod43784843_b8c8_4a5e_a079_bf03f4a50fc1.slice/crio-cef00192b638460207c17d96ac313158cbec4a71435cb784b03b89cb51dd024c WatchSource:0}: Error finding container cef00192b638460207c17d96ac313158cbec4a71435cb784b03b89cb51dd024c: Status 404 returned error can't find the container with id cef00192b638460207c17d96ac313158cbec4a71435cb784b03b89cb51dd024c
Oct 30 20:38:19.370820 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:19.370786    6004 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/periodic-gathering-s5zd4-r8bqt" event={"ID":"43784843-b8c8-4a5e-a079-bf03f4a50fc1","Type":"ContainerStarted","Data":"c6c0de5b571a2a37d40cec1363898eefeb141dd512e58d2d356926e92403e65d"}
Oct 30 20:38:19.371327 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:19.370843    6004 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/periodic-gathering-s5zd4-r8bqt" event={"ID":"43784843-b8c8-4a5e-a079-bf03f4a50fc1","Type":"ContainerStarted","Data":"cef00192b638460207c17d96ac313158cbec4a71435cb784b03b89cb51dd024c"}
Oct 30 20:38:19.373561 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:19.373533    6004 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-t4s4p" event={"ID":"18d56389-8b1b-45d7-ac47-cd2b6c19c5dd","Type":"ContainerStarted","Data":"5605b90da8cc810f095f000bb753dbf2797fe2e4665b8cade49b1f27c103fb6f"}
Oct 30 20:38:19.373682 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:19.373582    6004 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-t4s4p" event={"ID":"18d56389-8b1b-45d7-ac47-cd2b6c19c5dd","Type":"ContainerStarted","Data":"3ca8a8b9ba161eef873565f6b37d48dac15a61bcf659ae23a3dfda44cbfbdfde"}
Oct 30 20:38:19.491656 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:19.491605    6004 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-insights/periodic-gathering-s5zd4-r8bqt" podStartSLOduration=2.491589308 podStartE2EDuration="2.491589308s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:38:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:38:19.490979508 +0000 UTC m=+5.410765625" watchObservedRunningTime="2026-10-30 20:38:19.491589308 +0000 UTC m=+5.411375499"
Oct 30 20:38:19.568397 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:19.568363    6004 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-265zm"
Oct 30 20:38:19.613948 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:19.613896    6004 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-t4s4p" podStartSLOduration=3.569102853 podStartE2EDuration="5.613881056s" totalImagesPullingTime="1.950825875s" totalInitContainerRuntime="93.952328ms" isStatefulPod=true podCreationTimestamp="2026-10-30 20:38:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:38:19.61340357 +0000 UTC m=+5.533189712" watchObservedRunningTime="2026-10-30 20:38:19.613881056 +0000 UTC m=+5.533667179"
Oct 30 20:38:20.183096 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:20.183065    6004 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-mw7xm"
Oct 30 20:38:20.245992 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:20.245961    6004 patch_prober.go:29] interesting pod/image-registry-57547d4649-8sjtp container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Oct 30 20:38:20.246164 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:20.246008    6004 prober.go:122] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-57547d4649-8sjtp" podUID="2aee32c9-f358-4ff4-9d50-c18dba9885a5" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 30 20:38:20.488247 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:20.488170    6004 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-265zm_aaadd8de-58cb-45af-a477-384fbf1cf317/dns/0.log"
Oct 30 20:38:20.591560 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:20.591527    6004 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-6c5684fdcf-l5m76"
Oct 30 20:38:20.593165 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:20.593142    6004 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-265zm_aaadd8de-58cb-45af-a477-384fbf1cf317/kube-rbac-proxy/0.log"
Oct 30 20:38:20.819003 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:20.818931    6004 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-lqdtq"
Oct 30 20:38:21.596952 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:21.596922    6004 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-t4227_16e71e18-453a-41bf-a3f8-9618482c9a50/dns-node-resolver/0.log"
Oct 30 20:38:21.797742 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:21.797704    6004 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-5b9d6cdd59-4g6mx_cd59fef4-66a5-471b-a8ef-18df25e44d5c/router/0.log"
Oct 30 20:38:22.197891 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:22.197860    6004 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-dhfg8_caca5f60-f777-4672-b570-faa422073cb9/serve-healthcheck-canary/0.log"
Oct 30 20:38:23.019537 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:23.019501    6004 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-7cd56b8dbc-sb7ds"
Oct 30 20:38:23.020003 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:23.019635    6004 prober_manager.go:356] "Failed to trigger a manual run" probe="Readiness"
Oct 30 20:38:23.023309 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:23.023283    6004 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-7cd56b8dbc-sb7ds"
Oct 30 20:38:27.617764 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:27.617691    6004 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-57547d4649-8sjtp"
Oct 30 20:38:27.842951 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:27.842917    6004 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-6c5684fdcf-l5m76"]
Oct 30 20:38:27.847098 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:27.847074    6004 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-6c5684fdcf-l5m76"
Oct 30 20:38:28.911995 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:28.911963    6004 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-x6f58"
Oct 30 20:38:35.128717 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:35.128680    6004 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-insights/periodic-gathering-c49f4-pnxgw"]
Oct 30 20:38:35.129237 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:35.128888    6004 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-insights/periodic-gathering-c49f4-pnxgw" podUID="519501c9-00d9-416f-887a-13b83aad5762" containerName="insights-gathering" containerID="cri-o://7b11d51d9a96d18226370422e6b941e17c849028210da4ad320edcb03c4771b5" gracePeriod=30
Oct 30 20:38:35.377417 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:35.377393    6004 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-insights/periodic-gathering-c49f4-pnxgw"
Oct 30 20:38:35.439465 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:35.439430    6004 generic.go:356] "Generic (PLEG): container finished" podID="519501c9-00d9-416f-887a-13b83aad5762" containerID="7b11d51d9a96d18226370422e6b941e17c849028210da4ad320edcb03c4771b5" exitCode=2
Oct 30 20:38:35.439603 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:35.439475    6004 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-insights/periodic-gathering-c49f4-pnxgw"
Oct 30 20:38:35.439603 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:35.439525    6004 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/periodic-gathering-c49f4-pnxgw" event={"ID":"519501c9-00d9-416f-887a-13b83aad5762","Type":"ContainerDied","Data":"7b11d51d9a96d18226370422e6b941e17c849028210da4ad320edcb03c4771b5"}
Oct 30 20:38:35.439603 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:35.439578    6004 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/periodic-gathering-c49f4-pnxgw" event={"ID":"519501c9-00d9-416f-887a-13b83aad5762","Type":"ContainerDied","Data":"7ac2c7083eb6835289efd435b8ec60ae66457c6a19c6f3d8e64f8b02bc1190e6"}
Oct 30 20:38:35.439698 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:35.439603    6004 scope.go:122] "RemoveContainer" containerID="7b11d51d9a96d18226370422e6b941e17c849028210da4ad320edcb03c4771b5"
Oct 30 20:38:35.447760 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:35.447744    6004 scope.go:122] "RemoveContainer" containerID="7b11d51d9a96d18226370422e6b941e17c849028210da4ad320edcb03c4771b5"
Oct 30 20:38:35.448108 ip-10-0-138-85 kubenswrapper[6004]: E1030 20:38:35.448087    6004 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7b11d51d9a96d18226370422e6b941e17c849028210da4ad320edcb03c4771b5\": container with ID starting with 7b11d51d9a96d18226370422e6b941e17c849028210da4ad320edcb03c4771b5 not found: ID does not exist" containerID="7b11d51d9a96d18226370422e6b941e17c849028210da4ad320edcb03c4771b5"
Oct 30 20:38:35.448192 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:35.448122    6004 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7b11d51d9a96d18226370422e6b941e17c849028210da4ad320edcb03c4771b5"} err="failed to get container status \"7b11d51d9a96d18226370422e6b941e17c849028210da4ad320edcb03c4771b5\": rpc error: code = NotFound desc = could not find container \"7b11d51d9a96d18226370422e6b941e17c849028210da4ad320edcb03c4771b5\": container with ID starting with 7b11d51d9a96d18226370422e6b941e17c849028210da4ad320edcb03c4771b5 not found: ID does not exist"
Oct 30 20:38:35.461347 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:35.461326    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/519501c9-00d9-416f-887a-13b83aad5762-archives-path\" (UniqueName: \"kubernetes.io/empty-dir/519501c9-00d9-416f-887a-13b83aad5762-archives-path\") pod \"519501c9-00d9-416f-887a-13b83aad5762\" (UID: \"519501c9-00d9-416f-887a-13b83aad5762\") "
Oct 30 20:38:35.461446 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:35.461396    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/519501c9-00d9-416f-887a-13b83aad5762-kube-api-access-f2b6b\" (UniqueName: \"kubernetes.io/projected/519501c9-00d9-416f-887a-13b83aad5762-kube-api-access-f2b6b\") pod \"519501c9-00d9-416f-887a-13b83aad5762\" (UID: \"519501c9-00d9-416f-887a-13b83aad5762\") "
Oct 30 20:38:35.461446 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:35.461430    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/519501c9-00d9-416f-887a-13b83aad5762-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/519501c9-00d9-416f-887a-13b83aad5762-service-ca-bundle\") pod \"519501c9-00d9-416f-887a-13b83aad5762\" (UID: \"519501c9-00d9-416f-887a-13b83aad5762\") "
Oct 30 20:38:35.461523 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:35.461450    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/519501c9-00d9-416f-887a-13b83aad5762-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/519501c9-00d9-416f-887a-13b83aad5762-trusted-ca-bundle\") pod \"519501c9-00d9-416f-887a-13b83aad5762\" (UID: \"519501c9-00d9-416f-887a-13b83aad5762\") "
Oct 30 20:38:35.461691 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:35.461665    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/519501c9-00d9-416f-887a-13b83aad5762-archives-path" pod "519501c9-00d9-416f-887a-13b83aad5762" (UID: "519501c9-00d9-416f-887a-13b83aad5762"). InnerVolumeSpecName "archives-path". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:38:35.461767 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:35.461747    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/519501c9-00d9-416f-887a-13b83aad5762-service-ca-bundle" pod "519501c9-00d9-416f-887a-13b83aad5762" (UID: "519501c9-00d9-416f-887a-13b83aad5762"). InnerVolumeSpecName "service-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 20:38:35.461883 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:35.461862    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/519501c9-00d9-416f-887a-13b83aad5762-trusted-ca-bundle" pod "519501c9-00d9-416f-887a-13b83aad5762" (UID: "519501c9-00d9-416f-887a-13b83aad5762"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 20:38:35.463540 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:35.463519    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/519501c9-00d9-416f-887a-13b83aad5762-kube-api-access-f2b6b" pod "519501c9-00d9-416f-887a-13b83aad5762" (UID: "519501c9-00d9-416f-887a-13b83aad5762"). InnerVolumeSpecName "kube-api-access-f2b6b". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:38:35.563007 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:35.562973    6004 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f2b6b\" (UniqueName: \"kubernetes.io/projected/519501c9-00d9-416f-887a-13b83aad5762-kube-api-access-f2b6b\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:38:35.563007 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:35.563000    6004 reconciler_common.go:299] "Volume detached for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/519501c9-00d9-416f-887a-13b83aad5762-service-ca-bundle\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:38:35.563007 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:35.563011    6004 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/519501c9-00d9-416f-887a-13b83aad5762-trusted-ca-bundle\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:38:35.563251 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:35.563019    6004 reconciler_common.go:299] "Volume detached for volume \"archives-path\" (UniqueName: \"kubernetes.io/empty-dir/519501c9-00d9-416f-887a-13b83aad5762-archives-path\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:38:35.857953 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:35.857918    6004 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-insights/periodic-gathering-c49f4-pnxgw"]
Oct 30 20:38:35.863621 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:35.863595    6004 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-insights/periodic-gathering-c49f4-pnxgw"]
Oct 30 20:38:36.229106 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:36.229067    6004 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="519501c9-00d9-416f-887a-13b83aad5762" path="/var/lib/kubelet/pods/519501c9-00d9-416f-887a-13b83aad5762/volumes"
Oct 30 20:38:44.285143 ip-10-0-138-85 kubenswrapper[6004]: E1030 20:38:44.285104    6004 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-zz4wr" containerName="extractor"
Oct 30 20:38:52.862465 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:52.862392    6004 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-image-registry/image-registry-6c5684fdcf-l5m76" podUID="b3bff4d5-f9a8-4302-b63d-136ed3c6be35" containerName="registry" containerID="cri-o://22640beac8730d2a896c3efed39a9cae4696ae5c13b58f6c6489eacac98a526b" gracePeriod=30
Oct 30 20:38:53.109686 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:53.109660    6004 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6c5684fdcf-l5m76"
Oct 30 20:38:53.215041 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:53.215010    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/b3bff4d5-f9a8-4302-b63d-136ed3c6be35-ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/b3bff4d5-f9a8-4302-b63d-136ed3c6be35-ca-trust-extracted\") pod \"b3bff4d5-f9a8-4302-b63d-136ed3c6be35\" (UID: \"b3bff4d5-f9a8-4302-b63d-136ed3c6be35\") "
Oct 30 20:38:53.215223 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:53.215117    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/b3bff4d5-f9a8-4302-b63d-136ed3c6be35-registry-certificates\" (UniqueName: \"kubernetes.io/configmap/b3bff4d5-f9a8-4302-b63d-136ed3c6be35-registry-certificates\") pod \"b3bff4d5-f9a8-4302-b63d-136ed3c6be35\" (UID: \"b3bff4d5-f9a8-4302-b63d-136ed3c6be35\") "
Oct 30 20:38:53.215223 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:53.215172    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/b3bff4d5-f9a8-4302-b63d-136ed3c6be35-bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b3bff4d5-f9a8-4302-b63d-136ed3c6be35-bound-sa-token\") pod \"b3bff4d5-f9a8-4302-b63d-136ed3c6be35\" (UID: \"b3bff4d5-f9a8-4302-b63d-136ed3c6be35\") "
Oct 30 20:38:53.215223 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:53.215215    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/b3bff4d5-f9a8-4302-b63d-136ed3c6be35-trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b3bff4d5-f9a8-4302-b63d-136ed3c6be35-trusted-ca\") pod \"b3bff4d5-f9a8-4302-b63d-136ed3c6be35\" (UID: \"b3bff4d5-f9a8-4302-b63d-136ed3c6be35\") "
Oct 30 20:38:53.215348 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:53.215243    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/b3bff4d5-f9a8-4302-b63d-136ed3c6be35-installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/b3bff4d5-f9a8-4302-b63d-136ed3c6be35-installation-pull-secrets\") pod \"b3bff4d5-f9a8-4302-b63d-136ed3c6be35\" (UID: \"b3bff4d5-f9a8-4302-b63d-136ed3c6be35\") "
Oct 30 20:38:53.215348 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:53.215274    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/b3bff4d5-f9a8-4302-b63d-136ed3c6be35-image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/b3bff4d5-f9a8-4302-b63d-136ed3c6be35-image-registry-private-configuration\") pod \"b3bff4d5-f9a8-4302-b63d-136ed3c6be35\" (UID: \"b3bff4d5-f9a8-4302-b63d-136ed3c6be35\") "
Oct 30 20:38:53.215348 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:53.215308    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/b3bff4d5-f9a8-4302-b63d-136ed3c6be35-kube-api-access-75wkc\" (UniqueName: \"kubernetes.io/projected/b3bff4d5-f9a8-4302-b63d-136ed3c6be35-kube-api-access-75wkc\") pod \"b3bff4d5-f9a8-4302-b63d-136ed3c6be35\" (UID: \"b3bff4d5-f9a8-4302-b63d-136ed3c6be35\") "
Oct 30 20:38:53.215348 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:53.215344    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/b3bff4d5-f9a8-4302-b63d-136ed3c6be35-registry-tls\" (UniqueName: \"kubernetes.io/projected/b3bff4d5-f9a8-4302-b63d-136ed3c6be35-registry-tls\") pod \"b3bff4d5-f9a8-4302-b63d-136ed3c6be35\" (UID: \"b3bff4d5-f9a8-4302-b63d-136ed3c6be35\") "
Oct 30 20:38:53.215620 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:53.215569    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b3bff4d5-f9a8-4302-b63d-136ed3c6be35-registry-certificates" pod "b3bff4d5-f9a8-4302-b63d-136ed3c6be35" (UID: "b3bff4d5-f9a8-4302-b63d-136ed3c6be35"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 20:38:53.216151 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:53.216117    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b3bff4d5-f9a8-4302-b63d-136ed3c6be35-trusted-ca" pod "b3bff4d5-f9a8-4302-b63d-136ed3c6be35" (UID: "b3bff4d5-f9a8-4302-b63d-136ed3c6be35"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 20:38:53.218008 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:53.217981    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b3bff4d5-f9a8-4302-b63d-136ed3c6be35-image-registry-private-configuration" pod "b3bff4d5-f9a8-4302-b63d-136ed3c6be35" (UID: "b3bff4d5-f9a8-4302-b63d-136ed3c6be35"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 20:38:53.218129 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:53.218037    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b3bff4d5-f9a8-4302-b63d-136ed3c6be35-registry-tls" pod "b3bff4d5-f9a8-4302-b63d-136ed3c6be35" (UID: "b3bff4d5-f9a8-4302-b63d-136ed3c6be35"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:38:53.218177 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:53.218151    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b3bff4d5-f9a8-4302-b63d-136ed3c6be35-installation-pull-secrets" pod "b3bff4d5-f9a8-4302-b63d-136ed3c6be35" (UID: "b3bff4d5-f9a8-4302-b63d-136ed3c6be35"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 20:38:53.218213 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:53.218169    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b3bff4d5-f9a8-4302-b63d-136ed3c6be35-bound-sa-token" pod "b3bff4d5-f9a8-4302-b63d-136ed3c6be35" (UID: "b3bff4d5-f9a8-4302-b63d-136ed3c6be35"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:38:53.219680 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:53.219658    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b3bff4d5-f9a8-4302-b63d-136ed3c6be35-kube-api-access-75wkc" pod "b3bff4d5-f9a8-4302-b63d-136ed3c6be35" (UID: "b3bff4d5-f9a8-4302-b63d-136ed3c6be35"). InnerVolumeSpecName "kube-api-access-75wkc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:38:53.222770 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:53.222710    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b3bff4d5-f9a8-4302-b63d-136ed3c6be35-ca-trust-extracted" pod "b3bff4d5-f9a8-4302-b63d-136ed3c6be35" (UID: "b3bff4d5-f9a8-4302-b63d-136ed3c6be35"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:38:53.316379 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:53.316346    6004 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-75wkc\" (UniqueName: \"kubernetes.io/projected/b3bff4d5-f9a8-4302-b63d-136ed3c6be35-kube-api-access-75wkc\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:38:53.316379 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:53.316376    6004 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b3bff4d5-f9a8-4302-b63d-136ed3c6be35-registry-tls\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:38:53.316379 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:53.316386    6004 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/b3bff4d5-f9a8-4302-b63d-136ed3c6be35-ca-trust-extracted\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:38:53.316591 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:53.316395    6004 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/b3bff4d5-f9a8-4302-b63d-136ed3c6be35-registry-certificates\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:38:53.316591 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:53.316404    6004 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b3bff4d5-f9a8-4302-b63d-136ed3c6be35-bound-sa-token\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:38:53.316591 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:53.316413    6004 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b3bff4d5-f9a8-4302-b63d-136ed3c6be35-trusted-ca\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:38:53.316591 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:53.316422    6004 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/b3bff4d5-f9a8-4302-b63d-136ed3c6be35-installation-pull-secrets\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:38:53.316591 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:53.316432    6004 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/b3bff4d5-f9a8-4302-b63d-136ed3c6be35-image-registry-private-configuration\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:38:53.514729 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:53.514652    6004 generic.go:356] "Generic (PLEG): container finished" podID="b3bff4d5-f9a8-4302-b63d-136ed3c6be35" containerID="22640beac8730d2a896c3efed39a9cae4696ae5c13b58f6c6489eacac98a526b" exitCode=0
Oct 30 20:38:53.514729 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:53.514697    6004 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6c5684fdcf-l5m76"
Oct 30 20:38:53.514906 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:53.514734    6004 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6c5684fdcf-l5m76" event={"ID":"b3bff4d5-f9a8-4302-b63d-136ed3c6be35","Type":"ContainerDied","Data":"22640beac8730d2a896c3efed39a9cae4696ae5c13b58f6c6489eacac98a526b"}
Oct 30 20:38:53.514906 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:53.514790    6004 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6c5684fdcf-l5m76" event={"ID":"b3bff4d5-f9a8-4302-b63d-136ed3c6be35","Type":"ContainerDied","Data":"ed2c4569b0ef02ef7486d1463e75049ee89c6ad4b14a41244e5f16c0dfda8853"}
Oct 30 20:38:53.514906 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:53.514811    6004 scope.go:122] "RemoveContainer" containerID="22640beac8730d2a896c3efed39a9cae4696ae5c13b58f6c6489eacac98a526b"
Oct 30 20:38:53.523196 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:53.523180    6004 scope.go:122] "RemoveContainer" containerID="22640beac8730d2a896c3efed39a9cae4696ae5c13b58f6c6489eacac98a526b"
Oct 30 20:38:53.523457 ip-10-0-138-85 kubenswrapper[6004]: E1030 20:38:53.523439    6004 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"22640beac8730d2a896c3efed39a9cae4696ae5c13b58f6c6489eacac98a526b\": container with ID starting with 22640beac8730d2a896c3efed39a9cae4696ae5c13b58f6c6489eacac98a526b not found: ID does not exist" containerID="22640beac8730d2a896c3efed39a9cae4696ae5c13b58f6c6489eacac98a526b"
Oct 30 20:38:53.523499 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:53.523467    6004 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"22640beac8730d2a896c3efed39a9cae4696ae5c13b58f6c6489eacac98a526b"} err="failed to get container status \"22640beac8730d2a896c3efed39a9cae4696ae5c13b58f6c6489eacac98a526b\": rpc error: code = NotFound desc = could not find container \"22640beac8730d2a896c3efed39a9cae4696ae5c13b58f6c6489eacac98a526b\": container with ID starting with 22640beac8730d2a896c3efed39a9cae4696ae5c13b58f6c6489eacac98a526b not found: ID does not exist"
Oct 30 20:38:53.680217 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:53.680185    6004 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-6c5684fdcf-l5m76"]
Oct 30 20:38:53.684756 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:53.684737    6004 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-6c5684fdcf-l5m76"]
Oct 30 20:38:54.229552 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:38:54.229522    6004 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="b3bff4d5-f9a8-4302-b63d-136ed3c6be35" path="/var/lib/kubelet/pods/b3bff4d5-f9a8-4302-b63d-136ed3c6be35/volumes"
Oct 30 20:39:14.284978 ip-10-0-138-85 kubenswrapper[6004]: E1030 20:39:14.284933    6004 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-zz4wr" containerName="extractor"
Oct 30 20:39:44.284598 ip-10-0-138-85 kubenswrapper[6004]: E1030 20:39:44.284561    6004 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-zz4wr" containerName="extractor"
Oct 30 20:39:46.729199 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:39:46.729163    6004 generic.go:356] "Generic (PLEG): container finished" podID="43784843-b8c8-4a5e-a079-bf03f4a50fc1" containerID="c6c0de5b571a2a37d40cec1363898eefeb141dd512e58d2d356926e92403e65d" exitCode=0
Oct 30 20:39:46.729679 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:39:46.729241    6004 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/periodic-gathering-s5zd4-r8bqt" event={"ID":"43784843-b8c8-4a5e-a079-bf03f4a50fc1","Type":"ContainerDied","Data":"c6c0de5b571a2a37d40cec1363898eefeb141dd512e58d2d356926e92403e65d"}
Oct 30 20:39:47.870549 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:39:47.870524    6004 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-insights/periodic-gathering-s5zd4-r8bqt"
Oct 30 20:39:47.902309 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:39:47.902285    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/43784843-b8c8-4a5e-a079-bf03f4a50fc1-kube-api-access-658tt\" (UniqueName: \"kubernetes.io/projected/43784843-b8c8-4a5e-a079-bf03f4a50fc1-kube-api-access-658tt\") pod \"43784843-b8c8-4a5e-a079-bf03f4a50fc1\" (UID: \"43784843-b8c8-4a5e-a079-bf03f4a50fc1\") "
Oct 30 20:39:47.902440 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:39:47.902337    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/43784843-b8c8-4a5e-a079-bf03f4a50fc1-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/43784843-b8c8-4a5e-a079-bf03f4a50fc1-trusted-ca-bundle\") pod \"43784843-b8c8-4a5e-a079-bf03f4a50fc1\" (UID: \"43784843-b8c8-4a5e-a079-bf03f4a50fc1\") "
Oct 30 20:39:47.902440 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:39:47.902366    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/43784843-b8c8-4a5e-a079-bf03f4a50fc1-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/43784843-b8c8-4a5e-a079-bf03f4a50fc1-service-ca-bundle\") pod \"43784843-b8c8-4a5e-a079-bf03f4a50fc1\" (UID: \"43784843-b8c8-4a5e-a079-bf03f4a50fc1\") "
Oct 30 20:39:47.902517 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:39:47.902464    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/43784843-b8c8-4a5e-a079-bf03f4a50fc1-archives-path\" (UniqueName: \"kubernetes.io/empty-dir/43784843-b8c8-4a5e-a079-bf03f4a50fc1-archives-path\") pod \"43784843-b8c8-4a5e-a079-bf03f4a50fc1\" (UID: \"43784843-b8c8-4a5e-a079-bf03f4a50fc1\") "
Oct 30 20:39:47.902701 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:39:47.902679    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/43784843-b8c8-4a5e-a079-bf03f4a50fc1-trusted-ca-bundle" pod "43784843-b8c8-4a5e-a079-bf03f4a50fc1" (UID: "43784843-b8c8-4a5e-a079-bf03f4a50fc1"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 20:39:47.902762 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:39:47.902743    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/43784843-b8c8-4a5e-a079-bf03f4a50fc1-service-ca-bundle" pod "43784843-b8c8-4a5e-a079-bf03f4a50fc1" (UID: "43784843-b8c8-4a5e-a079-bf03f4a50fc1"). InnerVolumeSpecName "service-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 20:39:47.902807 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:39:47.902788    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/43784843-b8c8-4a5e-a079-bf03f4a50fc1-archives-path" pod "43784843-b8c8-4a5e-a079-bf03f4a50fc1" (UID: "43784843-b8c8-4a5e-a079-bf03f4a50fc1"). InnerVolumeSpecName "archives-path". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:39:47.904392 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:39:47.904369    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/43784843-b8c8-4a5e-a079-bf03f4a50fc1-kube-api-access-658tt" pod "43784843-b8c8-4a5e-a079-bf03f4a50fc1" (UID: "43784843-b8c8-4a5e-a079-bf03f4a50fc1"). InnerVolumeSpecName "kube-api-access-658tt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:39:48.003322 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:39:48.003252    6004 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/43784843-b8c8-4a5e-a079-bf03f4a50fc1-trusted-ca-bundle\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:39:48.003322 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:39:48.003277    6004 reconciler_common.go:299] "Volume detached for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/43784843-b8c8-4a5e-a079-bf03f4a50fc1-service-ca-bundle\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:39:48.003322 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:39:48.003288    6004 reconciler_common.go:299] "Volume detached for volume \"archives-path\" (UniqueName: \"kubernetes.io/empty-dir/43784843-b8c8-4a5e-a079-bf03f4a50fc1-archives-path\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:39:48.003322 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:39:48.003297    6004 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-658tt\" (UniqueName: \"kubernetes.io/projected/43784843-b8c8-4a5e-a079-bf03f4a50fc1-kube-api-access-658tt\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:39:48.739036 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:39:48.739002    6004 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/periodic-gathering-s5zd4-r8bqt" event={"ID":"43784843-b8c8-4a5e-a079-bf03f4a50fc1","Type":"ContainerDied","Data":"cef00192b638460207c17d96ac313158cbec4a71435cb784b03b89cb51dd024c"}
Oct 30 20:39:48.739228 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:39:48.739045    6004 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-insights/periodic-gathering-s5zd4-r8bqt"
Oct 30 20:39:48.739228 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:39:48.739071    6004 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="cef00192b638460207c17d96ac313158cbec4a71435cb784b03b89cb51dd024c"
Oct 30 20:40:14.285508 ip-10-0-138-85 kubenswrapper[6004]: E1030 20:40:14.285468    6004 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-zz4wr" containerName="extractor"
Oct 30 20:40:44.287547 ip-10-0-138-85 kubenswrapper[6004]: E1030 20:40:44.287504    6004 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-zz4wr" containerName="extractor"
Oct 30 20:41:14.284604 ip-10-0-138-85 kubenswrapper[6004]: E1030 20:41:14.284565    6004 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-zz4wr" containerName="extractor"
Oct 30 20:41:44.285406 ip-10-0-138-85 kubenswrapper[6004]: E1030 20:41:44.285358    6004 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-zz4wr" containerName="extractor"
Oct 30 20:42:14.285222 ip-10-0-138-85 kubenswrapper[6004]: E1030 20:42:14.285183    6004 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-zz4wr" containerName="extractor"
Oct 30 20:42:44.285324 ip-10-0-138-85 kubenswrapper[6004]: E1030 20:42:44.285282    6004 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-zz4wr" containerName="extractor"
Oct 30 20:43:14.251253 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:43:14.251222    6004 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-sb7ds_90cd3de0-c573-41c2-bf3e-cf0e46a41d50/console-operator/2.log"
Oct 30 20:43:14.257702 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:43:14.257677    6004 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-sb7ds_90cd3de0-c573-41c2-bf3e-cf0e46a41d50/console-operator/2.log"
Oct 30 20:43:14.285708 ip-10-0-138-85 kubenswrapper[6004]: E1030 20:43:14.285676    6004 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-zz4wr" containerName="extractor"
Oct 30 20:43:29.540664 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:43:29.540623    6004 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7v96hn"]
Oct 30 20:43:29.541818 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:43:29.541789    6004 cpu_manager.go:414] "containerMap: removing container" podUID="519501c9-00d9-416f-887a-13b83aad5762" containerName="insights-gathering"
Oct 30 20:43:29.541969 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:43:29.541956    6004 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="519501c9-00d9-416f-887a-13b83aad5762" containerName="insights-gathering"
Oct 30 20:43:29.542098 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:43:29.542086    6004 cpu_manager.go:414] "containerMap: removing container" podUID="43784843-b8c8-4a5e-a079-bf03f4a50fc1" containerName="insights-gathering"
Oct 30 20:43:29.542185 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:43:29.542175    6004 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="43784843-b8c8-4a5e-a079-bf03f4a50fc1" containerName="insights-gathering"
Oct 30 20:43:29.542260 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:43:29.542252    6004 cpu_manager.go:414] "containerMap: removing container" podUID="b3bff4d5-f9a8-4302-b63d-136ed3c6be35" containerName="registry"
Oct 30 20:43:29.542327 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:43:29.542318    6004 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="b3bff4d5-f9a8-4302-b63d-136ed3c6be35" containerName="registry"
Oct 30 20:43:29.542579 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:43:29.542567    6004 memory_manager.go:365] "RemoveStaleState removing state" podUID="519501c9-00d9-416f-887a-13b83aad5762" containerName="insights-gathering"
Oct 30 20:43:29.542670 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:43:29.542660    6004 memory_manager.go:365] "RemoveStaleState removing state" podUID="43784843-b8c8-4a5e-a079-bf03f4a50fc1" containerName="insights-gathering"
Oct 30 20:43:29.542738 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:43:29.542730    6004 memory_manager.go:365] "RemoveStaleState removing state" podUID="b3bff4d5-f9a8-4302-b63d-136ed3c6be35" containerName="registry"
Oct 30 20:43:29.547244 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:43:29.547223    6004 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7v96hn"
Oct 30 20:43:29.600643 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:43:29.600614    6004 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Oct 30 20:43:29.631346 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:43:29.631310    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kr47b\" (UniqueName: \"kubernetes.io/projected/bc21b899-1a8e-46a9-9a55-e9a13ae46ec3-kube-api-access-kr47b\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7v96hn\" (UID: \"bc21b899-1a8e-46a9-9a55-e9a13ae46ec3\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7v96hn"
Oct 30 20:43:29.631346 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:43:29.631348    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bc21b899-1a8e-46a9-9a55-e9a13ae46ec3-util\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7v96hn\" (UID: \"bc21b899-1a8e-46a9-9a55-e9a13ae46ec3\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7v96hn"
Oct 30 20:43:29.631547 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:43:29.631372    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bc21b899-1a8e-46a9-9a55-e9a13ae46ec3-bundle\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7v96hn\" (UID: \"bc21b899-1a8e-46a9-9a55-e9a13ae46ec3\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7v96hn"
Oct 30 20:43:29.650838 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:43:29.650809    6004 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Oct 30 20:43:29.651237 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:43:29.651217    6004 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"da112bd609bff87f7bacd2ba941225d7cff15c-bd73b2fc-dockercfg-jcnhp\""
Oct 30 20:43:29.651938 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:43:29.651919    6004 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7v96hn"]
Oct 30 20:43:29.652530 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:43:29.652512    6004 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c646p44"]
Oct 30 20:43:29.655846 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:43:29.655831    6004 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c646p44"
Oct 30 20:43:29.700988 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:43:29.700962    6004 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c646p44"]
Oct 30 20:43:29.708700 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:43:29.708674    6004 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3-b83c8cba-dockercfg-kglqw\""
Oct 30 20:43:29.732396 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:43:29.732367    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kr47b\" (UniqueName: \"kubernetes.io/projected/bc21b899-1a8e-46a9-9a55-e9a13ae46ec3-kube-api-access-kr47b\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7v96hn\" (UID: \"bc21b899-1a8e-46a9-9a55-e9a13ae46ec3\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7v96hn"
Oct 30 20:43:29.732556 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:43:29.732403    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bc21b899-1a8e-46a9-9a55-e9a13ae46ec3-util\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7v96hn\" (UID: \"bc21b899-1a8e-46a9-9a55-e9a13ae46ec3\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7v96hn"
Oct 30 20:43:29.732556 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:43:29.732424    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/157ae0b0-c748-4cca-aea7-fab3afbe0a4e-util\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c646p44\" (UID: \"157ae0b0-c748-4cca-aea7-fab3afbe0a4e\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c646p44"
Oct 30 20:43:29.732556 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:43:29.732463    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bc21b899-1a8e-46a9-9a55-e9a13ae46ec3-bundle\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7v96hn\" (UID: \"bc21b899-1a8e-46a9-9a55-e9a13ae46ec3\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7v96hn"
Oct 30 20:43:29.732556 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:43:29.732520    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/157ae0b0-c748-4cca-aea7-fab3afbe0a4e-bundle\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c646p44\" (UID: \"157ae0b0-c748-4cca-aea7-fab3afbe0a4e\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c646p44"
Oct 30 20:43:29.732824 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:43:29.732712    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pdd8r\" (UniqueName: \"kubernetes.io/projected/157ae0b0-c748-4cca-aea7-fab3afbe0a4e-kube-api-access-pdd8r\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c646p44\" (UID: \"157ae0b0-c748-4cca-aea7-fab3afbe0a4e\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c646p44"
Oct 30 20:43:29.732824 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:43:29.732753    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bc21b899-1a8e-46a9-9a55-e9a13ae46ec3-util\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7v96hn\" (UID: \"bc21b899-1a8e-46a9-9a55-e9a13ae46ec3\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7v96hn"
Oct 30 20:43:29.732901 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:43:29.732833    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bc21b899-1a8e-46a9-9a55-e9a13ae46ec3-bundle\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7v96hn\" (UID: \"bc21b899-1a8e-46a9-9a55-e9a13ae46ec3\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7v96hn"
Oct 30 20:43:29.789833 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:43:29.789801    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kr47b\" (UniqueName: \"kubernetes.io/projected/bc21b899-1a8e-46a9-9a55-e9a13ae46ec3-kube-api-access-kr47b\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7v96hn\" (UID: \"bc21b899-1a8e-46a9-9a55-e9a13ae46ec3\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7v96hn"
Oct 30 20:43:29.833532 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:43:29.833472    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/157ae0b0-c748-4cca-aea7-fab3afbe0a4e-util\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c646p44\" (UID: \"157ae0b0-c748-4cca-aea7-fab3afbe0a4e\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c646p44"
Oct 30 20:43:29.833532 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:43:29.833523    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/157ae0b0-c748-4cca-aea7-fab3afbe0a4e-bundle\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c646p44\" (UID: \"157ae0b0-c748-4cca-aea7-fab3afbe0a4e\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c646p44"
Oct 30 20:43:29.833722 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:43:29.833632    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pdd8r\" (UniqueName: \"kubernetes.io/projected/157ae0b0-c748-4cca-aea7-fab3afbe0a4e-kube-api-access-pdd8r\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c646p44\" (UID: \"157ae0b0-c748-4cca-aea7-fab3afbe0a4e\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c646p44"
Oct 30 20:43:29.833890 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:43:29.833866    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/157ae0b0-c748-4cca-aea7-fab3afbe0a4e-util\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c646p44\" (UID: \"157ae0b0-c748-4cca-aea7-fab3afbe0a4e\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c646p44"
Oct 30 20:43:29.833948 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:43:29.833891    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/157ae0b0-c748-4cca-aea7-fab3afbe0a4e-bundle\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c646p44\" (UID: \"157ae0b0-c748-4cca-aea7-fab3afbe0a4e\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c646p44"
Oct 30 20:43:29.863163 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:43:29.863139    6004 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7v96hn"
Oct 30 20:43:29.892328 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:43:29.892291    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pdd8r\" (UniqueName: \"kubernetes.io/projected/157ae0b0-c748-4cca-aea7-fab3afbe0a4e-kube-api-access-pdd8r\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c646p44\" (UID: \"157ae0b0-c748-4cca-aea7-fab3afbe0a4e\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c646p44"
Oct 30 20:43:29.971824 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:43:29.971790    6004 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c646p44"
Oct 30 20:43:30.117188 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:43:30.117120    6004 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651c86fbj"]
Oct 30 20:43:30.121547 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:43:30.121530    6004 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651c86fbj"
Oct 30 20:43:30.175923 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:43:30.175897    6004 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"c7537007944577f64df34960ace3c69136c416-139ec370-dockercfg-n5r95\""
Oct 30 20:43:30.180657 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:43:30.180632    6004 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651c86fbj"]
Oct 30 20:43:30.237429 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:43:30.237400    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8b4ee760-ce38-4661-8d92-2c847d9f473d-util\") pod \"c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651c86fbj\" (UID: \"8b4ee760-ce38-4661-8d92-2c847d9f473d\") " pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651c86fbj"
Oct 30 20:43:30.237566 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:43:30.237454    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8b4ee760-ce38-4661-8d92-2c847d9f473d-bundle\") pod \"c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651c86fbj\" (UID: \"8b4ee760-ce38-4661-8d92-2c847d9f473d\") " pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651c86fbj"
Oct 30 20:43:30.237630 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:43:30.237565    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-76b76\" (UniqueName: \"kubernetes.io/projected/8b4ee760-ce38-4661-8d92-2c847d9f473d-kube-api-access-76b76\") pod \"c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651c86fbj\" (UID: \"8b4ee760-ce38-4661-8d92-2c847d9f473d\") " pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651c86fbj"
Oct 30 20:43:30.278132 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:43:30.278104    6004 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7v96hn"]
Oct 30 20:43:30.280980 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:43:30.280951    6004 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbc21b899_1a8e_46a9_9a55_e9a13ae46ec3.slice/crio-d8288d33b5c326c9166c9d0b45d3341be091843b842a86fdd53936befec4e891 WatchSource:0}: Error finding container d8288d33b5c326c9166c9d0b45d3341be091843b842a86fdd53936befec4e891: Status 404 returned error can't find the container with id d8288d33b5c326c9166c9d0b45d3341be091843b842a86fdd53936befec4e891
Oct 30 20:43:30.282855 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:43:30.282840    6004 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Oct 30 20:43:30.338080 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:43:30.338038    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8b4ee760-ce38-4661-8d92-2c847d9f473d-util\") pod \"c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651c86fbj\" (UID: \"8b4ee760-ce38-4661-8d92-2c847d9f473d\") " pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651c86fbj"
Oct 30 20:43:30.338198 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:43:30.338092    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8b4ee760-ce38-4661-8d92-2c847d9f473d-bundle\") pod \"c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651c86fbj\" (UID: \"8b4ee760-ce38-4661-8d92-2c847d9f473d\") " pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651c86fbj"
Oct 30 20:43:30.338198 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:43:30.338131    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-76b76\" (UniqueName: \"kubernetes.io/projected/8b4ee760-ce38-4661-8d92-2c847d9f473d-kube-api-access-76b76\") pod \"c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651c86fbj\" (UID: \"8b4ee760-ce38-4661-8d92-2c847d9f473d\") " pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651c86fbj"
Oct 30 20:43:30.338488 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:43:30.338465    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8b4ee760-ce38-4661-8d92-2c847d9f473d-util\") pod \"c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651c86fbj\" (UID: \"8b4ee760-ce38-4661-8d92-2c847d9f473d\") " pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651c86fbj"
Oct 30 20:43:30.338526 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:43:30.338478    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8b4ee760-ce38-4661-8d92-2c847d9f473d-bundle\") pod \"c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651c86fbj\" (UID: \"8b4ee760-ce38-4661-8d92-2c847d9f473d\") " pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651c86fbj"
Oct 30 20:43:30.341797 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:43:30.341724    6004 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c646p44"]
Oct 30 20:43:30.344292 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:43:30.344263    6004 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod157ae0b0_c748_4cca_aea7_fab3afbe0a4e.slice/crio-8a61c07797d05da888d8c88c6f11452d58632b79202496a682f677a99c823d88 WatchSource:0}: Error finding container 8a61c07797d05da888d8c88c6f11452d58632b79202496a682f677a99c823d88: Status 404 returned error can't find the container with id 8a61c07797d05da888d8c88c6f11452d58632b79202496a682f677a99c823d88
Oct 30 20:43:30.396905 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:43:30.396843    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-76b76\" (UniqueName: \"kubernetes.io/projected/8b4ee760-ce38-4661-8d92-2c847d9f473d-kube-api-access-76b76\") pod \"c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651c86fbj\" (UID: \"8b4ee760-ce38-4661-8d92-2c847d9f473d\") " pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651c86fbj"
Oct 30 20:43:30.437563 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:43:30.437534    6004 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651c86fbj"
Oct 30 20:43:30.592754 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:43:30.592718    6004 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c646p44" event={"ID":"157ae0b0-c748-4cca-aea7-fab3afbe0a4e","Type":"ContainerStarted","Data":"8a61c07797d05da888d8c88c6f11452d58632b79202496a682f677a99c823d88"}
Oct 30 20:43:30.593897 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:43:30.593869    6004 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7v96hn" event={"ID":"bc21b899-1a8e-46a9-9a55-e9a13ae46ec3","Type":"ContainerStarted","Data":"d8288d33b5c326c9166c9d0b45d3341be091843b842a86fdd53936befec4e891"}
Oct 30 20:43:30.811014 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:43:30.810989    6004 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651c86fbj"]
Oct 30 20:43:30.813531 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:43:30.813502    6004 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8b4ee760_ce38_4661_8d92_2c847d9f473d.slice/crio-3367570fc96503675dc08f96c479651d4a7ab9d23fad0cd9ae1d2737a04a0d73 WatchSource:0}: Error finding container 3367570fc96503675dc08f96c479651d4a7ab9d23fad0cd9ae1d2737a04a0d73: Status 404 returned error can't find the container with id 3367570fc96503675dc08f96c479651d4a7ab9d23fad0cd9ae1d2737a04a0d73
Oct 30 20:43:31.601541 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:43:31.601487    6004 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651c86fbj" event={"ID":"8b4ee760-ce38-4661-8d92-2c847d9f473d","Type":"ContainerStarted","Data":"3367570fc96503675dc08f96c479651d4a7ab9d23fad0cd9ae1d2737a04a0d73"}
Oct 30 20:43:33.417359 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:43:33.417326    6004 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71jt4gg"]
Oct 30 20:43:33.420963 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:43:33.420940    6004 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71jt4gg"
Oct 30 20:43:33.468545 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:43:33.468500    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1f6bf21d-fb4e-4e8f-bdd1-fd5adc6349e8-bundle\") pod \"e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71jt4gg\" (UID: \"1f6bf21d-fb4e-4e8f-bdd1-fd5adc6349e8\") " pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71jt4gg"
Oct 30 20:43:33.468729 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:43:33.468562    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1f6bf21d-fb4e-4e8f-bdd1-fd5adc6349e8-util\") pod \"e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71jt4gg\" (UID: \"1f6bf21d-fb4e-4e8f-bdd1-fd5adc6349e8\") " pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71jt4gg"
Oct 30 20:43:33.468729 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:43:33.468638    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qjrkw\" (UniqueName: \"kubernetes.io/projected/1f6bf21d-fb4e-4e8f-bdd1-fd5adc6349e8-kube-api-access-qjrkw\") pod \"e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71jt4gg\" (UID: \"1f6bf21d-fb4e-4e8f-bdd1-fd5adc6349e8\") " pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71jt4gg"
Oct 30 20:43:33.517302 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:43:33.517267    6004 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"e644421527c169d876fdb59235c927986d6bd2-9d2815fc-dockercfg-ptbhp\""
Oct 30 20:43:33.521671 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:43:33.521644    6004 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71jt4gg"]
Oct 30 20:43:33.570679 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:43:33.570097    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1f6bf21d-fb4e-4e8f-bdd1-fd5adc6349e8-util\") pod \"e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71jt4gg\" (UID: \"1f6bf21d-fb4e-4e8f-bdd1-fd5adc6349e8\") " pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71jt4gg"
Oct 30 20:43:33.570679 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:43:33.570149    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qjrkw\" (UniqueName: \"kubernetes.io/projected/1f6bf21d-fb4e-4e8f-bdd1-fd5adc6349e8-kube-api-access-qjrkw\") pod \"e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71jt4gg\" (UID: \"1f6bf21d-fb4e-4e8f-bdd1-fd5adc6349e8\") " pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71jt4gg"
Oct 30 20:43:33.570679 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:43:33.570246    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1f6bf21d-fb4e-4e8f-bdd1-fd5adc6349e8-bundle\") pod \"e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71jt4gg\" (UID: \"1f6bf21d-fb4e-4e8f-bdd1-fd5adc6349e8\") " pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71jt4gg"
Oct 30 20:43:33.570679 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:43:33.570521    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1f6bf21d-fb4e-4e8f-bdd1-fd5adc6349e8-util\") pod \"e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71jt4gg\" (UID: \"1f6bf21d-fb4e-4e8f-bdd1-fd5adc6349e8\") " pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71jt4gg"
Oct 30 20:43:33.570679 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:43:33.570634    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1f6bf21d-fb4e-4e8f-bdd1-fd5adc6349e8-bundle\") pod \"e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71jt4gg\" (UID: \"1f6bf21d-fb4e-4e8f-bdd1-fd5adc6349e8\") " pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71jt4gg"
Oct 30 20:43:33.631061 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:43:33.631024    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qjrkw\" (UniqueName: \"kubernetes.io/projected/1f6bf21d-fb4e-4e8f-bdd1-fd5adc6349e8-kube-api-access-qjrkw\") pod \"e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71jt4gg\" (UID: \"1f6bf21d-fb4e-4e8f-bdd1-fd5adc6349e8\") " pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71jt4gg"
Oct 30 20:43:33.740338 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:43:33.740088    6004 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71jt4gg"
Oct 30 20:43:34.134295 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:43:34.133540    6004 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71jt4gg"]
Oct 30 20:43:34.136719 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:43:34.136686    6004 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1f6bf21d_fb4e_4e8f_bdd1_fd5adc6349e8.slice/crio-45c7bd92e503c39648f7623b8b1d6e70b373ac3d97f25dbe8ecf37b505931879 WatchSource:0}: Error finding container 45c7bd92e503c39648f7623b8b1d6e70b373ac3d97f25dbe8ecf37b505931879: Status 404 returned error can't find the container with id 45c7bd92e503c39648f7623b8b1d6e70b373ac3d97f25dbe8ecf37b505931879
Oct 30 20:43:34.450161 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:43:34.450127    6004 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-769df7846c-d4xk7"]
Oct 30 20:43:34.455062 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:43:34.455023    6004 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-d4xk7"
Oct 30 20:43:34.508336 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:43:34.508301    6004 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Oct 30 20:43:34.529731 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:43:34.529674    6004 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-qbqvq\""
Oct 30 20:43:34.560390 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:43:34.560355    6004 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-769df7846c-d4xk7"]
Oct 30 20:43:34.580862 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:43:34.580824    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0e8f5c36-1420-425c-9283-b5ecfd4419a2-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-769df7846c-d4xk7\" (UID: \"0e8f5c36-1420-425c-9283-b5ecfd4419a2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-d4xk7"
Oct 30 20:43:34.581007 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:43:34.580895    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0e8f5c36-1420-425c-9283-b5ecfd4419a2-workload-certs\") pod \"maas-default-gateway-openshift-default-769df7846c-d4xk7\" (UID: \"0e8f5c36-1420-425c-9283-b5ecfd4419a2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-d4xk7"
Oct 30 20:43:34.581007 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:43:34.580929    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0e8f5c36-1420-425c-9283-b5ecfd4419a2-istio-envoy\") pod \"maas-default-gateway-openshift-default-769df7846c-d4xk7\" (UID: \"0e8f5c36-1420-425c-9283-b5ecfd4419a2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-d4xk7"
Oct 30 20:43:34.581007 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:43:34.580966    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0e8f5c36-1420-425c-9283-b5ecfd4419a2-credential-socket\") pod \"maas-default-gateway-openshift-default-769df7846c-d4xk7\" (UID: \"0e8f5c36-1420-425c-9283-b5ecfd4419a2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-d4xk7"
Oct 30 20:43:34.581176 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:43:34.581006    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0e8f5c36-1420-425c-9283-b5ecfd4419a2-workload-socket\") pod \"maas-default-gateway-openshift-default-769df7846c-d4xk7\" (UID: \"0e8f5c36-1420-425c-9283-b5ecfd4419a2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-d4xk7"
Oct 30 20:43:34.581176 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:43:34.581044    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-76sp5\" (UniqueName: \"kubernetes.io/projected/0e8f5c36-1420-425c-9283-b5ecfd4419a2-kube-api-access-76sp5\") pod \"maas-default-gateway-openshift-default-769df7846c-d4xk7\" (UID: \"0e8f5c36-1420-425c-9283-b5ecfd4419a2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-d4xk7"
Oct 30 20:43:34.581176 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:43:34.581120    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0e8f5c36-1420-425c-9283-b5ecfd4419a2-istio-podinfo\") pod \"maas-default-gateway-openshift-default-769df7846c-d4xk7\" (UID: \"0e8f5c36-1420-425c-9283-b5ecfd4419a2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-d4xk7"
Oct 30 20:43:34.581176 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:43:34.581150    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0e8f5c36-1420-425c-9283-b5ecfd4419a2-istio-token\") pod \"maas-default-gateway-openshift-default-769df7846c-d4xk7\" (UID: \"0e8f5c36-1420-425c-9283-b5ecfd4419a2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-d4xk7"
Oct 30 20:43:34.581312 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:43:34.581199    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0e8f5c36-1420-425c-9283-b5ecfd4419a2-istio-data\") pod \"maas-default-gateway-openshift-default-769df7846c-d4xk7\" (UID: \"0e8f5c36-1420-425c-9283-b5ecfd4419a2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-d4xk7"
Oct 30 20:43:34.625619 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:43:34.625539    6004 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71jt4gg" event={"ID":"1f6bf21d-fb4e-4e8f-bdd1-fd5adc6349e8","Type":"ContainerStarted","Data":"45c7bd92e503c39648f7623b8b1d6e70b373ac3d97f25dbe8ecf37b505931879"}
Oct 30 20:43:34.682126 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:43:34.682085    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-76sp5\" (UniqueName: \"kubernetes.io/projected/0e8f5c36-1420-425c-9283-b5ecfd4419a2-kube-api-access-76sp5\") pod \"maas-default-gateway-openshift-default-769df7846c-d4xk7\" (UID: \"0e8f5c36-1420-425c-9283-b5ecfd4419a2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-d4xk7"
Oct 30 20:43:34.682377 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:43:34.682148    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0e8f5c36-1420-425c-9283-b5ecfd4419a2-istio-podinfo\") pod \"maas-default-gateway-openshift-default-769df7846c-d4xk7\" (UID: \"0e8f5c36-1420-425c-9283-b5ecfd4419a2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-d4xk7"
Oct 30 20:43:34.682377 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:43:34.682177    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0e8f5c36-1420-425c-9283-b5ecfd4419a2-istio-token\") pod \"maas-default-gateway-openshift-default-769df7846c-d4xk7\" (UID: \"0e8f5c36-1420-425c-9283-b5ecfd4419a2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-d4xk7"
Oct 30 20:43:34.682377 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:43:34.682221    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0e8f5c36-1420-425c-9283-b5ecfd4419a2-istio-data\") pod \"maas-default-gateway-openshift-default-769df7846c-d4xk7\" (UID: \"0e8f5c36-1420-425c-9283-b5ecfd4419a2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-d4xk7"
Oct 30 20:43:34.682377 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:43:34.682271    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0e8f5c36-1420-425c-9283-b5ecfd4419a2-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-769df7846c-d4xk7\" (UID: \"0e8f5c36-1420-425c-9283-b5ecfd4419a2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-d4xk7"
Oct 30 20:43:34.682377 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:43:34.682320    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0e8f5c36-1420-425c-9283-b5ecfd4419a2-workload-certs\") pod \"maas-default-gateway-openshift-default-769df7846c-d4xk7\" (UID: \"0e8f5c36-1420-425c-9283-b5ecfd4419a2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-d4xk7"
Oct 30 20:43:34.682377 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:43:34.682350    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0e8f5c36-1420-425c-9283-b5ecfd4419a2-istio-envoy\") pod \"maas-default-gateway-openshift-default-769df7846c-d4xk7\" (UID: \"0e8f5c36-1420-425c-9283-b5ecfd4419a2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-d4xk7"
Oct 30 20:43:34.682879 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:43:34.682388    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0e8f5c36-1420-425c-9283-b5ecfd4419a2-credential-socket\") pod \"maas-default-gateway-openshift-default-769df7846c-d4xk7\" (UID: \"0e8f5c36-1420-425c-9283-b5ecfd4419a2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-d4xk7"
Oct 30 20:43:34.682879 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:43:34.682427    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0e8f5c36-1420-425c-9283-b5ecfd4419a2-workload-socket\") pod \"maas-default-gateway-openshift-default-769df7846c-d4xk7\" (UID: \"0e8f5c36-1420-425c-9283-b5ecfd4419a2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-d4xk7"
Oct 30 20:43:34.683171 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:43:34.683138    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0e8f5c36-1420-425c-9283-b5ecfd4419a2-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-769df7846c-d4xk7\" (UID: \"0e8f5c36-1420-425c-9283-b5ecfd4419a2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-d4xk7"
Oct 30 20:43:34.683686 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:43:34.683385    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0e8f5c36-1420-425c-9283-b5ecfd4419a2-workload-socket\") pod \"maas-default-gateway-openshift-default-769df7846c-d4xk7\" (UID: \"0e8f5c36-1420-425c-9283-b5ecfd4419a2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-d4xk7"
Oct 30 20:43:34.683686 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:43:34.683546    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0e8f5c36-1420-425c-9283-b5ecfd4419a2-credential-socket\") pod \"maas-default-gateway-openshift-default-769df7846c-d4xk7\" (UID: \"0e8f5c36-1420-425c-9283-b5ecfd4419a2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-d4xk7"
Oct 30 20:43:34.683686 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:43:34.683564    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0e8f5c36-1420-425c-9283-b5ecfd4419a2-workload-certs\") pod \"maas-default-gateway-openshift-default-769df7846c-d4xk7\" (UID: \"0e8f5c36-1420-425c-9283-b5ecfd4419a2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-d4xk7"
Oct 30 20:43:34.683686 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:43:34.683645    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0e8f5c36-1420-425c-9283-b5ecfd4419a2-istio-data\") pod \"maas-default-gateway-openshift-default-769df7846c-d4xk7\" (UID: \"0e8f5c36-1420-425c-9283-b5ecfd4419a2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-d4xk7"
Oct 30 20:43:34.685626 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:43:34.685604    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0e8f5c36-1420-425c-9283-b5ecfd4419a2-istio-envoy\") pod \"maas-default-gateway-openshift-default-769df7846c-d4xk7\" (UID: \"0e8f5c36-1420-425c-9283-b5ecfd4419a2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-d4xk7"
Oct 30 20:43:34.685877 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:43:34.685856    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0e8f5c36-1420-425c-9283-b5ecfd4419a2-istio-podinfo\") pod \"maas-default-gateway-openshift-default-769df7846c-d4xk7\" (UID: \"0e8f5c36-1420-425c-9283-b5ecfd4419a2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-d4xk7"
Oct 30 20:43:34.740088 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:43:34.739995    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-76sp5\" (UniqueName: \"kubernetes.io/projected/0e8f5c36-1420-425c-9283-b5ecfd4419a2-kube-api-access-76sp5\") pod \"maas-default-gateway-openshift-default-769df7846c-d4xk7\" (UID: \"0e8f5c36-1420-425c-9283-b5ecfd4419a2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-d4xk7"
Oct 30 20:43:34.747783 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:43:34.747755    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0e8f5c36-1420-425c-9283-b5ecfd4419a2-istio-token\") pod \"maas-default-gateway-openshift-default-769df7846c-d4xk7\" (UID: \"0e8f5c36-1420-425c-9283-b5ecfd4419a2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-d4xk7"
Oct 30 20:43:34.771657 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:43:34.771623    6004 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-d4xk7"
Oct 30 20:43:35.134123 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:43:35.134034    6004 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cxdtdf"]
Oct 30 20:43:35.139016 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:43:35.138406    6004 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cxdtdf"
Oct 30 20:43:35.192991 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:43:35.192927    6004 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cxdtdf"]
Oct 30 20:43:35.195420 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:43:35.195389    6004 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"e3d011e69d9573cabb8c359e5ac709eb5ac240-be78d160-dockercfg-chq6l\""
Oct 30 20:43:35.281483 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:43:35.281456    6004 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-769df7846c-d4xk7"]
Oct 30 20:43:35.282747 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:43:35.282678    6004 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0e8f5c36_1420_425c_9283_b5ecfd4419a2.slice/crio-775f91789e4e33bfb3b9b01b8e4332582ae1bbab8e34bb32004bf2cc1ca8bbb7 WatchSource:0}: Error finding container 775f91789e4e33bfb3b9b01b8e4332582ae1bbab8e34bb32004bf2cc1ca8bbb7: Status 404 returned error can't find the container with id 775f91789e4e33bfb3b9b01b8e4332582ae1bbab8e34bb32004bf2cc1ca8bbb7
Oct 30 20:43:35.288203 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:43:35.288177    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ad53ca03-87f2-4d26-a93e-7d9cf1db9c47-util\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cxdtdf\" (UID: \"ad53ca03-87f2-4d26-a93e-7d9cf1db9c47\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cxdtdf"
Oct 30 20:43:35.288302 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:43:35.288219    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t47rs\" (UniqueName: \"kubernetes.io/projected/ad53ca03-87f2-4d26-a93e-7d9cf1db9c47-kube-api-access-t47rs\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cxdtdf\" (UID: \"ad53ca03-87f2-4d26-a93e-7d9cf1db9c47\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cxdtdf"
Oct 30 20:43:35.288394 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:43:35.288367    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ad53ca03-87f2-4d26-a93e-7d9cf1db9c47-bundle\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cxdtdf\" (UID: \"ad53ca03-87f2-4d26-a93e-7d9cf1db9c47\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cxdtdf"
Oct 30 20:43:35.388994 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:43:35.388902    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ad53ca03-87f2-4d26-a93e-7d9cf1db9c47-bundle\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cxdtdf\" (UID: \"ad53ca03-87f2-4d26-a93e-7d9cf1db9c47\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cxdtdf"
Oct 30 20:43:35.389171 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:43:35.389031    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ad53ca03-87f2-4d26-a93e-7d9cf1db9c47-util\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cxdtdf\" (UID: \"ad53ca03-87f2-4d26-a93e-7d9cf1db9c47\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cxdtdf"
Oct 30 20:43:35.389171 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:43:35.389090    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t47rs\" (UniqueName: \"kubernetes.io/projected/ad53ca03-87f2-4d26-a93e-7d9cf1db9c47-kube-api-access-t47rs\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cxdtdf\" (UID: \"ad53ca03-87f2-4d26-a93e-7d9cf1db9c47\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cxdtdf"
Oct 30 20:43:35.389443 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:43:35.389420    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ad53ca03-87f2-4d26-a93e-7d9cf1db9c47-bundle\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cxdtdf\" (UID: \"ad53ca03-87f2-4d26-a93e-7d9cf1db9c47\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cxdtdf"
Oct 30 20:43:35.389774 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:43:35.389754    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ad53ca03-87f2-4d26-a93e-7d9cf1db9c47-util\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cxdtdf\" (UID: \"ad53ca03-87f2-4d26-a93e-7d9cf1db9c47\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cxdtdf"
Oct 30 20:43:35.459575 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:43:35.459543    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t47rs\" (UniqueName: \"kubernetes.io/projected/ad53ca03-87f2-4d26-a93e-7d9cf1db9c47-kube-api-access-t47rs\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cxdtdf\" (UID: \"ad53ca03-87f2-4d26-a93e-7d9cf1db9c47\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cxdtdf"
Oct 30 20:43:35.633724 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:43:35.633675    6004 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-d4xk7" event={"ID":"0e8f5c36-1420-425c-9283-b5ecfd4419a2","Type":"ContainerStarted","Data":"775f91789e4e33bfb3b9b01b8e4332582ae1bbab8e34bb32004bf2cc1ca8bbb7"}
Oct 30 20:43:35.759007 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:43:35.758568    6004 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cxdtdf"
Oct 30 20:43:36.161093 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:43:36.160969    6004 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cxdtdf"]
Oct 30 20:43:36.175590 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:43:36.175554    6004 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podad53ca03_87f2_4d26_a93e_7d9cf1db9c47.slice/crio-9431ded1a040e8b431b16e53635ea859b6b156e70ac9be2bc4f323ad9d32bc72 WatchSource:0}: Error finding container 9431ded1a040e8b431b16e53635ea859b6b156e70ac9be2bc4f323ad9d32bc72: Status 404 returned error can't find the container with id 9431ded1a040e8b431b16e53635ea859b6b156e70ac9be2bc4f323ad9d32bc72
Oct 30 20:43:36.641839 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:43:36.641713    6004 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cxdtdf" event={"ID":"ad53ca03-87f2-4d26-a93e-7d9cf1db9c47","Type":"ContainerStarted","Data":"9431ded1a040e8b431b16e53635ea859b6b156e70ac9be2bc4f323ad9d32bc72"}
Oct 30 20:43:40.669857 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:43:40.669805    6004 generic.go:356] "Generic (PLEG): container finished" podID="8b4ee760-ce38-4661-8d92-2c847d9f473d" containerID="c6c54836bdd74b2e99ab74c3a8633962c9e81b5188247ff9a9257292b6d30f21" exitCode=0
Oct 30 20:43:40.670357 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:43:40.669889    6004 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651c86fbj" event={"ID":"8b4ee760-ce38-4661-8d92-2c847d9f473d","Type":"ContainerDied","Data":"c6c54836bdd74b2e99ab74c3a8633962c9e81b5188247ff9a9257292b6d30f21"}
Oct 30 20:43:41.583355 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:43:41.583321    6004 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 20:43:41.583484 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:43:41.583397    6004 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 20:43:41.583484 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:43:41.583434    6004 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 20:43:41.686668 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:43:41.686636    6004 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-d4xk7" event={"ID":"0e8f5c36-1420-425c-9283-b5ecfd4419a2","Type":"ContainerStarted","Data":"197ce9838c8cc218dae12d24af5da9823e02fbac3d950cc19b3a9241f35d1d55"}
Oct 30 20:43:41.688663 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:43:41.688640    6004 generic.go:356] "Generic (PLEG): container finished" podID="1f6bf21d-fb4e-4e8f-bdd1-fd5adc6349e8" containerID="ba7b7b6e455706cf22e328ba53842d5484378bfbbbee256ea93b14dbbf6fd143" exitCode=0
Oct 30 20:43:41.688800 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:43:41.688729    6004 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71jt4gg" event={"ID":"1f6bf21d-fb4e-4e8f-bdd1-fd5adc6349e8","Type":"ContainerDied","Data":"ba7b7b6e455706cf22e328ba53842d5484378bfbbbee256ea93b14dbbf6fd143"}
Oct 30 20:43:41.772726 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:43:41.772692    6004 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-d4xk7"
Oct 30 20:43:41.836895 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:43:41.836792    6004 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-d4xk7" podStartSLOduration=1.54054993 podStartE2EDuration="7.836776077s" totalImagesPullingTime="6.296226147s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:43:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:43:41.836014186 +0000 UTC m=+327.755800306" watchObservedRunningTime="2026-10-30 20:43:41.836776077 +0000 UTC m=+327.756562195"
Oct 30 20:43:42.702119 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:43:42.702037    6004 generic.go:356] "Generic (PLEG): container finished" podID="157ae0b0-c748-4cca-aea7-fab3afbe0a4e" containerID="61062b15bd59664ce1624fe10e1d8f10c116e92380e97fce1c05b42a4d58d165" exitCode=0
Oct 30 20:43:42.702542 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:43:42.702152    6004 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c646p44" event={"ID":"157ae0b0-c748-4cca-aea7-fab3afbe0a4e","Type":"ContainerDied","Data":"61062b15bd59664ce1624fe10e1d8f10c116e92380e97fce1c05b42a4d58d165"}
Oct 30 20:43:42.703999 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:43:42.703974    6004 generic.go:356] "Generic (PLEG): container finished" podID="bc21b899-1a8e-46a9-9a55-e9a13ae46ec3" containerID="b48bdec94b20c103de396df56adc65a144c8b1ca7a56c7ba115f775ebae95a48" exitCode=0
Oct 30 20:43:42.704123 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:43:42.704110    6004 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7v96hn" event={"ID":"bc21b899-1a8e-46a9-9a55-e9a13ae46ec3","Type":"ContainerDied","Data":"b48bdec94b20c103de396df56adc65a144c8b1ca7a56c7ba115f775ebae95a48"}
Oct 30 20:43:42.705937 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:43:42.705910    6004 generic.go:356] "Generic (PLEG): container finished" podID="ad53ca03-87f2-4d26-a93e-7d9cf1db9c47" containerID="38d1dd4915d87b1b9a79f6036cac38b825e466a3491ee859240820925b2546a9" exitCode=0
Oct 30 20:43:42.706096 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:43:42.706071    6004 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cxdtdf" event={"ID":"ad53ca03-87f2-4d26-a93e-7d9cf1db9c47","Type":"ContainerDied","Data":"38d1dd4915d87b1b9a79f6036cac38b825e466a3491ee859240820925b2546a9"}
Oct 30 20:43:42.778260 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:43:42.778235    6004 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-d4xk7"
Oct 30 20:43:43.713859 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:43:43.713524    6004 generic.go:356] "Generic (PLEG): container finished" podID="1f6bf21d-fb4e-4e8f-bdd1-fd5adc6349e8" containerID="d164b03858bee962246c51e3432002d6b2a2310b9cb52904c3017af8d0d2869d" exitCode=0
Oct 30 20:43:43.713859 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:43:43.713638    6004 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71jt4gg" event={"ID":"1f6bf21d-fb4e-4e8f-bdd1-fd5adc6349e8","Type":"ContainerDied","Data":"d164b03858bee962246c51e3432002d6b2a2310b9cb52904c3017af8d0d2869d"}
Oct 30 20:43:43.714393 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:43:43.713933    6004 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-d4xk7"
Oct 30 20:43:43.715215 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:43:43.715184    6004 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-d4xk7"
Oct 30 20:43:44.284841 ip-10-0-138-85 kubenswrapper[6004]: E1030 20:43:44.284761    6004 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-zz4wr" containerName="extractor"
Oct 30 20:43:44.720919 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:43:44.720883    6004 generic.go:356] "Generic (PLEG): container finished" podID="157ae0b0-c748-4cca-aea7-fab3afbe0a4e" containerID="1a6907d999c546e2561fdf16fb9b71f3bf53a7ffd0a028ceaa3ec5703d22faa2" exitCode=0
Oct 30 20:43:44.721339 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:43:44.720965    6004 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c646p44" event={"ID":"157ae0b0-c748-4cca-aea7-fab3afbe0a4e","Type":"ContainerDied","Data":"1a6907d999c546e2561fdf16fb9b71f3bf53a7ffd0a028ceaa3ec5703d22faa2"}
Oct 30 20:43:44.723272 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:43:44.723250    6004 generic.go:356] "Generic (PLEG): container finished" podID="bc21b899-1a8e-46a9-9a55-e9a13ae46ec3" containerID="de2c7340e04d5f2643aefa649501d90b5f853518e073d555913117adbb49b2c1" exitCode=0
Oct 30 20:43:44.723556 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:43:44.723532    6004 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7v96hn" event={"ID":"bc21b899-1a8e-46a9-9a55-e9a13ae46ec3","Type":"ContainerDied","Data":"de2c7340e04d5f2643aefa649501d90b5f853518e073d555913117adbb49b2c1"}
Oct 30 20:43:44.725556 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:43:44.725533    6004 generic.go:356] "Generic (PLEG): container finished" podID="ad53ca03-87f2-4d26-a93e-7d9cf1db9c47" containerID="f8f991d854f053fdc3b3cfdf9d50ee01e3473cb837575acc93ce8546454476d5" exitCode=0
Oct 30 20:43:44.725652 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:43:44.725617    6004 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cxdtdf" event={"ID":"ad53ca03-87f2-4d26-a93e-7d9cf1db9c47","Type":"ContainerDied","Data":"f8f991d854f053fdc3b3cfdf9d50ee01e3473cb837575acc93ce8546454476d5"}
Oct 30 20:43:44.728564 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:43:44.728543    6004 generic.go:356] "Generic (PLEG): container finished" podID="8b4ee760-ce38-4661-8d92-2c847d9f473d" containerID="9765d87bb3e4d88895bd589c5c58ec702e17879d1d9d814713077338f87a47a8" exitCode=0
Oct 30 20:43:44.728663 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:43:44.728628    6004 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651c86fbj" event={"ID":"8b4ee760-ce38-4661-8d92-2c847d9f473d","Type":"ContainerDied","Data":"9765d87bb3e4d88895bd589c5c58ec702e17879d1d9d814713077338f87a47a8"}
Oct 30 20:43:56.815581 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:43:56.815435    6004 generic.go:356] "Generic (PLEG): container finished" podID="1f6bf21d-fb4e-4e8f-bdd1-fd5adc6349e8" containerID="fcb3a2a35dc4574a1a269e346c1a15931ac4b6fa9deca1721cc15a8e007324e6" exitCode=0
Oct 30 20:43:56.815581 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:43:56.815520    6004 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71jt4gg" event={"ID":"1f6bf21d-fb4e-4e8f-bdd1-fd5adc6349e8","Type":"ContainerDied","Data":"fcb3a2a35dc4574a1a269e346c1a15931ac4b6fa9deca1721cc15a8e007324e6"}
Oct 30 20:43:56.818468 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:43:56.818432    6004 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7v96hn" event={"ID":"bc21b899-1a8e-46a9-9a55-e9a13ae46ec3","Type":"ContainerStarted","Data":"8595089a8eebcb19db8036a412ca9fae50d9d306c6704937b4d492b01c6256ae"}
Oct 30 20:43:56.821288 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:43:56.821109    6004 generic.go:356] "Generic (PLEG): container finished" podID="ad53ca03-87f2-4d26-a93e-7d9cf1db9c47" containerID="89be4432d60b4de4ff40e27dc9b34a459453d371ff9b0edb4e60ffae8b58bf65" exitCode=0
Oct 30 20:43:56.821288 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:43:56.821224    6004 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cxdtdf" event={"ID":"ad53ca03-87f2-4d26-a93e-7d9cf1db9c47","Type":"ContainerDied","Data":"89be4432d60b4de4ff40e27dc9b34a459453d371ff9b0edb4e60ffae8b58bf65"}
Oct 30 20:43:56.823841 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:43:56.823817    6004 generic.go:356] "Generic (PLEG): container finished" podID="8b4ee760-ce38-4661-8d92-2c847d9f473d" containerID="b7ab324183986f14923189162ea095ac9e1c186670820213c4690aeb891195ef" exitCode=0
Oct 30 20:43:56.823940 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:43:56.823840    6004 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651c86fbj" event={"ID":"8b4ee760-ce38-4661-8d92-2c847d9f473d","Type":"ContainerDied","Data":"b7ab324183986f14923189162ea095ac9e1c186670820213c4690aeb891195ef"}
Oct 30 20:43:57.053015 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:43:57.052963    6004 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7v96hn" podStartSLOduration=3.065068509 podStartE2EDuration="28.052949295s" totalImagesPullingTime="24.987880786s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:43:29 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:43:57.051993805 +0000 UTC m=+342.971779924" watchObservedRunningTime="2026-10-30 20:43:57.052949295 +0000 UTC m=+342.972735410"
Oct 30 20:43:57.830358 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:43:57.830322    6004 generic.go:356] "Generic (PLEG): container finished" podID="157ae0b0-c748-4cca-aea7-fab3afbe0a4e" containerID="95ed0a1cbe261f0477256ad24f88376d768f55ea0aceb727a8cf6181644b6c10" exitCode=0
Oct 30 20:43:57.830772 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:43:57.830404    6004 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c646p44" event={"ID":"157ae0b0-c748-4cca-aea7-fab3afbe0a4e","Type":"ContainerDied","Data":"95ed0a1cbe261f0477256ad24f88376d768f55ea0aceb727a8cf6181644b6c10"}
Oct 30 20:43:57.832552 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:43:57.832531    6004 generic.go:356] "Generic (PLEG): container finished" podID="bc21b899-1a8e-46a9-9a55-e9a13ae46ec3" containerID="8595089a8eebcb19db8036a412ca9fae50d9d306c6704937b4d492b01c6256ae" exitCode=0
Oct 30 20:43:57.832673 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:43:57.832621    6004 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7v96hn" event={"ID":"bc21b899-1a8e-46a9-9a55-e9a13ae46ec3","Type":"ContainerDied","Data":"8595089a8eebcb19db8036a412ca9fae50d9d306c6704937b4d492b01c6256ae"}
Oct 30 20:43:57.964198 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:43:57.964171    6004 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71jt4gg"
Oct 30 20:43:58.003775 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:43:58.003739    6004 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cxdtdf"
Oct 30 20:43:58.032762 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:43:58.032738    6004 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651c86fbj"
Oct 30 20:43:58.111332 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:43:58.111252    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/ad53ca03-87f2-4d26-a93e-7d9cf1db9c47-kube-api-access-t47rs\" (UniqueName: \"kubernetes.io/projected/ad53ca03-87f2-4d26-a93e-7d9cf1db9c47-kube-api-access-t47rs\") pod \"ad53ca03-87f2-4d26-a93e-7d9cf1db9c47\" (UID: \"ad53ca03-87f2-4d26-a93e-7d9cf1db9c47\") "
Oct 30 20:43:58.111332 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:43:58.111320    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/1f6bf21d-fb4e-4e8f-bdd1-fd5adc6349e8-bundle\" (UniqueName: \"kubernetes.io/empty-dir/1f6bf21d-fb4e-4e8f-bdd1-fd5adc6349e8-bundle\") pod \"1f6bf21d-fb4e-4e8f-bdd1-fd5adc6349e8\" (UID: \"1f6bf21d-fb4e-4e8f-bdd1-fd5adc6349e8\") "
Oct 30 20:43:58.111553 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:43:58.111343    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/ad53ca03-87f2-4d26-a93e-7d9cf1db9c47-bundle\" (UniqueName: \"kubernetes.io/empty-dir/ad53ca03-87f2-4d26-a93e-7d9cf1db9c47-bundle\") pod \"ad53ca03-87f2-4d26-a93e-7d9cf1db9c47\" (UID: \"ad53ca03-87f2-4d26-a93e-7d9cf1db9c47\") "
Oct 30 20:43:58.111553 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:43:58.111368    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/1f6bf21d-fb4e-4e8f-bdd1-fd5adc6349e8-kube-api-access-qjrkw\" (UniqueName: \"kubernetes.io/projected/1f6bf21d-fb4e-4e8f-bdd1-fd5adc6349e8-kube-api-access-qjrkw\") pod \"1f6bf21d-fb4e-4e8f-bdd1-fd5adc6349e8\" (UID: \"1f6bf21d-fb4e-4e8f-bdd1-fd5adc6349e8\") "
Oct 30 20:43:58.111553 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:43:58.111392    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/1f6bf21d-fb4e-4e8f-bdd1-fd5adc6349e8-util\" (UniqueName: \"kubernetes.io/empty-dir/1f6bf21d-fb4e-4e8f-bdd1-fd5adc6349e8-util\") pod \"1f6bf21d-fb4e-4e8f-bdd1-fd5adc6349e8\" (UID: \"1f6bf21d-fb4e-4e8f-bdd1-fd5adc6349e8\") "
Oct 30 20:43:58.111553 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:43:58.111450    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/ad53ca03-87f2-4d26-a93e-7d9cf1db9c47-util\" (UniqueName: \"kubernetes.io/empty-dir/ad53ca03-87f2-4d26-a93e-7d9cf1db9c47-util\") pod \"ad53ca03-87f2-4d26-a93e-7d9cf1db9c47\" (UID: \"ad53ca03-87f2-4d26-a93e-7d9cf1db9c47\") "
Oct 30 20:43:58.112104 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:43:58.112076    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1f6bf21d-fb4e-4e8f-bdd1-fd5adc6349e8-bundle" pod "1f6bf21d-fb4e-4e8f-bdd1-fd5adc6349e8" (UID: "1f6bf21d-fb4e-4e8f-bdd1-fd5adc6349e8"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:43:58.112201 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:43:58.112112    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ad53ca03-87f2-4d26-a93e-7d9cf1db9c47-bundle" pod "ad53ca03-87f2-4d26-a93e-7d9cf1db9c47" (UID: "ad53ca03-87f2-4d26-a93e-7d9cf1db9c47"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:43:58.113610 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:43:58.113580    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ad53ca03-87f2-4d26-a93e-7d9cf1db9c47-kube-api-access-t47rs" pod "ad53ca03-87f2-4d26-a93e-7d9cf1db9c47" (UID: "ad53ca03-87f2-4d26-a93e-7d9cf1db9c47"). InnerVolumeSpecName "kube-api-access-t47rs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:43:58.113754 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:43:58.113734    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1f6bf21d-fb4e-4e8f-bdd1-fd5adc6349e8-kube-api-access-qjrkw" pod "1f6bf21d-fb4e-4e8f-bdd1-fd5adc6349e8" (UID: "1f6bf21d-fb4e-4e8f-bdd1-fd5adc6349e8"). InnerVolumeSpecName "kube-api-access-qjrkw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:43:58.117396 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:43:58.117372    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ad53ca03-87f2-4d26-a93e-7d9cf1db9c47-util" pod "ad53ca03-87f2-4d26-a93e-7d9cf1db9c47" (UID: "ad53ca03-87f2-4d26-a93e-7d9cf1db9c47"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:43:58.117717 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:43:58.117697    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1f6bf21d-fb4e-4e8f-bdd1-fd5adc6349e8-util" pod "1f6bf21d-fb4e-4e8f-bdd1-fd5adc6349e8" (UID: "1f6bf21d-fb4e-4e8f-bdd1-fd5adc6349e8"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:43:58.212748 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:43:58.212721    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/8b4ee760-ce38-4661-8d92-2c847d9f473d-bundle\" (UniqueName: \"kubernetes.io/empty-dir/8b4ee760-ce38-4661-8d92-2c847d9f473d-bundle\") pod \"8b4ee760-ce38-4661-8d92-2c847d9f473d\" (UID: \"8b4ee760-ce38-4661-8d92-2c847d9f473d\") "
Oct 30 20:43:58.212880 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:43:58.212771    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/8b4ee760-ce38-4661-8d92-2c847d9f473d-kube-api-access-76b76\" (UniqueName: \"kubernetes.io/projected/8b4ee760-ce38-4661-8d92-2c847d9f473d-kube-api-access-76b76\") pod \"8b4ee760-ce38-4661-8d92-2c847d9f473d\" (UID: \"8b4ee760-ce38-4661-8d92-2c847d9f473d\") "
Oct 30 20:43:58.212880 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:43:58.212806    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/8b4ee760-ce38-4661-8d92-2c847d9f473d-util\" (UniqueName: \"kubernetes.io/empty-dir/8b4ee760-ce38-4661-8d92-2c847d9f473d-util\") pod \"8b4ee760-ce38-4661-8d92-2c847d9f473d\" (UID: \"8b4ee760-ce38-4661-8d92-2c847d9f473d\") "
Oct 30 20:43:58.212988 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:43:58.212974    6004 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ad53ca03-87f2-4d26-a93e-7d9cf1db9c47-util\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:43:58.213023 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:43:58.212996    6004 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t47rs\" (UniqueName: \"kubernetes.io/projected/ad53ca03-87f2-4d26-a93e-7d9cf1db9c47-kube-api-access-t47rs\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:43:58.213023 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:43:58.213011    6004 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1f6bf21d-fb4e-4e8f-bdd1-fd5adc6349e8-bundle\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:43:58.213108 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:43:58.213025    6004 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ad53ca03-87f2-4d26-a93e-7d9cf1db9c47-bundle\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:43:58.213108 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:43:58.213038    6004 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qjrkw\" (UniqueName: \"kubernetes.io/projected/1f6bf21d-fb4e-4e8f-bdd1-fd5adc6349e8-kube-api-access-qjrkw\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:43:58.213108 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:43:58.213074    6004 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1f6bf21d-fb4e-4e8f-bdd1-fd5adc6349e8-util\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:43:58.213457 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:43:58.213435    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8b4ee760-ce38-4661-8d92-2c847d9f473d-bundle" pod "8b4ee760-ce38-4661-8d92-2c847d9f473d" (UID: "8b4ee760-ce38-4661-8d92-2c847d9f473d"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:43:58.214833 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:43:58.214811    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8b4ee760-ce38-4661-8d92-2c847d9f473d-kube-api-access-76b76" pod "8b4ee760-ce38-4661-8d92-2c847d9f473d" (UID: "8b4ee760-ce38-4661-8d92-2c847d9f473d"). InnerVolumeSpecName "kube-api-access-76b76". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:43:58.216648 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:43:58.216627    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8b4ee760-ce38-4661-8d92-2c847d9f473d-util" pod "8b4ee760-ce38-4661-8d92-2c847d9f473d" (UID: "8b4ee760-ce38-4661-8d92-2c847d9f473d"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:43:58.314642 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:43:58.314611    6004 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8b4ee760-ce38-4661-8d92-2c847d9f473d-bundle\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:43:58.314758 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:43:58.314644    6004 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-76b76\" (UniqueName: \"kubernetes.io/projected/8b4ee760-ce38-4661-8d92-2c847d9f473d-kube-api-access-76b76\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:43:58.314758 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:43:58.314662    6004 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8b4ee760-ce38-4661-8d92-2c847d9f473d-util\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:43:58.838319 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:43:58.838292    6004 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651c86fbj"
Oct 30 20:43:58.838786 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:43:58.838290    6004 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651c86fbj" event={"ID":"8b4ee760-ce38-4661-8d92-2c847d9f473d","Type":"ContainerDied","Data":"3367570fc96503675dc08f96c479651d4a7ab9d23fad0cd9ae1d2737a04a0d73"}
Oct 30 20:43:58.838786 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:43:58.838424    6004 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3367570fc96503675dc08f96c479651d4a7ab9d23fad0cd9ae1d2737a04a0d73"
Oct 30 20:43:58.840453 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:43:58.840432    6004 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71jt4gg" event={"ID":"1f6bf21d-fb4e-4e8f-bdd1-fd5adc6349e8","Type":"ContainerDied","Data":"45c7bd92e503c39648f7623b8b1d6e70b373ac3d97f25dbe8ecf37b505931879"}
Oct 30 20:43:58.840584 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:43:58.840455    6004 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71jt4gg"
Oct 30 20:43:58.840584 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:43:58.840465    6004 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="45c7bd92e503c39648f7623b8b1d6e70b373ac3d97f25dbe8ecf37b505931879"
Oct 30 20:43:58.842774 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:43:58.842750    6004 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cxdtdf" event={"ID":"ad53ca03-87f2-4d26-a93e-7d9cf1db9c47","Type":"ContainerDied","Data":"9431ded1a040e8b431b16e53635ea859b6b156e70ac9be2bc4f323ad9d32bc72"}
Oct 30 20:43:58.842887 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:43:58.842784    6004 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9431ded1a040e8b431b16e53635ea859b6b156e70ac9be2bc4f323ad9d32bc72"
Oct 30 20:43:58.842887 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:43:58.842832    6004 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cxdtdf"
Oct 30 20:43:59.003010 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:43:59.002983    6004 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7v96hn"
Oct 30 20:43:59.008774 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:43:59.008754    6004 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c646p44"
Oct 30 20:43:59.119500 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:43:59.119419    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/bc21b899-1a8e-46a9-9a55-e9a13ae46ec3-util\" (UniqueName: \"kubernetes.io/empty-dir/bc21b899-1a8e-46a9-9a55-e9a13ae46ec3-util\") pod \"bc21b899-1a8e-46a9-9a55-e9a13ae46ec3\" (UID: \"bc21b899-1a8e-46a9-9a55-e9a13ae46ec3\") "
Oct 30 20:43:59.119500 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:43:59.119453    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/157ae0b0-c748-4cca-aea7-fab3afbe0a4e-util\" (UniqueName: \"kubernetes.io/empty-dir/157ae0b0-c748-4cca-aea7-fab3afbe0a4e-util\") pod \"157ae0b0-c748-4cca-aea7-fab3afbe0a4e\" (UID: \"157ae0b0-c748-4cca-aea7-fab3afbe0a4e\") "
Oct 30 20:43:59.119500 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:43:59.119491    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/bc21b899-1a8e-46a9-9a55-e9a13ae46ec3-kube-api-access-kr47b\" (UniqueName: \"kubernetes.io/projected/bc21b899-1a8e-46a9-9a55-e9a13ae46ec3-kube-api-access-kr47b\") pod \"bc21b899-1a8e-46a9-9a55-e9a13ae46ec3\" (UID: \"bc21b899-1a8e-46a9-9a55-e9a13ae46ec3\") "
Oct 30 20:43:59.119776 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:43:59.119543    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/157ae0b0-c748-4cca-aea7-fab3afbe0a4e-bundle\" (UniqueName: \"kubernetes.io/empty-dir/157ae0b0-c748-4cca-aea7-fab3afbe0a4e-bundle\") pod \"157ae0b0-c748-4cca-aea7-fab3afbe0a4e\" (UID: \"157ae0b0-c748-4cca-aea7-fab3afbe0a4e\") "
Oct 30 20:43:59.119776 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:43:59.119578    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/bc21b899-1a8e-46a9-9a55-e9a13ae46ec3-bundle\" (UniqueName: \"kubernetes.io/empty-dir/bc21b899-1a8e-46a9-9a55-e9a13ae46ec3-bundle\") pod \"bc21b899-1a8e-46a9-9a55-e9a13ae46ec3\" (UID: \"bc21b899-1a8e-46a9-9a55-e9a13ae46ec3\") "
Oct 30 20:43:59.119776 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:43:59.119603    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/157ae0b0-c748-4cca-aea7-fab3afbe0a4e-kube-api-access-pdd8r\" (UniqueName: \"kubernetes.io/projected/157ae0b0-c748-4cca-aea7-fab3afbe0a4e-kube-api-access-pdd8r\") pod \"157ae0b0-c748-4cca-aea7-fab3afbe0a4e\" (UID: \"157ae0b0-c748-4cca-aea7-fab3afbe0a4e\") "
Oct 30 20:43:59.120496 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:43:59.120033    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/157ae0b0-c748-4cca-aea7-fab3afbe0a4e-bundle" pod "157ae0b0-c748-4cca-aea7-fab3afbe0a4e" (UID: "157ae0b0-c748-4cca-aea7-fab3afbe0a4e"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:43:59.120496 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:43:59.120090    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bc21b899-1a8e-46a9-9a55-e9a13ae46ec3-bundle" pod "bc21b899-1a8e-46a9-9a55-e9a13ae46ec3" (UID: "bc21b899-1a8e-46a9-9a55-e9a13ae46ec3"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:43:59.123559 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:43:59.123479    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/157ae0b0-c748-4cca-aea7-fab3afbe0a4e-kube-api-access-pdd8r" pod "157ae0b0-c748-4cca-aea7-fab3afbe0a4e" (UID: "157ae0b0-c748-4cca-aea7-fab3afbe0a4e"). InnerVolumeSpecName "kube-api-access-pdd8r". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:43:59.124280 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:43:59.124234    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bc21b899-1a8e-46a9-9a55-e9a13ae46ec3-kube-api-access-kr47b" pod "bc21b899-1a8e-46a9-9a55-e9a13ae46ec3" (UID: "bc21b899-1a8e-46a9-9a55-e9a13ae46ec3"). InnerVolumeSpecName "kube-api-access-kr47b". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:43:59.126080 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:43:59.126033    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bc21b899-1a8e-46a9-9a55-e9a13ae46ec3-util" pod "bc21b899-1a8e-46a9-9a55-e9a13ae46ec3" (UID: "bc21b899-1a8e-46a9-9a55-e9a13ae46ec3"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:43:59.127495 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:43:59.127466    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/157ae0b0-c748-4cca-aea7-fab3afbe0a4e-util" pod "157ae0b0-c748-4cca-aea7-fab3afbe0a4e" (UID: "157ae0b0-c748-4cca-aea7-fab3afbe0a4e"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:43:59.220969 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:43:59.220934    6004 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bc21b899-1a8e-46a9-9a55-e9a13ae46ec3-util\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:43:59.220969 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:43:59.220962    6004 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/157ae0b0-c748-4cca-aea7-fab3afbe0a4e-util\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:43:59.220969 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:43:59.220976    6004 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kr47b\" (UniqueName: \"kubernetes.io/projected/bc21b899-1a8e-46a9-9a55-e9a13ae46ec3-kube-api-access-kr47b\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:43:59.221217 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:43:59.220988    6004 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/157ae0b0-c748-4cca-aea7-fab3afbe0a4e-bundle\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:43:59.221217 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:43:59.221002    6004 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bc21b899-1a8e-46a9-9a55-e9a13ae46ec3-bundle\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:43:59.221217 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:43:59.221013    6004 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pdd8r\" (UniqueName: \"kubernetes.io/projected/157ae0b0-c748-4cca-aea7-fab3afbe0a4e-kube-api-access-pdd8r\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:43:59.849399 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:43:59.849371    6004 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c646p44"
Oct 30 20:43:59.849846 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:43:59.849369    6004 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c646p44" event={"ID":"157ae0b0-c748-4cca-aea7-fab3afbe0a4e","Type":"ContainerDied","Data":"8a61c07797d05da888d8c88c6f11452d58632b79202496a682f677a99c823d88"}
Oct 30 20:43:59.849846 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:43:59.849520    6004 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8a61c07797d05da888d8c88c6f11452d58632b79202496a682f677a99c823d88"
Oct 30 20:43:59.851282 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:43:59.851261    6004 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7v96hn"
Oct 30 20:43:59.851282 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:43:59.851269    6004 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7v96hn" event={"ID":"bc21b899-1a8e-46a9-9a55-e9a13ae46ec3","Type":"ContainerDied","Data":"d8288d33b5c326c9166c9d0b45d3341be091843b842a86fdd53936befec4e891"}
Oct 30 20:43:59.851429 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:43:59.851309    6004 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d8288d33b5c326c9166c9d0b45d3341be091843b842a86fdd53936befec4e891"
Oct 30 20:44:04.186853 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:44:04.186820    6004 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-7d87bcd5fd-whzbj"]
Oct 30 20:44:04.187282 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:44:04.187157    6004 cpu_manager.go:414] "containerMap: removing container" podUID="ad53ca03-87f2-4d26-a93e-7d9cf1db9c47" containerName="extract"
Oct 30 20:44:04.187282 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:44:04.187168    6004 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="ad53ca03-87f2-4d26-a93e-7d9cf1db9c47" containerName="extract"
Oct 30 20:44:04.187282 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:44:04.187180    6004 cpu_manager.go:414] "containerMap: removing container" podUID="ad53ca03-87f2-4d26-a93e-7d9cf1db9c47" containerName="util"
Oct 30 20:44:04.187282 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:44:04.187185    6004 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="ad53ca03-87f2-4d26-a93e-7d9cf1db9c47" containerName="util"
Oct 30 20:44:04.187282 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:44:04.187192    6004 cpu_manager.go:414] "containerMap: removing container" podUID="bc21b899-1a8e-46a9-9a55-e9a13ae46ec3" containerName="extract"
Oct 30 20:44:04.187282 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:44:04.187206    6004 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="bc21b899-1a8e-46a9-9a55-e9a13ae46ec3" containerName="extract"
Oct 30 20:44:04.187282 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:44:04.187222    6004 cpu_manager.go:414] "containerMap: removing container" podUID="1f6bf21d-fb4e-4e8f-bdd1-fd5adc6349e8" containerName="extract"
Oct 30 20:44:04.187282 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:44:04.187227    6004 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="1f6bf21d-fb4e-4e8f-bdd1-fd5adc6349e8" containerName="extract"
Oct 30 20:44:04.187282 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:44:04.187234    6004 cpu_manager.go:414] "containerMap: removing container" podUID="157ae0b0-c748-4cca-aea7-fab3afbe0a4e" containerName="util"
Oct 30 20:44:04.187282 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:44:04.187239    6004 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="157ae0b0-c748-4cca-aea7-fab3afbe0a4e" containerName="util"
Oct 30 20:44:04.187282 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:44:04.187247    6004 cpu_manager.go:414] "containerMap: removing container" podUID="157ae0b0-c748-4cca-aea7-fab3afbe0a4e" containerName="pull"
Oct 30 20:44:04.187282 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:44:04.187251    6004 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="157ae0b0-c748-4cca-aea7-fab3afbe0a4e" containerName="pull"
Oct 30 20:44:04.187282 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:44:04.187258    6004 cpu_manager.go:414] "containerMap: removing container" podUID="bc21b899-1a8e-46a9-9a55-e9a13ae46ec3" containerName="pull"
Oct 30 20:44:04.187282 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:44:04.187263    6004 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="bc21b899-1a8e-46a9-9a55-e9a13ae46ec3" containerName="pull"
Oct 30 20:44:04.187282 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:44:04.187271    6004 cpu_manager.go:414] "containerMap: removing container" podUID="bc21b899-1a8e-46a9-9a55-e9a13ae46ec3" containerName="util"
Oct 30 20:44:04.187282 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:44:04.187275    6004 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="bc21b899-1a8e-46a9-9a55-e9a13ae46ec3" containerName="util"
Oct 30 20:44:04.187282 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:44:04.187281    6004 cpu_manager.go:414] "containerMap: removing container" podUID="157ae0b0-c748-4cca-aea7-fab3afbe0a4e" containerName="extract"
Oct 30 20:44:04.187282 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:44:04.187285    6004 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="157ae0b0-c748-4cca-aea7-fab3afbe0a4e" containerName="extract"
Oct 30 20:44:04.187859 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:44:04.187295    6004 cpu_manager.go:414] "containerMap: removing container" podUID="8b4ee760-ce38-4661-8d92-2c847d9f473d" containerName="pull"
Oct 30 20:44:04.187859 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:44:04.187300    6004 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="8b4ee760-ce38-4661-8d92-2c847d9f473d" containerName="pull"
Oct 30 20:44:04.187859 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:44:04.187307    6004 cpu_manager.go:414] "containerMap: removing container" podUID="1f6bf21d-fb4e-4e8f-bdd1-fd5adc6349e8" containerName="util"
Oct 30 20:44:04.187859 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:44:04.187311    6004 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="1f6bf21d-fb4e-4e8f-bdd1-fd5adc6349e8" containerName="util"
Oct 30 20:44:04.187859 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:44:04.187318    6004 cpu_manager.go:414] "containerMap: removing container" podUID="8b4ee760-ce38-4661-8d92-2c847d9f473d" containerName="util"
Oct 30 20:44:04.187859 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:44:04.187322    6004 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="8b4ee760-ce38-4661-8d92-2c847d9f473d" containerName="util"
Oct 30 20:44:04.187859 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:44:04.187328    6004 cpu_manager.go:414] "containerMap: removing container" podUID="1f6bf21d-fb4e-4e8f-bdd1-fd5adc6349e8" containerName="pull"
Oct 30 20:44:04.187859 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:44:04.187332    6004 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="1f6bf21d-fb4e-4e8f-bdd1-fd5adc6349e8" containerName="pull"
Oct 30 20:44:04.187859 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:44:04.187338    6004 cpu_manager.go:414] "containerMap: removing container" podUID="ad53ca03-87f2-4d26-a93e-7d9cf1db9c47" containerName="pull"
Oct 30 20:44:04.187859 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:44:04.187342    6004 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="ad53ca03-87f2-4d26-a93e-7d9cf1db9c47" containerName="pull"
Oct 30 20:44:04.187859 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:44:04.187348    6004 cpu_manager.go:414] "containerMap: removing container" podUID="8b4ee760-ce38-4661-8d92-2c847d9f473d" containerName="extract"
Oct 30 20:44:04.187859 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:44:04.187352    6004 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="8b4ee760-ce38-4661-8d92-2c847d9f473d" containerName="extract"
Oct 30 20:44:04.187859 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:44:04.187399    6004 memory_manager.go:365] "RemoveStaleState removing state" podUID="ad53ca03-87f2-4d26-a93e-7d9cf1db9c47" containerName="extract"
Oct 30 20:44:04.187859 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:44:04.187408    6004 memory_manager.go:365] "RemoveStaleState removing state" podUID="bc21b899-1a8e-46a9-9a55-e9a13ae46ec3" containerName="extract"
Oct 30 20:44:04.187859 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:44:04.187414    6004 memory_manager.go:365] "RemoveStaleState removing state" podUID="1f6bf21d-fb4e-4e8f-bdd1-fd5adc6349e8" containerName="extract"
Oct 30 20:44:04.187859 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:44:04.187421    6004 memory_manager.go:365] "RemoveStaleState removing state" podUID="157ae0b0-c748-4cca-aea7-fab3afbe0a4e" containerName="extract"
Oct 30 20:44:04.187859 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:44:04.187427    6004 memory_manager.go:365] "RemoveStaleState removing state" podUID="8b4ee760-ce38-4661-8d92-2c847d9f473d" containerName="extract"
Oct 30 20:44:04.220185 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:44:04.220160    6004 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-7d87bcd5fd-whzbj"
Oct 30 20:44:04.248605 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:44:04.248575    6004 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-7d87bcd5fd-whzbj"]
Oct 30 20:44:04.297643 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:44:04.297617    6004 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-2bbvp\""
Oct 30 20:44:04.297787 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:44:04.297678    6004 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\""
Oct 30 20:44:04.297787 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:44:04.297700    6004 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\""
Oct 30 20:44:04.361329 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:44:04.361296    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/50f9d81e-61e9-4fe9-bde3-39c899a931c6-tmp\") pod \"cert-manager-operator-controller-manager-7d87bcd5fd-whzbj\" (UID: \"50f9d81e-61e9-4fe9-bde3-39c899a931c6\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-7d87bcd5fd-whzbj"
Oct 30 20:44:04.361426 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:44:04.361337    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qk5xs\" (UniqueName: \"kubernetes.io/projected/50f9d81e-61e9-4fe9-bde3-39c899a931c6-kube-api-access-qk5xs\") pod \"cert-manager-operator-controller-manager-7d87bcd5fd-whzbj\" (UID: \"50f9d81e-61e9-4fe9-bde3-39c899a931c6\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-7d87bcd5fd-whzbj"
Oct 30 20:44:04.462778 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:44:04.462695    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/50f9d81e-61e9-4fe9-bde3-39c899a931c6-tmp\") pod \"cert-manager-operator-controller-manager-7d87bcd5fd-whzbj\" (UID: \"50f9d81e-61e9-4fe9-bde3-39c899a931c6\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-7d87bcd5fd-whzbj"
Oct 30 20:44:04.462778 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:44:04.462727    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qk5xs\" (UniqueName: \"kubernetes.io/projected/50f9d81e-61e9-4fe9-bde3-39c899a931c6-kube-api-access-qk5xs\") pod \"cert-manager-operator-controller-manager-7d87bcd5fd-whzbj\" (UID: \"50f9d81e-61e9-4fe9-bde3-39c899a931c6\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-7d87bcd5fd-whzbj"
Oct 30 20:44:04.463102 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:44:04.463082    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/50f9d81e-61e9-4fe9-bde3-39c899a931c6-tmp\") pod \"cert-manager-operator-controller-manager-7d87bcd5fd-whzbj\" (UID: \"50f9d81e-61e9-4fe9-bde3-39c899a931c6\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-7d87bcd5fd-whzbj"
Oct 30 20:44:04.521097 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:44:04.521043    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qk5xs\" (UniqueName: \"kubernetes.io/projected/50f9d81e-61e9-4fe9-bde3-39c899a931c6-kube-api-access-qk5xs\") pod \"cert-manager-operator-controller-manager-7d87bcd5fd-whzbj\" (UID: \"50f9d81e-61e9-4fe9-bde3-39c899a931c6\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-7d87bcd5fd-whzbj"
Oct 30 20:44:04.549721 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:44:04.549694    6004 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-7d87bcd5fd-whzbj"
Oct 30 20:44:04.981395 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:44:04.981366    6004 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-7d87bcd5fd-whzbj"]
Oct 30 20:44:04.984237 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:44:04.984210    6004 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod50f9d81e_61e9_4fe9_bde3_39c899a931c6.slice/crio-15a10ef3b9a67e0fffcbc2b413e84a5626dd8100c420a547024837835755e8f8 WatchSource:0}: Error finding container 15a10ef3b9a67e0fffcbc2b413e84a5626dd8100c420a547024837835755e8f8: Status 404 returned error can't find the container with id 15a10ef3b9a67e0fffcbc2b413e84a5626dd8100c420a547024837835755e8f8
Oct 30 20:44:05.878459 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:44:05.878411    6004 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-7d87bcd5fd-whzbj" event={"ID":"50f9d81e-61e9-4fe9-bde3-39c899a931c6","Type":"ContainerStarted","Data":"15a10ef3b9a67e0fffcbc2b413e84a5626dd8100c420a547024837835755e8f8"}
Oct 30 20:44:07.889642 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:44:07.889540    6004 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-7d87bcd5fd-whzbj" event={"ID":"50f9d81e-61e9-4fe9-bde3-39c899a931c6","Type":"ContainerStarted","Data":"0e1640f3a14c1f5bb9a3eb229481c5e1d5257910434bb3688c65a934e87b1d3f"}
Oct 30 20:44:08.115141 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:44:08.115089    6004 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-7d87bcd5fd-whzbj" podStartSLOduration=1.614022516 podStartE2EDuration="4.115076018s" totalImagesPullingTime="2.501053502s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:44:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:44:08.063360402 +0000 UTC m=+353.983146521" watchObservedRunningTime="2026-10-30 20:44:08.115076018 +0000 UTC m=+354.034862135"
Oct 30 20:44:10.349022 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:44:10.348988    6004 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["opendatahub-operator-system/opendatahub-operator-controller-manager-57f958cfdb-8pkkq"]
Oct 30 20:44:10.352074 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:44:10.352036    6004 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-57f958cfdb-8pkkq"
Oct 30 20:44:10.410504 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:44:10.410468    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/f26c7f30-70df-4c92-8aa4-1475e0f7d95a-manifests\") pod \"opendatahub-operator-controller-manager-57f958cfdb-8pkkq\" (UID: \"f26c7f30-70df-4c92-8aa4-1475e0f7d95a\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-57f958cfdb-8pkkq"
Oct 30 20:44:10.410504 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:44:10.410507    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/f26c7f30-70df-4c92-8aa4-1475e0f7d95a-apiservice-cert\") pod \"opendatahub-operator-controller-manager-57f958cfdb-8pkkq\" (UID: \"f26c7f30-70df-4c92-8aa4-1475e0f7d95a\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-57f958cfdb-8pkkq"
Oct 30 20:44:10.410670 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:44:10.410526    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n4m28\" (UniqueName: \"kubernetes.io/projected/f26c7f30-70df-4c92-8aa4-1475e0f7d95a-kube-api-access-n4m28\") pod \"opendatahub-operator-controller-manager-57f958cfdb-8pkkq\" (UID: \"f26c7f30-70df-4c92-8aa4-1475e0f7d95a\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-57f958cfdb-8pkkq"
Oct 30 20:44:10.410670 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:44:10.410633    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f26c7f30-70df-4c92-8aa4-1475e0f7d95a-tmp\") pod \"opendatahub-operator-controller-manager-57f958cfdb-8pkkq\" (UID: \"f26c7f30-70df-4c92-8aa4-1475e0f7d95a\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-57f958cfdb-8pkkq"
Oct 30 20:44:10.410670 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:44:10.410661    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f26c7f30-70df-4c92-8aa4-1475e0f7d95a-webhook-cert\") pod \"opendatahub-operator-controller-manager-57f958cfdb-8pkkq\" (UID: \"f26c7f30-70df-4c92-8aa4-1475e0f7d95a\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-57f958cfdb-8pkkq"
Oct 30 20:44:10.410794 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:44:10.410681    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/f26c7f30-70df-4c92-8aa4-1475e0f7d95a-metrics-cert\") pod \"opendatahub-operator-controller-manager-57f958cfdb-8pkkq\" (UID: \"f26c7f30-70df-4c92-8aa4-1475e0f7d95a\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-57f958cfdb-8pkkq"
Oct 30 20:44:10.418368 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:44:10.418345    6004 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub-operator-system\"/\"openshift-service-ca.crt\""
Oct 30 20:44:10.466665 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:44:10.466619    6004 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub-operator-system\"/\"opendatahub-operator-controller-webhook-cert\""
Oct 30 20:44:10.466665 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:44:10.466650    6004 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub-operator-system\"/\"opendatahub-operator-metrics-tls\""
Oct 30 20:44:10.466877 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:44:10.466671    6004 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub-operator-system\"/\"kube-root-ca.crt\""
Oct 30 20:44:10.466877 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:44:10.466719    6004 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub-operator-system\"/\"opendatahub-operator-controller-manager-service-cert\""
Oct 30 20:44:10.466877 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:44:10.466724    6004 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub-operator-system\"/\"opendatahub-operator-controller-manager-dockercfg-wrjh7\""
Oct 30 20:44:10.471032 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:44:10.471008    6004 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub-operator-system/opendatahub-operator-controller-manager-57f958cfdb-8pkkq"]
Oct 30 20:44:10.511414 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:44:10.511371    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f26c7f30-70df-4c92-8aa4-1475e0f7d95a-tmp\") pod \"opendatahub-operator-controller-manager-57f958cfdb-8pkkq\" (UID: \"f26c7f30-70df-4c92-8aa4-1475e0f7d95a\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-57f958cfdb-8pkkq"
Oct 30 20:44:10.511414 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:44:10.511432    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f26c7f30-70df-4c92-8aa4-1475e0f7d95a-webhook-cert\") pod \"opendatahub-operator-controller-manager-57f958cfdb-8pkkq\" (UID: \"f26c7f30-70df-4c92-8aa4-1475e0f7d95a\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-57f958cfdb-8pkkq"
Oct 30 20:44:10.511604 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:44:10.511460    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/f26c7f30-70df-4c92-8aa4-1475e0f7d95a-metrics-cert\") pod \"opendatahub-operator-controller-manager-57f958cfdb-8pkkq\" (UID: \"f26c7f30-70df-4c92-8aa4-1475e0f7d95a\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-57f958cfdb-8pkkq"
Oct 30 20:44:10.511604 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:44:10.511519    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/f26c7f30-70df-4c92-8aa4-1475e0f7d95a-manifests\") pod \"opendatahub-operator-controller-manager-57f958cfdb-8pkkq\" (UID: \"f26c7f30-70df-4c92-8aa4-1475e0f7d95a\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-57f958cfdb-8pkkq"
Oct 30 20:44:10.511604 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:44:10.511550    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/f26c7f30-70df-4c92-8aa4-1475e0f7d95a-apiservice-cert\") pod \"opendatahub-operator-controller-manager-57f958cfdb-8pkkq\" (UID: \"f26c7f30-70df-4c92-8aa4-1475e0f7d95a\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-57f958cfdb-8pkkq"
Oct 30 20:44:10.511604 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:44:10.511576    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n4m28\" (UniqueName: \"kubernetes.io/projected/f26c7f30-70df-4c92-8aa4-1475e0f7d95a-kube-api-access-n4m28\") pod \"opendatahub-operator-controller-manager-57f958cfdb-8pkkq\" (UID: \"f26c7f30-70df-4c92-8aa4-1475e0f7d95a\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-57f958cfdb-8pkkq"
Oct 30 20:44:10.511971 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:44:10.511937    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/f26c7f30-70df-4c92-8aa4-1475e0f7d95a-manifests\") pod \"opendatahub-operator-controller-manager-57f958cfdb-8pkkq\" (UID: \"f26c7f30-70df-4c92-8aa4-1475e0f7d95a\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-57f958cfdb-8pkkq"
Oct 30 20:44:10.513875 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:44:10.513853    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f26c7f30-70df-4c92-8aa4-1475e0f7d95a-tmp\") pod \"opendatahub-operator-controller-manager-57f958cfdb-8pkkq\" (UID: \"f26c7f30-70df-4c92-8aa4-1475e0f7d95a\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-57f958cfdb-8pkkq"
Oct 30 20:44:10.514134 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:44:10.514109    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/f26c7f30-70df-4c92-8aa4-1475e0f7d95a-apiservice-cert\") pod \"opendatahub-operator-controller-manager-57f958cfdb-8pkkq\" (UID: \"f26c7f30-70df-4c92-8aa4-1475e0f7d95a\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-57f958cfdb-8pkkq"
Oct 30 20:44:10.514216 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:44:10.514194    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f26c7f30-70df-4c92-8aa4-1475e0f7d95a-webhook-cert\") pod \"opendatahub-operator-controller-manager-57f958cfdb-8pkkq\" (UID: \"f26c7f30-70df-4c92-8aa4-1475e0f7d95a\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-57f958cfdb-8pkkq"
Oct 30 20:44:10.514264 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:44:10.514251    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/f26c7f30-70df-4c92-8aa4-1475e0f7d95a-metrics-cert\") pod \"opendatahub-operator-controller-manager-57f958cfdb-8pkkq\" (UID: \"f26c7f30-70df-4c92-8aa4-1475e0f7d95a\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-57f958cfdb-8pkkq"
Oct 30 20:44:10.582964 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:44:10.582937    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n4m28\" (UniqueName: \"kubernetes.io/projected/f26c7f30-70df-4c92-8aa4-1475e0f7d95a-kube-api-access-n4m28\") pod \"opendatahub-operator-controller-manager-57f958cfdb-8pkkq\" (UID: \"f26c7f30-70df-4c92-8aa4-1475e0f7d95a\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-57f958cfdb-8pkkq"
Oct 30 20:44:10.665126 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:44:10.665033    6004 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-57f958cfdb-8pkkq"
Oct 30 20:44:11.157307 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:44:11.157270    6004 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf26c7f30_70df_4c92_8aa4_1475e0f7d95a.slice/crio-68773d190ff32e7e4f67dd2bc80f695f5ce44e8d0168484ce2a53ba457f8af8b WatchSource:0}: Error finding container 68773d190ff32e7e4f67dd2bc80f695f5ce44e8d0168484ce2a53ba457f8af8b: Status 404 returned error can't find the container with id 68773d190ff32e7e4f67dd2bc80f695f5ce44e8d0168484ce2a53ba457f8af8b
Oct 30 20:44:11.160473 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:44:11.160365    6004 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub-operator-system/opendatahub-operator-controller-manager-57f958cfdb-8pkkq"]
Oct 30 20:44:11.908838 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:44:11.908801    6004 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-57f958cfdb-8pkkq" event={"ID":"f26c7f30-70df-4c92-8aa4-1475e0f7d95a","Type":"ContainerStarted","Data":"68773d190ff32e7e4f67dd2bc80f695f5ce44e8d0168484ce2a53ba457f8af8b"}
Oct 30 20:44:14.293420 ip-10-0-138-85 kubenswrapper[6004]: E1030 20:44:14.293385    6004 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-zz4wr" containerName="extractor"
Oct 30 20:44:15.931093 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:44:15.931063    6004 generic.go:356] "Generic (PLEG): container finished" podID="f26c7f30-70df-4c92-8aa4-1475e0f7d95a" containerID="df605b73026f65455b70fa4374af2973f80fcaa8b39a06c52a6c40a22a4761dd" exitCode=0
Oct 30 20:44:15.931472 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:44:15.931101    6004 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-57f958cfdb-8pkkq" event={"ID":"f26c7f30-70df-4c92-8aa4-1475e0f7d95a","Type":"ContainerDied","Data":"df605b73026f65455b70fa4374af2973f80fcaa8b39a06c52a6c40a22a4761dd"}
Oct 30 20:44:16.566662 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:44:16.566624    6004 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-5dbbbf75cc-hx9wb"]
Oct 30 20:44:16.568894 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:44:16.568877    6004 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-5dbbbf75cc-hx9wb"
Oct 30 20:44:16.622155 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:44:16.622129    6004 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Oct 30 20:44:16.626392 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:44:16.626360    6004 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-6wn4q\""
Oct 30 20:44:16.627224 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:44:16.627185    6004 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-5dbbbf75cc-hx9wb"]
Oct 30 20:44:16.662856 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:44:16.662826    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r8675\" (UniqueName: \"kubernetes.io/projected/66856dd8-3224-436a-9922-b4b33dbba176-kube-api-access-r8675\") pod \"cert-manager-webhook-5dbbbf75cc-hx9wb\" (UID: \"66856dd8-3224-436a-9922-b4b33dbba176\") " pod="cert-manager/cert-manager-webhook-5dbbbf75cc-hx9wb"
Oct 30 20:44:16.662994 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:44:16.662876    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/66856dd8-3224-436a-9922-b4b33dbba176-bound-sa-token\") pod \"cert-manager-webhook-5dbbbf75cc-hx9wb\" (UID: \"66856dd8-3224-436a-9922-b4b33dbba176\") " pod="cert-manager/cert-manager-webhook-5dbbbf75cc-hx9wb"
Oct 30 20:44:16.722217 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:44:16.722191    6004 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Oct 30 20:44:16.763690 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:44:16.763660    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r8675\" (UniqueName: \"kubernetes.io/projected/66856dd8-3224-436a-9922-b4b33dbba176-kube-api-access-r8675\") pod \"cert-manager-webhook-5dbbbf75cc-hx9wb\" (UID: \"66856dd8-3224-436a-9922-b4b33dbba176\") " pod="cert-manager/cert-manager-webhook-5dbbbf75cc-hx9wb"
Oct 30 20:44:16.763690 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:44:16.763691    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/66856dd8-3224-436a-9922-b4b33dbba176-bound-sa-token\") pod \"cert-manager-webhook-5dbbbf75cc-hx9wb\" (UID: \"66856dd8-3224-436a-9922-b4b33dbba176\") " pod="cert-manager/cert-manager-webhook-5dbbbf75cc-hx9wb"
Oct 30 20:44:16.821667 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:44:16.821644    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/66856dd8-3224-436a-9922-b4b33dbba176-bound-sa-token\") pod \"cert-manager-webhook-5dbbbf75cc-hx9wb\" (UID: \"66856dd8-3224-436a-9922-b4b33dbba176\") " pod="cert-manager/cert-manager-webhook-5dbbbf75cc-hx9wb"
Oct 30 20:44:16.821863 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:44:16.821838    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r8675\" (UniqueName: \"kubernetes.io/projected/66856dd8-3224-436a-9922-b4b33dbba176-kube-api-access-r8675\") pod \"cert-manager-webhook-5dbbbf75cc-hx9wb\" (UID: \"66856dd8-3224-436a-9922-b4b33dbba176\") " pod="cert-manager/cert-manager-webhook-5dbbbf75cc-hx9wb"
Oct 30 20:44:16.891293 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:44:16.891266    6004 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-5dbbbf75cc-hx9wb"
Oct 30 20:44:16.938802 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:44:16.938765    6004 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-57f958cfdb-8pkkq" event={"ID":"f26c7f30-70df-4c92-8aa4-1475e0f7d95a","Type":"ContainerStarted","Data":"f3146e1b378006d2cc093635b480749d7623266f1ba0d7e7dfb69eb73a5f05b4"}
Oct 30 20:44:16.939219 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:44:16.939013    6004 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-57f958cfdb-8pkkq"
Oct 30 20:44:17.094684 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:44:17.094580    6004 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-57f958cfdb-8pkkq" podStartSLOduration=2.023227993 podStartE2EDuration="7.094565473s" totalImagesPullingTime="4.656665061s" totalInitContainerRuntime="414.672419ms" isStatefulPod=false podCreationTimestamp="2026-10-30 20:44:10 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:44:17.093715691 +0000 UTC m=+363.013501820" watchObservedRunningTime="2026-10-30 20:44:17.094565473 +0000 UTC m=+363.014351612"
Oct 30 20:44:17.276981 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:44:17.276941    6004 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-5dbbbf75cc-hx9wb"]
Oct 30 20:44:17.279926 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:44:17.279899    6004 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod66856dd8_3224_436a_9922_b4b33dbba176.slice/crio-7b4f314e95f364bc4e7cf17c66098a943ee7855aace73b6641c894eea5f6db95 WatchSource:0}: Error finding container 7b4f314e95f364bc4e7cf17c66098a943ee7855aace73b6641c894eea5f6db95: Status 404 returned error can't find the container with id 7b4f314e95f364bc4e7cf17c66098a943ee7855aace73b6641c894eea5f6db95
Oct 30 20:44:17.944945 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:44:17.944907    6004 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-5dbbbf75cc-hx9wb" event={"ID":"66856dd8-3224-436a-9922-b4b33dbba176","Type":"ContainerStarted","Data":"7b4f314e95f364bc4e7cf17c66098a943ee7855aace73b6641c894eea5f6db95"}
Oct 30 20:44:20.962600 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:44:20.962519    6004 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-5dbbbf75cc-hx9wb" event={"ID":"66856dd8-3224-436a-9922-b4b33dbba176","Type":"ContainerStarted","Data":"63fa825b6263a122c5094c56e8bcc131efee0705a5b6ba7e44e73fa5b13a19c2"}
Oct 30 20:44:20.962953 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:44:20.962627    6004 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-5dbbbf75cc-hx9wb"
Oct 30 20:44:21.086538 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:44:21.086482    6004 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-5dbbbf75cc-hx9wb" podStartSLOduration=1.674688578 podStartE2EDuration="5.08646874s" totalImagesPullingTime="3.411780162s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:44:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:44:21.085584028 +0000 UTC m=+367.005370147" watchObservedRunningTime="2026-10-30 20:44:21.08646874 +0000 UTC m=+367.006254858"
Oct 30 20:44:23.234686 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:44:23.234645    6004 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-8557cbdb84-nsfwz"]
Oct 30 20:44:23.237116 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:44:23.237096    6004 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-8557cbdb84-nsfwz"
Oct 30 20:44:23.321924 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:44:23.321884    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kxkdw\" (UniqueName: \"kubernetes.io/projected/5161191a-b984-4f95-b35e-2c095ec17d15-kube-api-access-kxkdw\") pod \"dns-operator-controller-manager-8557cbdb84-nsfwz\" (UID: \"5161191a-b984-4f95-b35e-2c095ec17d15\") " pod="kuadrant-system/dns-operator-controller-manager-8557cbdb84-nsfwz"
Oct 30 20:44:23.343659 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:44:23.343628    6004 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\""
Oct 30 20:44:23.343659 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:44:23.343633    6004 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Oct 30 20:44:23.343832 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:44:23.343660    6004 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-qpgvc\""
Oct 30 20:44:23.343832 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:44:23.343718    6004 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Oct 30 20:44:23.345124 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:44:23.345104    6004 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-8557cbdb84-nsfwz"]
Oct 30 20:44:23.423456 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:44:23.423420    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kxkdw\" (UniqueName: \"kubernetes.io/projected/5161191a-b984-4f95-b35e-2c095ec17d15-kube-api-access-kxkdw\") pod \"dns-operator-controller-manager-8557cbdb84-nsfwz\" (UID: \"5161191a-b984-4f95-b35e-2c095ec17d15\") " pod="kuadrant-system/dns-operator-controller-manager-8557cbdb84-nsfwz"
Oct 30 20:44:23.481072 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:44:23.481021    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kxkdw\" (UniqueName: \"kubernetes.io/projected/5161191a-b984-4f95-b35e-2c095ec17d15-kube-api-access-kxkdw\") pod \"dns-operator-controller-manager-8557cbdb84-nsfwz\" (UID: \"5161191a-b984-4f95-b35e-2c095ec17d15\") " pod="kuadrant-system/dns-operator-controller-manager-8557cbdb84-nsfwz"
Oct 30 20:44:23.548247 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:44:23.548161    6004 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-8557cbdb84-nsfwz"
Oct 30 20:44:23.940842 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:44:23.940808    6004 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5161191a_b984_4f95_b35e_2c095ec17d15.slice/crio-50de034f7f5dc57c000e0cf90ad9698bc0c88ea453a5a88888a4c51a43e3b025 WatchSource:0}: Error finding container 50de034f7f5dc57c000e0cf90ad9698bc0c88ea453a5a88888a4c51a43e3b025: Status 404 returned error can't find the container with id 50de034f7f5dc57c000e0cf90ad9698bc0c88ea453a5a88888a4c51a43e3b025
Oct 30 20:44:23.976666 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:44:23.976633    6004 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-8557cbdb84-nsfwz" event={"ID":"5161191a-b984-4f95-b35e-2c095ec17d15","Type":"ContainerStarted","Data":"50de034f7f5dc57c000e0cf90ad9698bc0c88ea453a5a88888a4c51a43e3b025"}
Oct 30 20:44:23.986140 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:44:23.986119    6004 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-8557cbdb84-nsfwz"]
Oct 30 20:44:26.969807 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:44:26.969723    6004 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-5dbbbf75cc-hx9wb"
Oct 30 20:44:27.946971 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:44:27.946943    6004 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-57f958cfdb-8pkkq"
Oct 30 20:44:27.996404 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:44:27.996364    6004 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-8557cbdb84-nsfwz" event={"ID":"5161191a-b984-4f95-b35e-2c095ec17d15","Type":"ContainerStarted","Data":"8eb34103316f3546598f744b18bb885c6af7be8c285019261f07ba0b5150732b"}
Oct 30 20:44:27.996796 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:44:27.996459    6004 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-8557cbdb84-nsfwz"
Oct 30 20:44:28.302607 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:44:28.302502    6004 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-8557cbdb84-nsfwz" podStartSLOduration=1.6770705860000001 podStartE2EDuration="5.302487637s" totalImagesPullingTime="3.625417051s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:44:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:44:28.301552284 +0000 UTC m=+374.221338403" watchObservedRunningTime="2026-10-30 20:44:28.302487637 +0000 UTC m=+374.222273755"
Oct 30 20:44:29.422602 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:44:29.422568    6004 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-678d87766f-btzg6"]
Oct 30 20:44:29.424992 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:44:29.424974    6004 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-btzg6"
Oct 30 20:44:29.436596 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:44:29.436574    6004 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-678d87766f-btzg6"]
Oct 30 20:44:29.476934 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:44:29.476899    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/8a47c9b5-f2d9-4ec7-98f9-77903f9098d5-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-678d87766f-btzg6\" (UID: \"8a47c9b5-f2d9-4ec7-98f9-77903f9098d5\") " pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-btzg6"
Oct 30 20:44:29.477085 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:44:29.476954    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jw7d2\" (UniqueName: \"kubernetes.io/projected/8a47c9b5-f2d9-4ec7-98f9-77903f9098d5-kube-api-access-jw7d2\") pod \"kuadrant-operator-controller-manager-678d87766f-btzg6\" (UID: \"8a47c9b5-f2d9-4ec7-98f9-77903f9098d5\") " pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-btzg6"
Oct 30 20:44:29.485648 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:44:29.485625    6004 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-zsc5j\""
Oct 30 20:44:29.577937 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:44:29.577899    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/8a47c9b5-f2d9-4ec7-98f9-77903f9098d5-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-678d87766f-btzg6\" (UID: \"8a47c9b5-f2d9-4ec7-98f9-77903f9098d5\") " pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-btzg6"
Oct 30 20:44:29.578108 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:44:29.577949    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jw7d2\" (UniqueName: \"kubernetes.io/projected/8a47c9b5-f2d9-4ec7-98f9-77903f9098d5-kube-api-access-jw7d2\") pod \"kuadrant-operator-controller-manager-678d87766f-btzg6\" (UID: \"8a47c9b5-f2d9-4ec7-98f9-77903f9098d5\") " pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-btzg6"
Oct 30 20:44:29.578368 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:44:29.578346    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/8a47c9b5-f2d9-4ec7-98f9-77903f9098d5-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-678d87766f-btzg6\" (UID: \"8a47c9b5-f2d9-4ec7-98f9-77903f9098d5\") " pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-btzg6"
Oct 30 20:44:29.639179 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:44:29.639147    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jw7d2\" (UniqueName: \"kubernetes.io/projected/8a47c9b5-f2d9-4ec7-98f9-77903f9098d5-kube-api-access-jw7d2\") pod \"kuadrant-operator-controller-manager-678d87766f-btzg6\" (UID: \"8a47c9b5-f2d9-4ec7-98f9-77903f9098d5\") " pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-btzg6"
Oct 30 20:44:29.738578 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:44:29.738541    6004 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-btzg6"
Oct 30 20:44:30.160645 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:44:30.160619    6004 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-678d87766f-btzg6"]
Oct 30 20:44:30.163031 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:44:30.163002    6004 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8a47c9b5_f2d9_4ec7_98f9_77903f9098d5.slice/crio-3db2b3a9b28e378ad0bff04c6726fc200e8412daeeca4f80825bb75f7f75da86 WatchSource:0}: Error finding container 3db2b3a9b28e378ad0bff04c6726fc200e8412daeeca4f80825bb75f7f75da86: Status 404 returned error can't find the container with id 3db2b3a9b28e378ad0bff04c6726fc200e8412daeeca4f80825bb75f7f75da86
Oct 30 20:44:31.011934 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:44:31.011899    6004 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-btzg6" event={"ID":"8a47c9b5-f2d9-4ec7-98f9-77903f9098d5","Type":"ContainerStarted","Data":"3db2b3a9b28e378ad0bff04c6726fc200e8412daeeca4f80825bb75f7f75da86"}
Oct 30 20:44:33.209832 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:44:33.209795    6004 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-7b7bb4bc77-bxsjs"]
Oct 30 20:44:33.212278 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:44:33.212260    6004 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-7b7bb4bc77-bxsjs"
Oct 30 20:44:33.308894 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:44:33.308853    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9hqt5\" (UniqueName: \"kubernetes.io/projected/4983e813-fc1f-4f21-8566-85bf64283efb-kube-api-access-9hqt5\") pod \"authorino-operator-7b7bb4bc77-bxsjs\" (UID: \"4983e813-fc1f-4f21-8566-85bf64283efb\") " pod="kuadrant-system/authorino-operator-7b7bb4bc77-bxsjs"
Oct 30 20:44:33.318669 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:44:33.318642    6004 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-429l6\""
Oct 30 20:44:33.320679 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:44:33.320652    6004 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-7b7bb4bc77-bxsjs"]
Oct 30 20:44:33.409984 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:44:33.409950    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9hqt5\" (UniqueName: \"kubernetes.io/projected/4983e813-fc1f-4f21-8566-85bf64283efb-kube-api-access-9hqt5\") pod \"authorino-operator-7b7bb4bc77-bxsjs\" (UID: \"4983e813-fc1f-4f21-8566-85bf64283efb\") " pod="kuadrant-system/authorino-operator-7b7bb4bc77-bxsjs"
Oct 30 20:44:33.468930 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:44:33.468855    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9hqt5\" (UniqueName: \"kubernetes.io/projected/4983e813-fc1f-4f21-8566-85bf64283efb-kube-api-access-9hqt5\") pod \"authorino-operator-7b7bb4bc77-bxsjs\" (UID: \"4983e813-fc1f-4f21-8566-85bf64283efb\") " pod="kuadrant-system/authorino-operator-7b7bb4bc77-bxsjs"
Oct 30 20:44:33.524386 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:44:33.524345    6004 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-7b7bb4bc77-bxsjs"
Oct 30 20:44:33.906917 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:44:33.906836    6004 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-7b7bb4bc77-bxsjs"]
Oct 30 20:44:33.910802 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:44:33.910763    6004 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4983e813_fc1f_4f21_8566_85bf64283efb.slice/crio-6ca9ab48b58a0e5a1529c23b514d66fff631d07836f7d8103bbc43976de2db48 WatchSource:0}: Error finding container 6ca9ab48b58a0e5a1529c23b514d66fff631d07836f7d8103bbc43976de2db48: Status 404 returned error can't find the container with id 6ca9ab48b58a0e5a1529c23b514d66fff631d07836f7d8103bbc43976de2db48
Oct 30 20:44:34.027850 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:44:34.027811    6004 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-7b7bb4bc77-bxsjs" event={"ID":"4983e813-fc1f-4f21-8566-85bf64283efb","Type":"ContainerStarted","Data":"6ca9ab48b58a0e5a1529c23b514d66fff631d07836f7d8103bbc43976de2db48"}
Oct 30 20:44:37.046711 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:44:37.046662    6004 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-btzg6" event={"ID":"8a47c9b5-f2d9-4ec7-98f9-77903f9098d5","Type":"ContainerStarted","Data":"11a20059dcc69cb71ace73ec7f51723ac910a3acf366b87d72a248cf371df633"}
Oct 30 20:44:37.047186 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:44:37.046777    6004 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-btzg6"
Oct 30 20:44:37.048741 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:44:37.048714    6004 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-7b7bb4bc77-bxsjs" event={"ID":"4983e813-fc1f-4f21-8566-85bf64283efb","Type":"ContainerStarted","Data":"f15d1b91231d2396c7d5947558d10829e38e1c46245d4842961b2ffb5f50e37a"}
Oct 30 20:44:37.048869 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:44:37.048855    6004 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-7b7bb4bc77-bxsjs"
Oct 30 20:44:37.270207 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:44:37.270155    6004 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-btzg6" podStartSLOduration=2.304040874 podStartE2EDuration="8.270140809s" totalImagesPullingTime="5.966099935s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:44:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:44:37.218729665 +0000 UTC m=+383.138515783" watchObservedRunningTime="2026-10-30 20:44:37.270140809 +0000 UTC m=+383.189926928"
Oct 30 20:44:37.338657 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:44:37.338569    6004 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-7b7bb4bc77-bxsjs" podStartSLOduration=1.643500833 podStartE2EDuration="4.338556734s" totalImagesPullingTime="2.695055901s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:44:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:44:37.338168797 +0000 UTC m=+383.257954916" watchObservedRunningTime="2026-10-30 20:44:37.338556734 +0000 UTC m=+383.258342852"
Oct 30 20:44:39.004545 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:44:39.004515    6004 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-8557cbdb84-nsfwz"
Oct 30 20:44:44.285730 ip-10-0-138-85 kubenswrapper[6004]: E1030 20:44:44.285693    6004 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-zz4wr" containerName="extractor"
Oct 30 20:44:48.056790 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:44:48.056728    6004 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-7b7bb4bc77-bxsjs"
Oct 30 20:44:48.057210 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:44:48.056900    6004 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-btzg6"
Oct 30 20:44:48.160961 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:44:48.160929    6004 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-649697ffd5cp5d2"]
Oct 30 20:44:48.166922 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:44:48.166899    6004 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-649697ffd5cp5d2"
Oct 30 20:44:48.215249 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:44:48.215211    6004 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-649697ffd5cp5d2"]
Oct 30 20:44:48.225080 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:44:48.225025    6004 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-sdmsw\""
Oct 30 20:44:48.331441 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:44:48.331338    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/36a522ba-4b20-409f-9e05-e74b55595875-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-649697ffd5cp5d2\" (UID: \"36a522ba-4b20-409f-9e05-e74b55595875\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-649697ffd5cp5d2"
Oct 30 20:44:48.331624 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:44:48.331481    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/36a522ba-4b20-409f-9e05-e74b55595875-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-649697ffd5cp5d2\" (UID: \"36a522ba-4b20-409f-9e05-e74b55595875\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-649697ffd5cp5d2"
Oct 30 20:44:48.331624 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:44:48.331551    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/36a522ba-4b20-409f-9e05-e74b55595875-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-649697ffd5cp5d2\" (UID: \"36a522ba-4b20-409f-9e05-e74b55595875\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-649697ffd5cp5d2"
Oct 30 20:44:48.331769 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:44:48.331751    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/36a522ba-4b20-409f-9e05-e74b55595875-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-649697ffd5cp5d2\" (UID: \"36a522ba-4b20-409f-9e05-e74b55595875\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-649697ffd5cp5d2"
Oct 30 20:44:48.331825 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:44:48.331783    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/36a522ba-4b20-409f-9e05-e74b55595875-istio-token\") pod \"data-science-gateway-data-science-gateway-class-649697ffd5cp5d2\" (UID: \"36a522ba-4b20-409f-9e05-e74b55595875\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-649697ffd5cp5d2"
Oct 30 20:44:48.331902 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:44:48.331884    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/36a522ba-4b20-409f-9e05-e74b55595875-istio-data\") pod \"data-science-gateway-data-science-gateway-class-649697ffd5cp5d2\" (UID: \"36a522ba-4b20-409f-9e05-e74b55595875\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-649697ffd5cp5d2"
Oct 30 20:44:48.331985 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:44:48.331961    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/36a522ba-4b20-409f-9e05-e74b55595875-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-649697ffd5cp5d2\" (UID: \"36a522ba-4b20-409f-9e05-e74b55595875\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-649697ffd5cp5d2"
Oct 30 20:44:48.332148 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:44:48.332007    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dgkbc\" (UniqueName: \"kubernetes.io/projected/36a522ba-4b20-409f-9e05-e74b55595875-kube-api-access-dgkbc\") pod \"data-science-gateway-data-science-gateway-class-649697ffd5cp5d2\" (UID: \"36a522ba-4b20-409f-9e05-e74b55595875\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-649697ffd5cp5d2"
Oct 30 20:44:48.332148 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:44:48.332073    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/36a522ba-4b20-409f-9e05-e74b55595875-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-649697ffd5cp5d2\" (UID: \"36a522ba-4b20-409f-9e05-e74b55595875\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-649697ffd5cp5d2"
Oct 30 20:44:48.432965 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:44:48.432924    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/36a522ba-4b20-409f-9e05-e74b55595875-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-649697ffd5cp5d2\" (UID: \"36a522ba-4b20-409f-9e05-e74b55595875\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-649697ffd5cp5d2"
Oct 30 20:44:48.432965 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:44:48.432968    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/36a522ba-4b20-409f-9e05-e74b55595875-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-649697ffd5cp5d2\" (UID: \"36a522ba-4b20-409f-9e05-e74b55595875\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-649697ffd5cp5d2"
Oct 30 20:44:48.433248 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:44:48.433072    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/36a522ba-4b20-409f-9e05-e74b55595875-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-649697ffd5cp5d2\" (UID: \"36a522ba-4b20-409f-9e05-e74b55595875\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-649697ffd5cp5d2"
Oct 30 20:44:48.433248 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:44:48.433129    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/36a522ba-4b20-409f-9e05-e74b55595875-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-649697ffd5cp5d2\" (UID: \"36a522ba-4b20-409f-9e05-e74b55595875\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-649697ffd5cp5d2"
Oct 30 20:44:48.433248 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:44:48.433219    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/36a522ba-4b20-409f-9e05-e74b55595875-istio-token\") pod \"data-science-gateway-data-science-gateway-class-649697ffd5cp5d2\" (UID: \"36a522ba-4b20-409f-9e05-e74b55595875\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-649697ffd5cp5d2"
Oct 30 20:44:48.433414 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:44:48.433294    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/36a522ba-4b20-409f-9e05-e74b55595875-istio-data\") pod \"data-science-gateway-data-science-gateway-class-649697ffd5cp5d2\" (UID: \"36a522ba-4b20-409f-9e05-e74b55595875\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-649697ffd5cp5d2"
Oct 30 20:44:48.433414 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:44:48.433337    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/36a522ba-4b20-409f-9e05-e74b55595875-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-649697ffd5cp5d2\" (UID: \"36a522ba-4b20-409f-9e05-e74b55595875\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-649697ffd5cp5d2"
Oct 30 20:44:48.433414 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:44:48.433377    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dgkbc\" (UniqueName: \"kubernetes.io/projected/36a522ba-4b20-409f-9e05-e74b55595875-kube-api-access-dgkbc\") pod \"data-science-gateway-data-science-gateway-class-649697ffd5cp5d2\" (UID: \"36a522ba-4b20-409f-9e05-e74b55595875\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-649697ffd5cp5d2"
Oct 30 20:44:48.433414 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:44:48.433405    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/36a522ba-4b20-409f-9e05-e74b55595875-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-649697ffd5cp5d2\" (UID: \"36a522ba-4b20-409f-9e05-e74b55595875\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-649697ffd5cp5d2"
Oct 30 20:44:48.433619 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:44:48.433455    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/36a522ba-4b20-409f-9e05-e74b55595875-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-649697ffd5cp5d2\" (UID: \"36a522ba-4b20-409f-9e05-e74b55595875\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-649697ffd5cp5d2"
Oct 30 20:44:48.433619 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:44:48.433599    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/36a522ba-4b20-409f-9e05-e74b55595875-istio-data\") pod \"data-science-gateway-data-science-gateway-class-649697ffd5cp5d2\" (UID: \"36a522ba-4b20-409f-9e05-e74b55595875\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-649697ffd5cp5d2"
Oct 30 20:44:48.433809 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:44:48.433786    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/36a522ba-4b20-409f-9e05-e74b55595875-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-649697ffd5cp5d2\" (UID: \"36a522ba-4b20-409f-9e05-e74b55595875\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-649697ffd5cp5d2"
Oct 30 20:44:48.433874 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:44:48.433827    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/36a522ba-4b20-409f-9e05-e74b55595875-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-649697ffd5cp5d2\" (UID: \"36a522ba-4b20-409f-9e05-e74b55595875\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-649697ffd5cp5d2"
Oct 30 20:44:48.433874 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:44:48.433832    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/36a522ba-4b20-409f-9e05-e74b55595875-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-649697ffd5cp5d2\" (UID: \"36a522ba-4b20-409f-9e05-e74b55595875\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-649697ffd5cp5d2"
Oct 30 20:44:48.435373 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:44:48.435346    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/36a522ba-4b20-409f-9e05-e74b55595875-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-649697ffd5cp5d2\" (UID: \"36a522ba-4b20-409f-9e05-e74b55595875\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-649697ffd5cp5d2"
Oct 30 20:44:48.436320 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:44:48.436300    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/36a522ba-4b20-409f-9e05-e74b55595875-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-649697ffd5cp5d2\" (UID: \"36a522ba-4b20-409f-9e05-e74b55595875\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-649697ffd5cp5d2"
Oct 30 20:44:48.491748 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:44:48.491718    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dgkbc\" (UniqueName: \"kubernetes.io/projected/36a522ba-4b20-409f-9e05-e74b55595875-kube-api-access-dgkbc\") pod \"data-science-gateway-data-science-gateway-class-649697ffd5cp5d2\" (UID: \"36a522ba-4b20-409f-9e05-e74b55595875\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-649697ffd5cp5d2"
Oct 30 20:44:48.491906 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:44:48.491885    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/36a522ba-4b20-409f-9e05-e74b55595875-istio-token\") pod \"data-science-gateway-data-science-gateway-class-649697ffd5cp5d2\" (UID: \"36a522ba-4b20-409f-9e05-e74b55595875\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-649697ffd5cp5d2"
Oct 30 20:44:48.781468 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:44:48.781420    6004 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-649697ffd5cp5d2"
Oct 30 20:44:49.221025 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:44:49.220995    6004 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-649697ffd5cp5d2"]
Oct 30 20:44:49.222511 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:44:49.222482    6004 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod36a522ba_4b20_409f_9e05_e74b55595875.slice/crio-757347589e6bd7d0a1df6f8d2ec708ef1efd9b2aadab549c5eb139fdddd57d76 WatchSource:0}: Error finding container 757347589e6bd7d0a1df6f8d2ec708ef1efd9b2aadab549c5eb139fdddd57d76: Status 404 returned error can't find the container with id 757347589e6bd7d0a1df6f8d2ec708ef1efd9b2aadab549c5eb139fdddd57d76
Oct 30 20:44:49.224695 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:44:49.224661    6004 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 20:44:49.224795 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:44:49.224737    6004 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 20:44:49.224795 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:44:49.224785    6004 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 20:44:50.113025 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:44:50.112987    6004 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-649697ffd5cp5d2" event={"ID":"36a522ba-4b20-409f-9e05-e74b55595875","Type":"ContainerStarted","Data":"7aef6f3f07ea6198bca2dbc3fe3d11c0b2d8a158407ab4adaa728187fad39fbd"}
Oct 30 20:44:50.113215 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:44:50.113043    6004 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-649697ffd5cp5d2" event={"ID":"36a522ba-4b20-409f-9e05-e74b55595875","Type":"ContainerStarted","Data":"757347589e6bd7d0a1df6f8d2ec708ef1efd9b2aadab549c5eb139fdddd57d76"}
Oct 30 20:44:50.138001 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:44:50.137968    6004 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-74dfcfb894-jsrqj"]
Oct 30 20:44:50.188573 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:44:50.188548    6004 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-74dfcfb894-jsrqj"
Oct 30 20:44:50.220350 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:44:50.220324    6004 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-74dfcfb894-jsrqj"]
Oct 30 20:44:50.241172 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:44:50.241147    6004 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Oct 30 20:44:50.241524 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:44:50.241251    6004 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-pfc5q\""
Oct 30 20:44:50.293090 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:44:50.290465    6004 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-649697ffd5cp5d2" podStartSLOduration=2.290437893 podStartE2EDuration="2.290437893s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:44:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:44:50.253172413 +0000 UTC m=+396.172958533" watchObservedRunningTime="2026-10-30 20:44:50.290437893 +0000 UTC m=+396.210224012"
Oct 30 20:44:50.350027 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:44:50.349988    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4t5j4\" (UniqueName: \"kubernetes.io/projected/25b7887e-e74a-4bee-bef7-b7a5b22c7f78-kube-api-access-4t5j4\") pod \"limitador-limitador-74dfcfb894-jsrqj\" (UID: \"25b7887e-e74a-4bee-bef7-b7a5b22c7f78\") " pod="kuadrant-system/limitador-limitador-74dfcfb894-jsrqj"
Oct 30 20:44:50.350213 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:44:50.350161    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/25b7887e-e74a-4bee-bef7-b7a5b22c7f78-config-file\") pod \"limitador-limitador-74dfcfb894-jsrqj\" (UID: \"25b7887e-e74a-4bee-bef7-b7a5b22c7f78\") " pod="kuadrant-system/limitador-limitador-74dfcfb894-jsrqj"
Oct 30 20:44:50.407864 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:44:50.407790    6004 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-74dfcfb894-jsrqj"]
Oct 30 20:44:50.451737 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:44:50.451708    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4t5j4\" (UniqueName: \"kubernetes.io/projected/25b7887e-e74a-4bee-bef7-b7a5b22c7f78-kube-api-access-4t5j4\") pod \"limitador-limitador-74dfcfb894-jsrqj\" (UID: \"25b7887e-e74a-4bee-bef7-b7a5b22c7f78\") " pod="kuadrant-system/limitador-limitador-74dfcfb894-jsrqj"
Oct 30 20:44:50.451901 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:44:50.451757    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/25b7887e-e74a-4bee-bef7-b7a5b22c7f78-config-file\") pod \"limitador-limitador-74dfcfb894-jsrqj\" (UID: \"25b7887e-e74a-4bee-bef7-b7a5b22c7f78\") " pod="kuadrant-system/limitador-limitador-74dfcfb894-jsrqj"
Oct 30 20:44:50.452399 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:44:50.452380    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/25b7887e-e74a-4bee-bef7-b7a5b22c7f78-config-file\") pod \"limitador-limitador-74dfcfb894-jsrqj\" (UID: \"25b7887e-e74a-4bee-bef7-b7a5b22c7f78\") " pod="kuadrant-system/limitador-limitador-74dfcfb894-jsrqj"
Oct 30 20:44:50.509451 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:44:50.509417    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4t5j4\" (UniqueName: \"kubernetes.io/projected/25b7887e-e74a-4bee-bef7-b7a5b22c7f78-kube-api-access-4t5j4\") pod \"limitador-limitador-74dfcfb894-jsrqj\" (UID: \"25b7887e-e74a-4bee-bef7-b7a5b22c7f78\") " pod="kuadrant-system/limitador-limitador-74dfcfb894-jsrqj"
Oct 30 20:44:50.512917 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:44:50.512886    6004 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-74dfcfb894-jsrqj"
Oct 30 20:44:50.781646 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:44:50.781614    6004 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-649697ffd5cp5d2"
Oct 30 20:44:50.786609 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:44:50.786585    6004 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-649697ffd5cp5d2"
Oct 30 20:44:50.905911 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:44:50.905883    6004 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-74dfcfb894-jsrqj"]
Oct 30 20:44:50.911891 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:44:50.911377    6004 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod25b7887e_e74a_4bee_bef7_b7a5b22c7f78.slice/crio-fb350d0097b10280d8d0ed1c3469e5c442fdb698b87c27f372f834d403a5f8c0 WatchSource:0}: Error finding container fb350d0097b10280d8d0ed1c3469e5c442fdb698b87c27f372f834d403a5f8c0: Status 404 returned error can't find the container with id fb350d0097b10280d8d0ed1c3469e5c442fdb698b87c27f372f834d403a5f8c0
Oct 30 20:44:51.119306 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:44:51.119222    6004 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-74dfcfb894-jsrqj" event={"ID":"25b7887e-e74a-4bee-bef7-b7a5b22c7f78","Type":"ContainerStarted","Data":"fb350d0097b10280d8d0ed1c3469e5c442fdb698b87c27f372f834d403a5f8c0"}
Oct 30 20:44:51.119615 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:44:51.119589    6004 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-649697ffd5cp5d2"
Oct 30 20:44:51.120506 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:44:51.120491    6004 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-649697ffd5cp5d2"
Oct 30 20:44:54.136016 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:44:54.135980    6004 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-74dfcfb894-jsrqj" event={"ID":"25b7887e-e74a-4bee-bef7-b7a5b22c7f78","Type":"ContainerStarted","Data":"1569af3401932e04d1167daaffa8ee06ca6255901c3f61ceb5b066bcf43823f3"}
Oct 30 20:44:54.136396 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:44:54.136084    6004 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-74dfcfb894-jsrqj"
Oct 30 20:44:54.251337 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:44:54.251286    6004 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-74dfcfb894-jsrqj" podStartSLOduration=2.063257918 podStartE2EDuration="4.251269903s" totalImagesPullingTime="2.188011985s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:44:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:44:54.251031323 +0000 UTC m=+400.170817440" watchObservedRunningTime="2026-10-30 20:44:54.251269903 +0000 UTC m=+400.171056022"
Oct 30 20:44:54.517718 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:44:54.517684    6004 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-56c6c9ddd5-2jlvt"]
Oct 30 20:44:54.520137 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:44:54.520121    6004 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-56c6c9ddd5-2jlvt"
Oct 30 20:44:54.577755 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:44:54.577728    6004 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-qrtn9\""
Oct 30 20:44:54.596590 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:44:54.596561    6004 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-56c6c9ddd5-2jlvt"]
Oct 30 20:44:54.689429 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:44:54.689390    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8r626\" (UniqueName: \"kubernetes.io/projected/0d04798d-9f63-4d40-92e9-fd44015ce0ea-kube-api-access-8r626\") pod \"authorino-56c6c9ddd5-2jlvt\" (UID: \"0d04798d-9f63-4d40-92e9-fd44015ce0ea\") " pod="kuadrant-system/authorino-56c6c9ddd5-2jlvt"
Oct 30 20:44:54.790674 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:44:54.790600    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8r626\" (UniqueName: \"kubernetes.io/projected/0d04798d-9f63-4d40-92e9-fd44015ce0ea-kube-api-access-8r626\") pod \"authorino-56c6c9ddd5-2jlvt\" (UID: \"0d04798d-9f63-4d40-92e9-fd44015ce0ea\") " pod="kuadrant-system/authorino-56c6c9ddd5-2jlvt"
Oct 30 20:44:54.853931 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:44:54.853898    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8r626\" (UniqueName: \"kubernetes.io/projected/0d04798d-9f63-4d40-92e9-fd44015ce0ea-kube-api-access-8r626\") pod \"authorino-56c6c9ddd5-2jlvt\" (UID: \"0d04798d-9f63-4d40-92e9-fd44015ce0ea\") " pod="kuadrant-system/authorino-56c6c9ddd5-2jlvt"
Oct 30 20:44:55.131187 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:44:55.131113    6004 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-56c6c9ddd5-2jlvt"
Oct 30 20:44:55.498335 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:44:55.498311    6004 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-56c6c9ddd5-2jlvt"]
Oct 30 20:44:55.500364 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:44:55.500336    6004 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0d04798d_9f63_4d40_92e9_fd44015ce0ea.slice/crio-698becdd94cf1e0f3dd254c48f41d09e05a8868a9c91b84358958a0ca304f038 WatchSource:0}: Error finding container 698becdd94cf1e0f3dd254c48f41d09e05a8868a9c91b84358958a0ca304f038: Status 404 returned error can't find the container with id 698becdd94cf1e0f3dd254c48f41d09e05a8868a9c91b84358958a0ca304f038
Oct 30 20:44:56.148776 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:44:56.148739    6004 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-56c6c9ddd5-2jlvt" event={"ID":"0d04798d-9f63-4d40-92e9-fd44015ce0ea","Type":"ContainerStarted","Data":"698becdd94cf1e0f3dd254c48f41d09e05a8868a9c91b84358958a0ca304f038"}
Oct 30 20:44:59.164945 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:44:59.164910    6004 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-56c6c9ddd5-2jlvt" event={"ID":"0d04798d-9f63-4d40-92e9-fd44015ce0ea","Type":"ContainerStarted","Data":"de09c21726c394a9a361b04ef9f7451850905c035b92ba50eb9c9de24ebffebd"}
Oct 30 20:44:59.313373 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:44:59.313321    6004 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kuadrant-system/authorino-56c6c9ddd5-2jlvt" podStartSLOduration=2.618871401 podStartE2EDuration="5.313306398s" totalImagesPullingTime="2.694434997s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:44:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:44:59.311794044 +0000 UTC m=+405.231580162" watchObservedRunningTime="2026-10-30 20:44:59.313306398 +0000 UTC m=+405.233092515"
Oct 30 20:45:00.365546 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:45:00.365512    6004 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-module-controller-manager-7566cf5fc8-4jjs7"]
Oct 30 20:45:00.369033 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:45:00.369018    6004 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-module-controller-manager-7566cf5fc8-4jjs7"
Oct 30 20:45:00.473774 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:45:00.473715    6004 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Oct 30 20:45:00.473774 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:45:00.473720    6004 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-module-controller-manager-dockercfg-vz8wc\""
Oct 30 20:45:00.473774 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:45:00.473728    6004 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Oct 30 20:45:00.538943 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:45:00.538910    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/53e10898-ebc3-41bf-9335-6e2af9bfab30-trusted-ca\") pod \"kserve-module-controller-manager-7566cf5fc8-4jjs7\" (UID: \"53e10898-ebc3-41bf-9335-6e2af9bfab30\") " pod="opendatahub/kserve-module-controller-manager-7566cf5fc8-4jjs7"
Oct 30 20:45:00.539119 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:45:00.538950    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jdqt9\" (UniqueName: \"kubernetes.io/projected/53e10898-ebc3-41bf-9335-6e2af9bfab30-kube-api-access-jdqt9\") pod \"kserve-module-controller-manager-7566cf5fc8-4jjs7\" (UID: \"53e10898-ebc3-41bf-9335-6e2af9bfab30\") " pod="opendatahub/kserve-module-controller-manager-7566cf5fc8-4jjs7"
Oct 30 20:45:00.539119 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:45:00.539078    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/53e10898-ebc3-41bf-9335-6e2af9bfab30-manifests\") pod \"kserve-module-controller-manager-7566cf5fc8-4jjs7\" (UID: \"53e10898-ebc3-41bf-9335-6e2af9bfab30\") " pod="opendatahub/kserve-module-controller-manager-7566cf5fc8-4jjs7"
Oct 30 20:45:00.539119 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:45:00.539103    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/53e10898-ebc3-41bf-9335-6e2af9bfab30-tmp\") pod \"kserve-module-controller-manager-7566cf5fc8-4jjs7\" (UID: \"53e10898-ebc3-41bf-9335-6e2af9bfab30\") " pod="opendatahub/kserve-module-controller-manager-7566cf5fc8-4jjs7"
Oct 30 20:45:00.575363 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:45:00.575312    6004 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"odh-trusted-ca-bundle\""
Oct 30 20:45:00.577044 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:45:00.577024    6004 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-module-controller-manager-7566cf5fc8-4jjs7"]
Oct 30 20:45:00.639680 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:45:00.639617    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/53e10898-ebc3-41bf-9335-6e2af9bfab30-manifests\") pod \"kserve-module-controller-manager-7566cf5fc8-4jjs7\" (UID: \"53e10898-ebc3-41bf-9335-6e2af9bfab30\") " pod="opendatahub/kserve-module-controller-manager-7566cf5fc8-4jjs7"
Oct 30 20:45:00.639680 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:45:00.639651    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/53e10898-ebc3-41bf-9335-6e2af9bfab30-tmp\") pod \"kserve-module-controller-manager-7566cf5fc8-4jjs7\" (UID: \"53e10898-ebc3-41bf-9335-6e2af9bfab30\") " pod="opendatahub/kserve-module-controller-manager-7566cf5fc8-4jjs7"
Oct 30 20:45:00.639819 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:45:00.639718    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/53e10898-ebc3-41bf-9335-6e2af9bfab30-trusted-ca\") pod \"kserve-module-controller-manager-7566cf5fc8-4jjs7\" (UID: \"53e10898-ebc3-41bf-9335-6e2af9bfab30\") " pod="opendatahub/kserve-module-controller-manager-7566cf5fc8-4jjs7"
Oct 30 20:45:00.639819 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:45:00.639746    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jdqt9\" (UniqueName: \"kubernetes.io/projected/53e10898-ebc3-41bf-9335-6e2af9bfab30-kube-api-access-jdqt9\") pod \"kserve-module-controller-manager-7566cf5fc8-4jjs7\" (UID: \"53e10898-ebc3-41bf-9335-6e2af9bfab30\") " pod="opendatahub/kserve-module-controller-manager-7566cf5fc8-4jjs7"
Oct 30 20:45:00.640113 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:45:00.640091    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/53e10898-ebc3-41bf-9335-6e2af9bfab30-manifests\") pod \"kserve-module-controller-manager-7566cf5fc8-4jjs7\" (UID: \"53e10898-ebc3-41bf-9335-6e2af9bfab30\") " pod="opendatahub/kserve-module-controller-manager-7566cf5fc8-4jjs7"
Oct 30 20:45:00.640153 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:45:00.640130    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/53e10898-ebc3-41bf-9335-6e2af9bfab30-tmp\") pod \"kserve-module-controller-manager-7566cf5fc8-4jjs7\" (UID: \"53e10898-ebc3-41bf-9335-6e2af9bfab30\") " pod="opendatahub/kserve-module-controller-manager-7566cf5fc8-4jjs7"
Oct 30 20:45:00.640555 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:45:00.640537    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/53e10898-ebc3-41bf-9335-6e2af9bfab30-trusted-ca\") pod \"kserve-module-controller-manager-7566cf5fc8-4jjs7\" (UID: \"53e10898-ebc3-41bf-9335-6e2af9bfab30\") " pod="opendatahub/kserve-module-controller-manager-7566cf5fc8-4jjs7"
Oct 30 20:45:00.698252 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:45:00.698225    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jdqt9\" (UniqueName: \"kubernetes.io/projected/53e10898-ebc3-41bf-9335-6e2af9bfab30-kube-api-access-jdqt9\") pod \"kserve-module-controller-manager-7566cf5fc8-4jjs7\" (UID: \"53e10898-ebc3-41bf-9335-6e2af9bfab30\") " pod="opendatahub/kserve-module-controller-manager-7566cf5fc8-4jjs7"
Oct 30 20:45:00.981785 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:45:00.981752    6004 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-module-controller-manager-7566cf5fc8-4jjs7"
Oct 30 20:45:01.402622 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:45:01.402599    6004 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-module-controller-manager-7566cf5fc8-4jjs7"]
Oct 30 20:45:01.404430 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:45:01.404395    6004 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod53e10898_ebc3_41bf_9335_6e2af9bfab30.slice/crio-742184c33cbb1ec56b227158c28e4a993d5b3cd3607db619d2f5cdc560fc7459 WatchSource:0}: Error finding container 742184c33cbb1ec56b227158c28e4a993d5b3cd3607db619d2f5cdc560fc7459: Status 404 returned error can't find the container with id 742184c33cbb1ec56b227158c28e4a993d5b3cd3607db619d2f5cdc560fc7459
Oct 30 20:45:02.181201 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:45:02.181161    6004 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-module-controller-manager-7566cf5fc8-4jjs7" event={"ID":"53e10898-ebc3-41bf-9335-6e2af9bfab30","Type":"ContainerStarted","Data":"742184c33cbb1ec56b227158c28e4a993d5b3cd3607db619d2f5cdc560fc7459"}
Oct 30 20:45:05.143828 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:45:05.143797    6004 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-74dfcfb894-jsrqj"
Oct 30 20:45:05.199438 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:45:05.199402    6004 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-module-controller-manager-7566cf5fc8-4jjs7" event={"ID":"53e10898-ebc3-41bf-9335-6e2af9bfab30","Type":"ContainerStarted","Data":"a6a5b6ed8c46781e157a4b9d00fabad0b1b1c6a0f60063f18fc5626b29bc8b5b"}
Oct 30 20:45:05.199627 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:45:05.199541    6004 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-module-controller-manager-7566cf5fc8-4jjs7"
Oct 30 20:45:05.374709 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:45:05.374656    6004 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="opendatahub/kserve-module-controller-manager-7566cf5fc8-4jjs7" podStartSLOduration=2.259854265 podStartE2EDuration="5.374643452s" totalImagesPullingTime="3.114789187s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:45:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:45:05.373753075 +0000 UTC m=+411.293539192" watchObservedRunningTime="2026-10-30 20:45:05.374643452 +0000 UTC m=+411.294429569"
Oct 30 20:45:09.258976 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:45:09.258941    6004 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-74dfcfb894-jsrqj"]
Oct 30 20:45:09.259392 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:45:09.259176    6004 kuberuntime_container.go:898] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-74dfcfb894-jsrqj" podUID="25b7887e-e74a-4bee-bef7-b7a5b22c7f78" containerName="limitador" containerID="cri-o://1569af3401932e04d1167daaffa8ee06ca6255901c3f61ceb5b066bcf43823f3" gracePeriod=30
Oct 30 20:45:09.803107 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:45:09.803081    6004 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-74dfcfb894-jsrqj"
Oct 30 20:45:09.817288 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:45:09.817258    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/25b7887e-e74a-4bee-bef7-b7a5b22c7f78-config-file\" (UniqueName: \"kubernetes.io/configmap/25b7887e-e74a-4bee-bef7-b7a5b22c7f78-config-file\") pod \"25b7887e-e74a-4bee-bef7-b7a5b22c7f78\" (UID: \"25b7887e-e74a-4bee-bef7-b7a5b22c7f78\") "
Oct 30 20:45:09.817431 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:45:09.817317    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/25b7887e-e74a-4bee-bef7-b7a5b22c7f78-kube-api-access-4t5j4\" (UniqueName: \"kubernetes.io/projected/25b7887e-e74a-4bee-bef7-b7a5b22c7f78-kube-api-access-4t5j4\") pod \"25b7887e-e74a-4bee-bef7-b7a5b22c7f78\" (UID: \"25b7887e-e74a-4bee-bef7-b7a5b22c7f78\") "
Oct 30 20:45:09.817660 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:45:09.817634    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/25b7887e-e74a-4bee-bef7-b7a5b22c7f78-config-file" pod "25b7887e-e74a-4bee-bef7-b7a5b22c7f78" (UID: "25b7887e-e74a-4bee-bef7-b7a5b22c7f78"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 20:45:09.819480 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:45:09.819432    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/25b7887e-e74a-4bee-bef7-b7a5b22c7f78-kube-api-access-4t5j4" pod "25b7887e-e74a-4bee-bef7-b7a5b22c7f78" (UID: "25b7887e-e74a-4bee-bef7-b7a5b22c7f78"). InnerVolumeSpecName "kube-api-access-4t5j4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:45:09.918006 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:45:09.917969    6004 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/25b7887e-e74a-4bee-bef7-b7a5b22c7f78-config-file\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:45:09.918006 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:45:09.918004    6004 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4t5j4\" (UniqueName: \"kubernetes.io/projected/25b7887e-e74a-4bee-bef7-b7a5b22c7f78-kube-api-access-4t5j4\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:45:10.225524 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:45:10.225491    6004 generic.go:356] "Generic (PLEG): container finished" podID="25b7887e-e74a-4bee-bef7-b7a5b22c7f78" containerID="1569af3401932e04d1167daaffa8ee06ca6255901c3f61ceb5b066bcf43823f3" exitCode=0
Oct 30 20:45:10.225688 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:45:10.225588    6004 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-74dfcfb894-jsrqj"
Oct 30 20:45:10.230451 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:45:10.230423    6004 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-74dfcfb894-jsrqj" event={"ID":"25b7887e-e74a-4bee-bef7-b7a5b22c7f78","Type":"ContainerDied","Data":"1569af3401932e04d1167daaffa8ee06ca6255901c3f61ceb5b066bcf43823f3"}
Oct 30 20:45:10.230584 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:45:10.230467    6004 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-74dfcfb894-jsrqj" event={"ID":"25b7887e-e74a-4bee-bef7-b7a5b22c7f78","Type":"ContainerDied","Data":"fb350d0097b10280d8d0ed1c3469e5c442fdb698b87c27f372f834d403a5f8c0"}
Oct 30 20:45:10.230584 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:45:10.230489    6004 scope.go:122] "RemoveContainer" containerID="1569af3401932e04d1167daaffa8ee06ca6255901c3f61ceb5b066bcf43823f3"
Oct 30 20:45:10.240658 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:45:10.240637    6004 scope.go:122] "RemoveContainer" containerID="1569af3401932e04d1167daaffa8ee06ca6255901c3f61ceb5b066bcf43823f3"
Oct 30 20:45:10.240914 ip-10-0-138-85 kubenswrapper[6004]: E1030 20:45:10.240890    6004 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1569af3401932e04d1167daaffa8ee06ca6255901c3f61ceb5b066bcf43823f3\": container with ID starting with 1569af3401932e04d1167daaffa8ee06ca6255901c3f61ceb5b066bcf43823f3 not found: ID does not exist" containerID="1569af3401932e04d1167daaffa8ee06ca6255901c3f61ceb5b066bcf43823f3"
Oct 30 20:45:10.240957 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:45:10.240922    6004 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1569af3401932e04d1167daaffa8ee06ca6255901c3f61ceb5b066bcf43823f3"} err="failed to get container status \"1569af3401932e04d1167daaffa8ee06ca6255901c3f61ceb5b066bcf43823f3\": rpc error: code = NotFound desc = could not find container \"1569af3401932e04d1167daaffa8ee06ca6255901c3f61ceb5b066bcf43823f3\": container with ID starting with 1569af3401932e04d1167daaffa8ee06ca6255901c3f61ceb5b066bcf43823f3 not found: ID does not exist"
Oct 30 20:45:10.390113 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:45:10.390081    6004 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-74dfcfb894-jsrqj"]
Oct 30 20:45:10.440572 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:45:10.440541    6004 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-74dfcfb894-jsrqj"]
Oct 30 20:45:12.229907 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:45:12.229872    6004 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="25b7887e-e74a-4bee-bef7-b7a5b22c7f78" path="/var/lib/kubelet/pods/25b7887e-e74a-4bee-bef7-b7a5b22c7f78/volumes"
Oct 30 20:45:14.287671 ip-10-0-138-85 kubenswrapper[6004]: E1030 20:45:14.285083    6004 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-zz4wr" containerName="extractor"
Oct 30 20:45:18.857501 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:45:18.854516    6004 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/postgres-7cdbf6dc44-m2jtb"]
Oct 30 20:45:18.857501 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:45:18.855329    6004 cpu_manager.go:414] "containerMap: removing container" podUID="25b7887e-e74a-4bee-bef7-b7a5b22c7f78" containerName="limitador"
Oct 30 20:45:18.857501 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:45:18.855351    6004 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="25b7887e-e74a-4bee-bef7-b7a5b22c7f78" containerName="limitador"
Oct 30 20:45:18.857501 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:45:18.855596    6004 memory_manager.go:365] "RemoveStaleState removing state" podUID="25b7887e-e74a-4bee-bef7-b7a5b22c7f78" containerName="limitador"
Oct 30 20:45:18.859344 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:45:18.859316    6004 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-7cdbf6dc44-m2jtb"
Oct 30 20:45:18.899370 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:45:18.899336    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xkdzd\" (UniqueName: \"kubernetes.io/projected/e5dec31c-f2e1-4d0e-9a92-9d137c715764-kube-api-access-xkdzd\") pod \"postgres-7cdbf6dc44-m2jtb\" (UID: \"e5dec31c-f2e1-4d0e-9a92-9d137c715764\") " pod="odh-ai-gateway-infra/postgres-7cdbf6dc44-m2jtb"
Oct 30 20:45:18.899511 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:45:18.899452    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/e5dec31c-f2e1-4d0e-9a92-9d137c715764-data\") pod \"postgres-7cdbf6dc44-m2jtb\" (UID: \"e5dec31c-f2e1-4d0e-9a92-9d137c715764\") " pod="odh-ai-gateway-infra/postgres-7cdbf6dc44-m2jtb"
Oct 30 20:45:18.911982 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:45:18.911953    6004 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-7cdbf6dc44-m2jtb"]
Oct 30 20:45:18.960740 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:45:18.960712    6004 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Oct 30 20:45:18.960878 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:45:18.960745    6004 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Oct 30 20:45:19.000686 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:45:19.000650    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/e5dec31c-f2e1-4d0e-9a92-9d137c715764-data\") pod \"postgres-7cdbf6dc44-m2jtb\" (UID: \"e5dec31c-f2e1-4d0e-9a92-9d137c715764\") " pod="odh-ai-gateway-infra/postgres-7cdbf6dc44-m2jtb"
Oct 30 20:45:19.000836 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:45:19.000727    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xkdzd\" (UniqueName: \"kubernetes.io/projected/e5dec31c-f2e1-4d0e-9a92-9d137c715764-kube-api-access-xkdzd\") pod \"postgres-7cdbf6dc44-m2jtb\" (UID: \"e5dec31c-f2e1-4d0e-9a92-9d137c715764\") " pod="odh-ai-gateway-infra/postgres-7cdbf6dc44-m2jtb"
Oct 30 20:45:19.001022 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:45:19.001004    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/e5dec31c-f2e1-4d0e-9a92-9d137c715764-data\") pod \"postgres-7cdbf6dc44-m2jtb\" (UID: \"e5dec31c-f2e1-4d0e-9a92-9d137c715764\") " pod="odh-ai-gateway-infra/postgres-7cdbf6dc44-m2jtb"
Oct 30 20:45:19.004717 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:45:19.004695    6004 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\""
Oct 30 20:45:19.011124 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:45:19.011106    6004 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"default-dockercfg-9n9mf\""
Oct 30 20:45:19.059270 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:45:19.059240    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xkdzd\" (UniqueName: \"kubernetes.io/projected/e5dec31c-f2e1-4d0e-9a92-9d137c715764-kube-api-access-xkdzd\") pod \"postgres-7cdbf6dc44-m2jtb\" (UID: \"e5dec31c-f2e1-4d0e-9a92-9d137c715764\") " pod="odh-ai-gateway-infra/postgres-7cdbf6dc44-m2jtb"
Oct 30 20:45:19.171660 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:45:19.171572    6004 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-7cdbf6dc44-m2jtb"
Oct 30 20:45:19.539912 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:45:19.539887    6004 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-7cdbf6dc44-m2jtb"]
Oct 30 20:45:19.541626 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:45:19.541593    6004 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode5dec31c_f2e1_4d0e_9a92_9d137c715764.slice/crio-39a84b02413f8a32f461d028e364ff6cbf5db1f7b16897cc4ab6da54ce3f737a WatchSource:0}: Error finding container 39a84b02413f8a32f461d028e364ff6cbf5db1f7b16897cc4ab6da54ce3f737a: Status 404 returned error can't find the container with id 39a84b02413f8a32f461d028e364ff6cbf5db1f7b16897cc4ab6da54ce3f737a
Oct 30 20:45:20.273430 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:45:20.273389    6004 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-7cdbf6dc44-m2jtb" event={"ID":"e5dec31c-f2e1-4d0e-9a92-9d137c715764","Type":"ContainerStarted","Data":"39a84b02413f8a32f461d028e364ff6cbf5db1f7b16897cc4ab6da54ce3f737a"}
Oct 30 20:45:26.205529 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:45:26.205496    6004 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-module-controller-manager-7566cf5fc8-4jjs7"
Oct 30 20:45:27.313819 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:45:27.313778    6004 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-7cdbf6dc44-m2jtb" event={"ID":"e5dec31c-f2e1-4d0e-9a92-9d137c715764","Type":"ContainerStarted","Data":"ae0a6e7ba454889c6749baf894ba710423dc4407e30ee6e7fa87bb02b144d270"}
Oct 30 20:45:27.314331 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:45:27.313899    6004 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/postgres-7cdbf6dc44-m2jtb"
Oct 30 20:45:27.432012 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:45:27.431954    6004 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/postgres-7cdbf6dc44-m2jtb" podStartSLOduration=2.544261661 podStartE2EDuration="9.43193927s" totalImagesPullingTime="6.887677609s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:45:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:45:27.43053149 +0000 UTC m=+433.350317610" watchObservedRunningTime="2026-10-30 20:45:27.43193927 +0000 UTC m=+433.351725412"
Oct 30 20:45:33.349040 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:45:33.349006    6004 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/postgres-7cdbf6dc44-m2jtb"
Oct 30 20:45:44.285797 ip-10-0-138-85 kubenswrapper[6004]: E1030 20:45:44.285756    6004 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-zz4wr" containerName="extractor"
Oct 30 20:45:48.272651 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:45:48.272611    6004 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-25knx"]
Oct 30 20:45:48.279890 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:45:48.279864    6004 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-25knx"
Oct 30 20:45:48.333276 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:45:48.333245    6004 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-25knx"]
Oct 30 20:45:48.366831 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:45:48.366790    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-source\" (UniqueName: \"kubernetes.io/configmap/0544d6f1-ae3f-4a61-ac1c-3876cbff174f-proxy-source\") pod \"usage-logs-tenancy-proxy-9c5d49bcd-25knx\" (UID: \"0544d6f1-ae3f-4a61-ac1c-3876cbff174f\") " pod="opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-25knx"
Oct 30 20:45:48.366831 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:45:48.366836    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4wxsz\" (UniqueName: \"kubernetes.io/projected/0544d6f1-ae3f-4a61-ac1c-3876cbff174f-kube-api-access-4wxsz\") pod \"usage-logs-tenancy-proxy-9c5d49bcd-25knx\" (UID: \"0544d6f1-ae3f-4a61-ac1c-3876cbff174f\") " pod="opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-25knx"
Oct 30 20:45:48.367110 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:45:48.366972    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/0544d6f1-ae3f-4a61-ac1c-3876cbff174f-tls-cert\") pod \"usage-logs-tenancy-proxy-9c5d49bcd-25knx\" (UID: \"0544d6f1-ae3f-4a61-ac1c-3876cbff174f\") " pod="opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-25knx"
Oct 30 20:45:48.367191 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:45:48.367123    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0544d6f1-ae3f-4a61-ac1c-3876cbff174f-service-ca\") pod \"usage-logs-tenancy-proxy-9c5d49bcd-25knx\" (UID: \"0544d6f1-ae3f-4a61-ac1c-3876cbff174f\") " pod="opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-25knx"
Oct 30 20:45:48.381103 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:45:48.381045    6004 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"usage-logs-tenancy-proxy-tls\""
Oct 30 20:45:48.381297 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:45:48.381078    6004 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"usage-tenancy-proxy-source\""
Oct 30 20:45:48.381427 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:45:48.381155    6004 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"usage-tenancy-proxy-dockercfg-jwtsx\""
Oct 30 20:45:48.381503 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:45:48.381163    6004 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"usage-logs-tenancy-proxy-ca-bundle\""
Oct 30 20:45:48.467631 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:45:48.467594    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-source\" (UniqueName: \"kubernetes.io/configmap/0544d6f1-ae3f-4a61-ac1c-3876cbff174f-proxy-source\") pod \"usage-logs-tenancy-proxy-9c5d49bcd-25knx\" (UID: \"0544d6f1-ae3f-4a61-ac1c-3876cbff174f\") " pod="opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-25knx"
Oct 30 20:45:48.467631 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:45:48.467629    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4wxsz\" (UniqueName: \"kubernetes.io/projected/0544d6f1-ae3f-4a61-ac1c-3876cbff174f-kube-api-access-4wxsz\") pod \"usage-logs-tenancy-proxy-9c5d49bcd-25knx\" (UID: \"0544d6f1-ae3f-4a61-ac1c-3876cbff174f\") " pod="opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-25knx"
Oct 30 20:45:48.467843 ip-10-0-138-85 kubenswrapper[6004]: E1030 20:45:48.467710    6004 configmap.go:193] Couldn't get configMap opendatahub/usage-tenancy-proxy-source: configmap "usage-tenancy-proxy-source" not found
Oct 30 20:45:48.467843 ip-10-0-138-85 kubenswrapper[6004]: E1030 20:45:48.467786    6004 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/0544d6f1-ae3f-4a61-ac1c-3876cbff174f-proxy-source podName:0544d6f1-ae3f-4a61-ac1c-3876cbff174f nodeName:}" failed. No retries permitted until 2026-10-30 20:45:48.967768072 +0000 UTC m=+454.887554181 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "proxy-source" (UniqueName: "kubernetes.io/configmap/0544d6f1-ae3f-4a61-ac1c-3876cbff174f-proxy-source") pod "usage-logs-tenancy-proxy-9c5d49bcd-25knx" (UID: "0544d6f1-ae3f-4a61-ac1c-3876cbff174f") : configmap "usage-tenancy-proxy-source" not found
Oct 30 20:45:48.467843 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:45:48.467806    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/0544d6f1-ae3f-4a61-ac1c-3876cbff174f-tls-cert\") pod \"usage-logs-tenancy-proxy-9c5d49bcd-25knx\" (UID: \"0544d6f1-ae3f-4a61-ac1c-3876cbff174f\") " pod="opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-25knx"
Oct 30 20:45:48.468013 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:45:48.467852    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0544d6f1-ae3f-4a61-ac1c-3876cbff174f-service-ca\") pod \"usage-logs-tenancy-proxy-9c5d49bcd-25knx\" (UID: \"0544d6f1-ae3f-4a61-ac1c-3876cbff174f\") " pod="opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-25knx"
Oct 30 20:45:48.468519 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:45:48.468501    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0544d6f1-ae3f-4a61-ac1c-3876cbff174f-service-ca\") pod \"usage-logs-tenancy-proxy-9c5d49bcd-25knx\" (UID: \"0544d6f1-ae3f-4a61-ac1c-3876cbff174f\") " pod="opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-25knx"
Oct 30 20:45:48.470279 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:45:48.470258    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/0544d6f1-ae3f-4a61-ac1c-3876cbff174f-tls-cert\") pod \"usage-logs-tenancy-proxy-9c5d49bcd-25knx\" (UID: \"0544d6f1-ae3f-4a61-ac1c-3876cbff174f\") " pod="opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-25knx"
Oct 30 20:45:48.525892 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:45:48.525819    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4wxsz\" (UniqueName: \"kubernetes.io/projected/0544d6f1-ae3f-4a61-ac1c-3876cbff174f-kube-api-access-4wxsz\") pod \"usage-logs-tenancy-proxy-9c5d49bcd-25knx\" (UID: \"0544d6f1-ae3f-4a61-ac1c-3876cbff174f\") " pod="opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-25knx"
Oct 30 20:45:48.972579 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:45:48.972535    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-source\" (UniqueName: \"kubernetes.io/configmap/0544d6f1-ae3f-4a61-ac1c-3876cbff174f-proxy-source\") pod \"usage-logs-tenancy-proxy-9c5d49bcd-25knx\" (UID: \"0544d6f1-ae3f-4a61-ac1c-3876cbff174f\") " pod="opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-25knx"
Oct 30 20:45:48.973383 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:45:48.973362    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proxy-source\" (UniqueName: \"kubernetes.io/configmap/0544d6f1-ae3f-4a61-ac1c-3876cbff174f-proxy-source\") pod \"usage-logs-tenancy-proxy-9c5d49bcd-25knx\" (UID: \"0544d6f1-ae3f-4a61-ac1c-3876cbff174f\") " pod="opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-25knx"
Oct 30 20:45:49.192921 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:45:49.192887    6004 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-25knx"
Oct 30 20:45:49.566934 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:45:49.566908    6004 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-25knx"]
Oct 30 20:45:49.567749 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:45:49.567724    6004 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0544d6f1_ae3f_4a61_ac1c_3876cbff174f.slice/crio-92cb1082d220f5e42da1db14647ccd47038fdc7d515ebad39243aebe4010fba9 WatchSource:0}: Error finding container 92cb1082d220f5e42da1db14647ccd47038fdc7d515ebad39243aebe4010fba9: Status 404 returned error can't find the container with id 92cb1082d220f5e42da1db14647ccd47038fdc7d515ebad39243aebe4010fba9
Oct 30 20:45:50.433648 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:45:50.433615    6004 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-25knx" event={"ID":"0544d6f1-ae3f-4a61-ac1c-3876cbff174f","Type":"ContainerStarted","Data":"92cb1082d220f5e42da1db14647ccd47038fdc7d515ebad39243aebe4010fba9"}
Oct 30 20:46:07.529686 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:46:07.529600    6004 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-25knx" event={"ID":"0544d6f1-ae3f-4a61-ac1c-3876cbff174f","Type":"ContainerStarted","Data":"1779e875961c1a862ac4e96b3fa243791e627bb999c543685fee2ab4e43105ab"}
Oct 30 20:46:07.530139 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:46:07.529748    6004 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-25knx"
Oct 30 20:46:07.645441 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:46:07.645391    6004 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-25knx" podStartSLOduration=1.9778137980000001 podStartE2EDuration="19.645376414s" totalImagesPullingTime="17.667562616s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:45:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:46:07.644134433 +0000 UTC m=+473.563920551" watchObservedRunningTime="2026-10-30 20:46:07.645376414 +0000 UTC m=+473.565162532"
Oct 30 20:46:08.985630 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:46:08.985591    6004 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-869d5dcc5d-7sg49"]
Oct 30 20:46:08.989667 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:46:08.989646    6004 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-7sg49"
Oct 30 20:46:09.045403 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:46:09.045371    6004 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-gwqg9\""
Oct 30 20:46:09.048267 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:46:09.048243    6004 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-869d5dcc5d-7sg49"]
Oct 30 20:46:09.061036 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:46:09.061010    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h5qpn\" (UniqueName: \"kubernetes.io/projected/ff3ae525-4cfd-4641-b7b7-d27967956924-kube-api-access-h5qpn\") pod \"llmisvc-controller-manager-869d5dcc5d-7sg49\" (UID: \"ff3ae525-4cfd-4641-b7b7-d27967956924\") " pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-7sg49"
Oct 30 20:46:09.061210 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:46:09.061066    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ff3ae525-4cfd-4641-b7b7-d27967956924-cert\") pod \"llmisvc-controller-manager-869d5dcc5d-7sg49\" (UID: \"ff3ae525-4cfd-4641-b7b7-d27967956924\") " pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-7sg49"
Oct 30 20:46:09.095905 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:46:09.095881    6004 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\""
Oct 30 20:46:09.161681 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:46:09.161644    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ff3ae525-4cfd-4641-b7b7-d27967956924-cert\") pod \"llmisvc-controller-manager-869d5dcc5d-7sg49\" (UID: \"ff3ae525-4cfd-4641-b7b7-d27967956924\") " pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-7sg49"
Oct 30 20:46:09.161846 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:46:09.161776    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h5qpn\" (UniqueName: \"kubernetes.io/projected/ff3ae525-4cfd-4641-b7b7-d27967956924-kube-api-access-h5qpn\") pod \"llmisvc-controller-manager-869d5dcc5d-7sg49\" (UID: \"ff3ae525-4cfd-4641-b7b7-d27967956924\") " pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-7sg49"
Oct 30 20:46:09.164559 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:46:09.164537    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ff3ae525-4cfd-4641-b7b7-d27967956924-cert\") pod \"llmisvc-controller-manager-869d5dcc5d-7sg49\" (UID: \"ff3ae525-4cfd-4641-b7b7-d27967956924\") " pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-7sg49"
Oct 30 20:46:09.220510 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:46:09.220478    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h5qpn\" (UniqueName: \"kubernetes.io/projected/ff3ae525-4cfd-4641-b7b7-d27967956924-kube-api-access-h5qpn\") pod \"llmisvc-controller-manager-869d5dcc5d-7sg49\" (UID: \"ff3ae525-4cfd-4641-b7b7-d27967956924\") " pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-7sg49"
Oct 30 20:46:09.302073 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:46:09.301977    6004 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-7sg49"
Oct 30 20:46:09.674733 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:46:09.674709    6004 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-869d5dcc5d-7sg49"]
Oct 30 20:46:09.676627 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:46:09.676597    6004 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podff3ae525_4cfd_4641_b7b7_d27967956924.slice/crio-13a1d1153eb2d497d935a23cef8730b3ffcb949933833bf5893d5cd4829ac5bc WatchSource:0}: Error finding container 13a1d1153eb2d497d935a23cef8730b3ffcb949933833bf5893d5cd4829ac5bc: Status 404 returned error can't find the container with id 13a1d1153eb2d497d935a23cef8730b3ffcb949933833bf5893d5cd4829ac5bc
Oct 30 20:46:10.546819 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:46:10.546779    6004 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-7sg49" event={"ID":"ff3ae525-4cfd-4641-b7b7-d27967956924","Type":"ContainerStarted","Data":"13a1d1153eb2d497d935a23cef8730b3ffcb949933833bf5893d5cd4829ac5bc"}
Oct 30 20:46:12.557976 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:46:12.557938    6004 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-7sg49" event={"ID":"ff3ae525-4cfd-4641-b7b7-d27967956924","Type":"ContainerStarted","Data":"828cc242fe6cac99989ae372a8a38661958635a8d0f046983c607d29bac2fc2b"}
Oct 30 20:46:12.558476 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:46:12.558082    6004 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-7sg49"
Oct 30 20:46:12.674709 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:46:12.674607    6004 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-7sg49" podStartSLOduration=1.9694852090000001 podStartE2EDuration="4.674594558s" totalImagesPullingTime="2.705109349s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:46:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:46:12.673903473 +0000 UTC m=+478.593689592" watchObservedRunningTime="2026-10-30 20:46:12.674594558 +0000 UTC m=+478.594380675"
Oct 30 20:46:14.284972 ip-10-0-138-85 kubenswrapper[6004]: E1030 20:46:14.284932    6004 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-zz4wr" containerName="extractor"
Oct 30 20:46:18.540501 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:46:18.540464    6004 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-25knx"
Oct 30 20:46:21.789873 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:46:21.789835    6004 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-6d669c7fcd-tvgtw"]
Oct 30 20:46:21.794543 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:46:21.794526    6004 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-6d669c7fcd-tvgtw"
Oct 30 20:46:21.878687 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:46:21.878651    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/435aabb8-24d7-44d1-bd05-a3aa68922c79-metrics-certs\") pod \"maas-api-6d669c7fcd-tvgtw\" (UID: \"435aabb8-24d7-44d1-bd05-a3aa68922c79\") " pod="odh-ai-gateway-infra/maas-api-6d669c7fcd-tvgtw"
Oct 30 20:46:21.878838 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:46:21.878697    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pnwvw\" (UniqueName: \"kubernetes.io/projected/435aabb8-24d7-44d1-bd05-a3aa68922c79-kube-api-access-pnwvw\") pod \"maas-api-6d669c7fcd-tvgtw\" (UID: \"435aabb8-24d7-44d1-bd05-a3aa68922c79\") " pod="odh-ai-gateway-infra/maas-api-6d669c7fcd-tvgtw"
Oct 30 20:46:21.878838 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:46:21.878795    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/435aabb8-24d7-44d1-bd05-a3aa68922c79-maas-api-tls\") pod \"maas-api-6d669c7fcd-tvgtw\" (UID: \"435aabb8-24d7-44d1-bd05-a3aa68922c79\") " pod="odh-ai-gateway-infra/maas-api-6d669c7fcd-tvgtw"
Oct 30 20:46:21.878914 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:46:21.878851    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/435aabb8-24d7-44d1-bd05-a3aa68922c79-openshift-service-ca\") pod \"maas-api-6d669c7fcd-tvgtw\" (UID: \"435aabb8-24d7-44d1-bd05-a3aa68922c79\") " pod="odh-ai-gateway-infra/maas-api-6d669c7fcd-tvgtw"
Oct 30 20:46:21.901685 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:46:21.901651    6004 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-metrics-tls\""
Oct 30 20:46:21.901879 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:46:21.901857    6004 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\""
Oct 30 20:46:21.901950 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:46:21.901932    6004 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-6mqfn\""
Oct 30 20:46:21.903341 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:46:21.903321    6004 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-6d669c7fcd-tvgtw"]
Oct 30 20:46:21.979623 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:46:21.979595    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pnwvw\" (UniqueName: \"kubernetes.io/projected/435aabb8-24d7-44d1-bd05-a3aa68922c79-kube-api-access-pnwvw\") pod \"maas-api-6d669c7fcd-tvgtw\" (UID: \"435aabb8-24d7-44d1-bd05-a3aa68922c79\") " pod="odh-ai-gateway-infra/maas-api-6d669c7fcd-tvgtw"
Oct 30 20:46:21.979799 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:46:21.979631    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/435aabb8-24d7-44d1-bd05-a3aa68922c79-maas-api-tls\") pod \"maas-api-6d669c7fcd-tvgtw\" (UID: \"435aabb8-24d7-44d1-bd05-a3aa68922c79\") " pod="odh-ai-gateway-infra/maas-api-6d669c7fcd-tvgtw"
Oct 30 20:46:21.979799 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:46:21.979675    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/435aabb8-24d7-44d1-bd05-a3aa68922c79-openshift-service-ca\") pod \"maas-api-6d669c7fcd-tvgtw\" (UID: \"435aabb8-24d7-44d1-bd05-a3aa68922c79\") " pod="odh-ai-gateway-infra/maas-api-6d669c7fcd-tvgtw"
Oct 30 20:46:21.979799 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:46:21.979722    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/435aabb8-24d7-44d1-bd05-a3aa68922c79-metrics-certs\") pod \"maas-api-6d669c7fcd-tvgtw\" (UID: \"435aabb8-24d7-44d1-bd05-a3aa68922c79\") " pod="odh-ai-gateway-infra/maas-api-6d669c7fcd-tvgtw"
Oct 30 20:46:21.980408 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:46:21.980384    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/435aabb8-24d7-44d1-bd05-a3aa68922c79-openshift-service-ca\") pod \"maas-api-6d669c7fcd-tvgtw\" (UID: \"435aabb8-24d7-44d1-bd05-a3aa68922c79\") " pod="odh-ai-gateway-infra/maas-api-6d669c7fcd-tvgtw"
Oct 30 20:46:21.982090 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:46:21.982062    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/435aabb8-24d7-44d1-bd05-a3aa68922c79-metrics-certs\") pod \"maas-api-6d669c7fcd-tvgtw\" (UID: \"435aabb8-24d7-44d1-bd05-a3aa68922c79\") " pod="odh-ai-gateway-infra/maas-api-6d669c7fcd-tvgtw"
Oct 30 20:46:21.982191 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:46:21.982111    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/435aabb8-24d7-44d1-bd05-a3aa68922c79-maas-api-tls\") pod \"maas-api-6d669c7fcd-tvgtw\" (UID: \"435aabb8-24d7-44d1-bd05-a3aa68922c79\") " pod="odh-ai-gateway-infra/maas-api-6d669c7fcd-tvgtw"
Oct 30 20:46:22.037354 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:46:22.037326    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pnwvw\" (UniqueName: \"kubernetes.io/projected/435aabb8-24d7-44d1-bd05-a3aa68922c79-kube-api-access-pnwvw\") pod \"maas-api-6d669c7fcd-tvgtw\" (UID: \"435aabb8-24d7-44d1-bd05-a3aa68922c79\") " pod="odh-ai-gateway-infra/maas-api-6d669c7fcd-tvgtw"
Oct 30 20:46:22.107150 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:46:22.107078    6004 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-6d669c7fcd-tvgtw"
Oct 30 20:46:22.483171 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:46:22.483145    6004 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-6d669c7fcd-tvgtw"]
Oct 30 20:46:22.484693 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:46:22.484663    6004 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod435aabb8_24d7_44d1_bd05_a3aa68922c79.slice/crio-c5d205ce7fe7f8989b2697ece03f5537b308e8d98f0f704110326679acfbbe9a WatchSource:0}: Error finding container c5d205ce7fe7f8989b2697ece03f5537b308e8d98f0f704110326679acfbbe9a: Status 404 returned error can't find the container with id c5d205ce7fe7f8989b2697ece03f5537b308e8d98f0f704110326679acfbbe9a
Oct 30 20:46:22.612002 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:46:22.611958    6004 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-6d669c7fcd-tvgtw" event={"ID":"435aabb8-24d7-44d1-bd05-a3aa68922c79","Type":"ContainerStarted","Data":"c5d205ce7fe7f8989b2697ece03f5537b308e8d98f0f704110326679acfbbe9a"}
Oct 30 20:46:26.638320 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:46:26.638281    6004 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-6d669c7fcd-tvgtw" event={"ID":"435aabb8-24d7-44d1-bd05-a3aa68922c79","Type":"ContainerStarted","Data":"524a07bedf83d503c6a3491cdc7f7ca3db3ebbf320819124449e8b094367ba1a"}
Oct 30 20:46:26.638823 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:46:26.638410    6004 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-6d669c7fcd-tvgtw"
Oct 30 20:46:26.754476 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:46:26.754408    6004 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-6d669c7fcd-tvgtw" podStartSLOduration=2.608734327 podStartE2EDuration="5.754388751s" totalImagesPullingTime="3.145654424s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:46:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:46:26.752588233 +0000 UTC m=+492.672374362" watchObservedRunningTime="2026-10-30 20:46:26.754388751 +0000 UTC m=+492.674174880"
Oct 30 20:46:32.660277 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:46:32.660250    6004 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-6d669c7fcd-tvgtw"
Oct 30 20:46:33.669404 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:46:33.669371    6004 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-56b9cf7d95-4cxb4"]
Oct 30 20:46:33.689847 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:46:33.689817    6004 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-56b9cf7d95-4cxb4"
Oct 30 20:46:33.735649 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:46:33.735560    6004 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-56b9cf7d95-4cxb4"]
Oct 30 20:46:33.810401 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:46:33.810358    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8f46c99a-399f-4952-9dac-63d3761c3b65-openshift-service-ca\") pod \"maas-api-56b9cf7d95-4cxb4\" (UID: \"8f46c99a-399f-4952-9dac-63d3761c3b65\") " pod="odh-ai-gateway-infra/maas-api-56b9cf7d95-4cxb4"
Oct 30 20:46:33.810401 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:46:33.810397    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-grp7t\" (UniqueName: \"kubernetes.io/projected/8f46c99a-399f-4952-9dac-63d3761c3b65-kube-api-access-grp7t\") pod \"maas-api-56b9cf7d95-4cxb4\" (UID: \"8f46c99a-399f-4952-9dac-63d3761c3b65\") " pod="odh-ai-gateway-infra/maas-api-56b9cf7d95-4cxb4"
Oct 30 20:46:33.810636 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:46:33.810493    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8f46c99a-399f-4952-9dac-63d3761c3b65-maas-api-tls\") pod \"maas-api-56b9cf7d95-4cxb4\" (UID: \"8f46c99a-399f-4952-9dac-63d3761c3b65\") " pod="odh-ai-gateway-infra/maas-api-56b9cf7d95-4cxb4"
Oct 30 20:46:33.810636 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:46:33.810536    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8f46c99a-399f-4952-9dac-63d3761c3b65-metrics-certs\") pod \"maas-api-56b9cf7d95-4cxb4\" (UID: \"8f46c99a-399f-4952-9dac-63d3761c3b65\") " pod="odh-ai-gateway-infra/maas-api-56b9cf7d95-4cxb4"
Oct 30 20:46:33.911721 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:46:33.911678    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8f46c99a-399f-4952-9dac-63d3761c3b65-openshift-service-ca\") pod \"maas-api-56b9cf7d95-4cxb4\" (UID: \"8f46c99a-399f-4952-9dac-63d3761c3b65\") " pod="odh-ai-gateway-infra/maas-api-56b9cf7d95-4cxb4"
Oct 30 20:46:33.911721 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:46:33.911718    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-grp7t\" (UniqueName: \"kubernetes.io/projected/8f46c99a-399f-4952-9dac-63d3761c3b65-kube-api-access-grp7t\") pod \"maas-api-56b9cf7d95-4cxb4\" (UID: \"8f46c99a-399f-4952-9dac-63d3761c3b65\") " pod="odh-ai-gateway-infra/maas-api-56b9cf7d95-4cxb4"
Oct 30 20:46:33.912012 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:46:33.911754    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8f46c99a-399f-4952-9dac-63d3761c3b65-maas-api-tls\") pod \"maas-api-56b9cf7d95-4cxb4\" (UID: \"8f46c99a-399f-4952-9dac-63d3761c3b65\") " pod="odh-ai-gateway-infra/maas-api-56b9cf7d95-4cxb4"
Oct 30 20:46:33.912012 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:46:33.911775    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8f46c99a-399f-4952-9dac-63d3761c3b65-metrics-certs\") pod \"maas-api-56b9cf7d95-4cxb4\" (UID: \"8f46c99a-399f-4952-9dac-63d3761c3b65\") " pod="odh-ai-gateway-infra/maas-api-56b9cf7d95-4cxb4"
Oct 30 20:46:33.912426 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:46:33.912402    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8f46c99a-399f-4952-9dac-63d3761c3b65-openshift-service-ca\") pod \"maas-api-56b9cf7d95-4cxb4\" (UID: \"8f46c99a-399f-4952-9dac-63d3761c3b65\") " pod="odh-ai-gateway-infra/maas-api-56b9cf7d95-4cxb4"
Oct 30 20:46:33.914265 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:46:33.914241    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8f46c99a-399f-4952-9dac-63d3761c3b65-maas-api-tls\") pod \"maas-api-56b9cf7d95-4cxb4\" (UID: \"8f46c99a-399f-4952-9dac-63d3761c3b65\") " pod="odh-ai-gateway-infra/maas-api-56b9cf7d95-4cxb4"
Oct 30 20:46:33.914370 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:46:33.914285    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8f46c99a-399f-4952-9dac-63d3761c3b65-metrics-certs\") pod \"maas-api-56b9cf7d95-4cxb4\" (UID: \"8f46c99a-399f-4952-9dac-63d3761c3b65\") " pod="odh-ai-gateway-infra/maas-api-56b9cf7d95-4cxb4"
Oct 30 20:46:33.981828 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:46:33.981788    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-grp7t\" (UniqueName: \"kubernetes.io/projected/8f46c99a-399f-4952-9dac-63d3761c3b65-kube-api-access-grp7t\") pod \"maas-api-56b9cf7d95-4cxb4\" (UID: \"8f46c99a-399f-4952-9dac-63d3761c3b65\") " pod="odh-ai-gateway-infra/maas-api-56b9cf7d95-4cxb4"
Oct 30 20:46:34.005834 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:46:34.005288    6004 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-56b9cf7d95-4cxb4"
Oct 30 20:46:34.395661 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:46:34.395630    6004 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-56b9cf7d95-4cxb4"]
Oct 30 20:46:34.397941 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:46:34.397905    6004 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8f46c99a_399f_4952_9dac_63d3761c3b65.slice/crio-1864566faf7e8f31bb143b3010f51c6502b41ceff2eb546d0b87d83f4e05381c WatchSource:0}: Error finding container 1864566faf7e8f31bb143b3010f51c6502b41ceff2eb546d0b87d83f4e05381c: Status 404 returned error can't find the container with id 1864566faf7e8f31bb143b3010f51c6502b41ceff2eb546d0b87d83f4e05381c
Oct 30 20:46:34.697275 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:46:34.697227    6004 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-56b9cf7d95-4cxb4" event={"ID":"8f46c99a-399f-4952-9dac-63d3761c3b65","Type":"ContainerStarted","Data":"1864566faf7e8f31bb143b3010f51c6502b41ceff2eb546d0b87d83f4e05381c"}
Oct 30 20:46:35.704808 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:46:35.704505    6004 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-56b9cf7d95-4cxb4" event={"ID":"8f46c99a-399f-4952-9dac-63d3761c3b65","Type":"ContainerStarted","Data":"d24d58c7433d8c64d96bf9effb46afd318e6998785dcbd59f26346539500cf5d"}
Oct 30 20:46:35.704808 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:46:35.704716    6004 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-56b9cf7d95-4cxb4"
Oct 30 20:46:35.821173 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:46:35.821117    6004 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-56b9cf7d95-4cxb4" podStartSLOduration=1.9067412080000001 podStartE2EDuration="2.821104791s" totalImagesPullingTime="914.363583ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:46:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:46:35.820336366 +0000 UTC m=+501.740122488" watchObservedRunningTime="2026-10-30 20:46:35.821104791 +0000 UTC m=+501.740890909"
Oct 30 20:46:36.650840 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:46:36.650732    6004 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-56c6c9ddd5-2jlvt"]
Oct 30 20:46:36.651088 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:46:36.650974    6004 kuberuntime_container.go:898] "Killing container with a grace period" pod="kuadrant-system/authorino-56c6c9ddd5-2jlvt" podUID="0d04798d-9f63-4d40-92e9-fd44015ce0ea" containerName="authorino" containerID="cri-o://de09c21726c394a9a361b04ef9f7451850905c035b92ba50eb9c9de24ebffebd" gracePeriod=30
Oct 30 20:46:36.712638 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:46:36.712602    6004 generic.go:356] "Generic (PLEG): container finished" podID="0e8f5c36-1420-425c-9283-b5ecfd4419a2" containerID="197ce9838c8cc218dae12d24af5da9823e02fbac3d950cc19b3a9241f35d1d55" exitCode=0
Oct 30 20:46:36.713007 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:46:36.712644    6004 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-d4xk7" event={"ID":"0e8f5c36-1420-425c-9283-b5ecfd4419a2","Type":"ContainerDied","Data":"197ce9838c8cc218dae12d24af5da9823e02fbac3d950cc19b3a9241f35d1d55"}
Oct 30 20:46:36.713247 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:46:36.713228    6004 scope.go:122] "RemoveContainer" containerID="197ce9838c8cc218dae12d24af5da9823e02fbac3d950cc19b3a9241f35d1d55"
Oct 30 20:46:36.714410 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:46:36.714377    6004 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 20:46:36.714516 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:46:36.714464    6004 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 20:46:36.714554 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:46:36.714513    6004 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 20:46:36.943540 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:46:36.943509    6004 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-56c6c9ddd5-2jlvt"
Oct 30 20:46:37.047438 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:46:37.047404    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/0d04798d-9f63-4d40-92e9-fd44015ce0ea-kube-api-access-8r626\" (UniqueName: \"kubernetes.io/projected/0d04798d-9f63-4d40-92e9-fd44015ce0ea-kube-api-access-8r626\") pod \"0d04798d-9f63-4d40-92e9-fd44015ce0ea\" (UID: \"0d04798d-9f63-4d40-92e9-fd44015ce0ea\") "
Oct 30 20:46:37.050044 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:46:37.050009    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0d04798d-9f63-4d40-92e9-fd44015ce0ea-kube-api-access-8r626" pod "0d04798d-9f63-4d40-92e9-fd44015ce0ea" (UID: "0d04798d-9f63-4d40-92e9-fd44015ce0ea"). InnerVolumeSpecName "kube-api-access-8r626". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:46:37.148799 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:46:37.148761    6004 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8r626\" (UniqueName: \"kubernetes.io/projected/0d04798d-9f63-4d40-92e9-fd44015ce0ea-kube-api-access-8r626\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:46:37.720026 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:46:37.719987    6004 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-d4xk7" event={"ID":"0e8f5c36-1420-425c-9283-b5ecfd4419a2","Type":"ContainerStarted","Data":"34b7138493616f9fb061f2b9ff25878f1279917e60d96644725868fda888f66c"}
Oct 30 20:46:37.721257 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:46:37.721231    6004 generic.go:356] "Generic (PLEG): container finished" podID="0d04798d-9f63-4d40-92e9-fd44015ce0ea" containerID="de09c21726c394a9a361b04ef9f7451850905c035b92ba50eb9c9de24ebffebd" exitCode=0
Oct 30 20:46:37.721358 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:46:37.721270    6004 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-56c6c9ddd5-2jlvt"
Oct 30 20:46:37.721358 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:46:37.721316    6004 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-56c6c9ddd5-2jlvt" event={"ID":"0d04798d-9f63-4d40-92e9-fd44015ce0ea","Type":"ContainerDied","Data":"de09c21726c394a9a361b04ef9f7451850905c035b92ba50eb9c9de24ebffebd"}
Oct 30 20:46:37.721445 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:46:37.721359    6004 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-56c6c9ddd5-2jlvt" event={"ID":"0d04798d-9f63-4d40-92e9-fd44015ce0ea","Type":"ContainerDied","Data":"698becdd94cf1e0f3dd254c48f41d09e05a8868a9c91b84358958a0ca304f038"}
Oct 30 20:46:37.721445 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:46:37.721377    6004 scope.go:122] "RemoveContainer" containerID="de09c21726c394a9a361b04ef9f7451850905c035b92ba50eb9c9de24ebffebd"
Oct 30 20:46:37.730762 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:46:37.730748    6004 scope.go:122] "RemoveContainer" containerID="de09c21726c394a9a361b04ef9f7451850905c035b92ba50eb9c9de24ebffebd"
Oct 30 20:46:37.731014 ip-10-0-138-85 kubenswrapper[6004]: E1030 20:46:37.730995    6004 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"de09c21726c394a9a361b04ef9f7451850905c035b92ba50eb9c9de24ebffebd\": container with ID starting with de09c21726c394a9a361b04ef9f7451850905c035b92ba50eb9c9de24ebffebd not found: ID does not exist" containerID="de09c21726c394a9a361b04ef9f7451850905c035b92ba50eb9c9de24ebffebd"
Oct 30 20:46:37.731101 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:46:37.731024    6004 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"de09c21726c394a9a361b04ef9f7451850905c035b92ba50eb9c9de24ebffebd"} err="failed to get container status \"de09c21726c394a9a361b04ef9f7451850905c035b92ba50eb9c9de24ebffebd\": rpc error: code = NotFound desc = could not find container \"de09c21726c394a9a361b04ef9f7451850905c035b92ba50eb9c9de24ebffebd\": container with ID starting with de09c21726c394a9a361b04ef9f7451850905c035b92ba50eb9c9de24ebffebd not found: ID does not exist"
Oct 30 20:46:37.772400 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:46:37.772363    6004 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-d4xk7"
Oct 30 20:46:37.773147 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:46:37.773121    6004 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-769df7846c-d4xk7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.35:15021/healthz/ready\": dial tcp 10.132.0.35:15021: connect: connection refused" start-of-body=
Oct 30 20:46:37.773288 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:46:37.773172    6004 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-d4xk7" podUID="0e8f5c36-1420-425c-9283-b5ecfd4419a2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.35:15021/healthz/ready\": dial tcp 10.132.0.35:15021: connect: connection refused"
Oct 30 20:46:37.961798 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:46:37.961759    6004 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-56c6c9ddd5-2jlvt"]
Oct 30 20:46:37.964750 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:46:37.964723    6004 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-56c6c9ddd5-2jlvt"]
Oct 30 20:46:38.253338 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:46:38.232777    6004 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="0d04798d-9f63-4d40-92e9-fd44015ce0ea" path="/var/lib/kubelet/pods/0d04798d-9f63-4d40-92e9-fd44015ce0ea/volumes"
Oct 30 20:46:38.772451 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:46:38.772409    6004 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-769df7846c-d4xk7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.35:15021/healthz/ready\": dial tcp 10.132.0.35:15021: connect: connection refused" start-of-body=
Oct 30 20:46:38.772926 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:46:38.772467    6004 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-d4xk7" podUID="0e8f5c36-1420-425c-9283-b5ecfd4419a2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.35:15021/healthz/ready\": dial tcp 10.132.0.35:15021: connect: connection refused"
Oct 30 20:46:39.772380 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:46:39.772344    6004 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-769df7846c-d4xk7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.35:15021/healthz/ready\": dial tcp 10.132.0.35:15021: connect: connection refused" start-of-body=
Oct 30 20:46:39.772552 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:46:39.772400    6004 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-d4xk7" podUID="0e8f5c36-1420-425c-9283-b5ecfd4419a2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.35:15021/healthz/ready\": dial tcp 10.132.0.35:15021: connect: connection refused"
Oct 30 20:46:40.772502 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:46:40.772465    6004 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-769df7846c-d4xk7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.35:15021/healthz/ready\": dial tcp 10.132.0.35:15021: connect: connection refused" start-of-body=
Oct 30 20:46:40.772681 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:46:40.772520    6004 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-d4xk7" podUID="0e8f5c36-1420-425c-9283-b5ecfd4419a2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.35:15021/healthz/ready\": dial tcp 10.132.0.35:15021: connect: connection refused"
Oct 30 20:46:41.718982 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:46:41.718950    6004 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-56b9cf7d95-4cxb4"
Oct 30 20:46:41.772268 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:46:41.772233    6004 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-769df7846c-d4xk7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.35:15021/healthz/ready\": dial tcp 10.132.0.35:15021: connect: connection refused" start-of-body=
Oct 30 20:46:41.772437 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:46:41.772285    6004 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-d4xk7" podUID="0e8f5c36-1420-425c-9283-b5ecfd4419a2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.35:15021/healthz/ready\": dial tcp 10.132.0.35:15021: connect: connection refused"
Oct 30 20:46:41.900641 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:46:41.900608    6004 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-6d669c7fcd-tvgtw"]
Oct 30 20:46:41.901096 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:46:41.900808    6004 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-6d669c7fcd-tvgtw" podUID="435aabb8-24d7-44d1-bd05-a3aa68922c79" containerName="maas-api" containerID="cri-o://524a07bedf83d503c6a3491cdc7f7ca3db3ebbf320819124449e8b094367ba1a" gracePeriod=30
Oct 30 20:46:42.712686 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:46:42.712651    6004 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-6d669c7fcd-tvgtw"
Oct 30 20:46:42.770538 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:46:42.770502    6004 generic.go:356] "Generic (PLEG): container finished" podID="435aabb8-24d7-44d1-bd05-a3aa68922c79" containerID="524a07bedf83d503c6a3491cdc7f7ca3db3ebbf320819124449e8b094367ba1a" exitCode=0
Oct 30 20:46:42.770704 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:46:42.770556    6004 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-6d669c7fcd-tvgtw"
Oct 30 20:46:42.770704 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:46:42.770592    6004 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-6d669c7fcd-tvgtw" event={"ID":"435aabb8-24d7-44d1-bd05-a3aa68922c79","Type":"ContainerDied","Data":"524a07bedf83d503c6a3491cdc7f7ca3db3ebbf320819124449e8b094367ba1a"}
Oct 30 20:46:42.770704 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:46:42.770639    6004 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-6d669c7fcd-tvgtw" event={"ID":"435aabb8-24d7-44d1-bd05-a3aa68922c79","Type":"ContainerDied","Data":"c5d205ce7fe7f8989b2697ece03f5537b308e8d98f0f704110326679acfbbe9a"}
Oct 30 20:46:42.770704 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:46:42.770662    6004 scope.go:122] "RemoveContainer" containerID="524a07bedf83d503c6a3491cdc7f7ca3db3ebbf320819124449e8b094367ba1a"
Oct 30 20:46:42.771897 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:46:42.771879    6004 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-769df7846c-d4xk7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.35:15021/healthz/ready\": dial tcp 10.132.0.35:15021: connect: connection refused" start-of-body=
Oct 30 20:46:42.771944 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:46:42.771927    6004 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-d4xk7" podUID="0e8f5c36-1420-425c-9283-b5ecfd4419a2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.35:15021/healthz/ready\": dial tcp 10.132.0.35:15021: connect: connection refused"
Oct 30 20:46:42.779921 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:46:42.779902    6004 scope.go:122] "RemoveContainer" containerID="524a07bedf83d503c6a3491cdc7f7ca3db3ebbf320819124449e8b094367ba1a"
Oct 30 20:46:42.780223 ip-10-0-138-85 kubenswrapper[6004]: E1030 20:46:42.780200    6004 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"524a07bedf83d503c6a3491cdc7f7ca3db3ebbf320819124449e8b094367ba1a\": container with ID starting with 524a07bedf83d503c6a3491cdc7f7ca3db3ebbf320819124449e8b094367ba1a not found: ID does not exist" containerID="524a07bedf83d503c6a3491cdc7f7ca3db3ebbf320819124449e8b094367ba1a"
Oct 30 20:46:42.780303 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:46:42.780233    6004 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"524a07bedf83d503c6a3491cdc7f7ca3db3ebbf320819124449e8b094367ba1a"} err="failed to get container status \"524a07bedf83d503c6a3491cdc7f7ca3db3ebbf320819124449e8b094367ba1a\": rpc error: code = NotFound desc = could not find container \"524a07bedf83d503c6a3491cdc7f7ca3db3ebbf320819124449e8b094367ba1a\": container with ID starting with 524a07bedf83d503c6a3491cdc7f7ca3db3ebbf320819124449e8b094367ba1a not found: ID does not exist"
Oct 30 20:46:42.803903 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:46:42.803865    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/435aabb8-24d7-44d1-bd05-a3aa68922c79-metrics-certs\" (UniqueName: \"kubernetes.io/secret/435aabb8-24d7-44d1-bd05-a3aa68922c79-metrics-certs\") pod \"435aabb8-24d7-44d1-bd05-a3aa68922c79\" (UID: \"435aabb8-24d7-44d1-bd05-a3aa68922c79\") "
Oct 30 20:46:42.804107 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:46:42.803909    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/435aabb8-24d7-44d1-bd05-a3aa68922c79-kube-api-access-pnwvw\" (UniqueName: \"kubernetes.io/projected/435aabb8-24d7-44d1-bd05-a3aa68922c79-kube-api-access-pnwvw\") pod \"435aabb8-24d7-44d1-bd05-a3aa68922c79\" (UID: \"435aabb8-24d7-44d1-bd05-a3aa68922c79\") "
Oct 30 20:46:42.804107 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:46:42.803951    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/435aabb8-24d7-44d1-bd05-a3aa68922c79-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/435aabb8-24d7-44d1-bd05-a3aa68922c79-openshift-service-ca\") pod \"435aabb8-24d7-44d1-bd05-a3aa68922c79\" (UID: \"435aabb8-24d7-44d1-bd05-a3aa68922c79\") "
Oct 30 20:46:42.804107 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:46:42.803988    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/435aabb8-24d7-44d1-bd05-a3aa68922c79-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/435aabb8-24d7-44d1-bd05-a3aa68922c79-maas-api-tls\") pod \"435aabb8-24d7-44d1-bd05-a3aa68922c79\" (UID: \"435aabb8-24d7-44d1-bd05-a3aa68922c79\") "
Oct 30 20:46:42.804392 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:46:42.804367    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/435aabb8-24d7-44d1-bd05-a3aa68922c79-openshift-service-ca" pod "435aabb8-24d7-44d1-bd05-a3aa68922c79" (UID: "435aabb8-24d7-44d1-bd05-a3aa68922c79"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 20:46:42.806506 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:46:42.806469    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/435aabb8-24d7-44d1-bd05-a3aa68922c79-maas-api-tls" pod "435aabb8-24d7-44d1-bd05-a3aa68922c79" (UID: "435aabb8-24d7-44d1-bd05-a3aa68922c79"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 20:46:42.806626 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:46:42.806532    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/435aabb8-24d7-44d1-bd05-a3aa68922c79-metrics-certs" pod "435aabb8-24d7-44d1-bd05-a3aa68922c79" (UID: "435aabb8-24d7-44d1-bd05-a3aa68922c79"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 20:46:42.806757 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:46:42.806733    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/435aabb8-24d7-44d1-bd05-a3aa68922c79-kube-api-access-pnwvw" pod "435aabb8-24d7-44d1-bd05-a3aa68922c79" (UID: "435aabb8-24d7-44d1-bd05-a3aa68922c79"). InnerVolumeSpecName "kube-api-access-pnwvw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:46:42.904912 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:46:42.904876    6004 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/435aabb8-24d7-44d1-bd05-a3aa68922c79-metrics-certs\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:46:42.904912 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:46:42.904906    6004 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pnwvw\" (UniqueName: \"kubernetes.io/projected/435aabb8-24d7-44d1-bd05-a3aa68922c79-kube-api-access-pnwvw\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:46:42.904912 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:46:42.904918    6004 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/435aabb8-24d7-44d1-bd05-a3aa68922c79-openshift-service-ca\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:46:42.905369 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:46:42.904928    6004 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/435aabb8-24d7-44d1-bd05-a3aa68922c79-maas-api-tls\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:46:43.194532 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:46:43.194498    6004 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-6d669c7fcd-tvgtw"]
Oct 30 20:46:43.200543 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:46:43.200514    6004 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-6d669c7fcd-tvgtw"]
Oct 30 20:46:43.564988 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:46:43.564953    6004 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-7sg49"
Oct 30 20:46:43.714856 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:46:43.714827    6004 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-d4xk7"
Oct 30 20:46:43.776745 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:46:43.776702    6004 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-d4xk7"
Oct 30 20:46:43.778295 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:46:43.778270    6004 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-d4xk7"
Oct 30 20:46:44.229944 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:46:44.229911    6004 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="435aabb8-24d7-44d1-bd05-a3aa68922c79" path="/var/lib/kubelet/pods/435aabb8-24d7-44d1-bd05-a3aa68922c79/volumes"
Oct 30 20:46:44.285030 ip-10-0-138-85 kubenswrapper[6004]: E1030 20:46:44.284997    6004 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-zz4wr" containerName="extractor"
Oct 30 20:46:45.645099 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:46:45.645029    6004 prober.go:122] "Probe failed" probeType="Readiness" pod="odh-ai-gateway-infra/maas-api-6d669c7fcd-tvgtw" podUID="435aabb8-24d7-44d1-bd05-a3aa68922c79" containerName="maas-api" probeResult="failure" output="Get \"https://10.132.0.50:8443/health\": context deadline exceeded"
Oct 30 20:47:14.285719 ip-10-0-138-85 kubenswrapper[6004]: E1030 20:47:14.285677    6004 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-zz4wr" containerName="extractor"
Oct 30 20:47:17.968457 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:47:17.968420    6004 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-6466c554d8-6rqgs"]
Oct 30 20:47:17.968861 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:47:17.968854    6004 cpu_manager.go:414] "containerMap: removing container" podUID="0d04798d-9f63-4d40-92e9-fd44015ce0ea" containerName="authorino"
Oct 30 20:47:17.968915 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:47:17.968865    6004 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="0d04798d-9f63-4d40-92e9-fd44015ce0ea" containerName="authorino"
Oct 30 20:47:17.968915 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:47:17.968880    6004 cpu_manager.go:414] "containerMap: removing container" podUID="435aabb8-24d7-44d1-bd05-a3aa68922c79" containerName="maas-api"
Oct 30 20:47:17.968915 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:47:17.968885    6004 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="435aabb8-24d7-44d1-bd05-a3aa68922c79" containerName="maas-api"
Oct 30 20:47:17.969021 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:47:17.968961    6004 memory_manager.go:365] "RemoveStaleState removing state" podUID="0d04798d-9f63-4d40-92e9-fd44015ce0ea" containerName="authorino"
Oct 30 20:47:17.969021 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:47:17.968969    6004 memory_manager.go:365] "RemoveStaleState removing state" podUID="435aabb8-24d7-44d1-bd05-a3aa68922c79" containerName="maas-api"
Oct 30 20:47:17.975442 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:47:17.975421    6004 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-6466c554d8-6rqgs"
Oct 30 20:47:18.029570 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:47:18.029530    6004 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-6466c554d8-6rqgs"]
Oct 30 20:47:18.114452 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:47:18.114410    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dhhc6\" (UniqueName: \"kubernetes.io/projected/eb8c513a-bb2a-40d4-8a81-33782f9d6585-kube-api-access-dhhc6\") pod \"llmisvc-controller-manager-6466c554d8-6rqgs\" (UID: \"eb8c513a-bb2a-40d4-8a81-33782f9d6585\") " pod="opendatahub/llmisvc-controller-manager-6466c554d8-6rqgs"
Oct 30 20:47:18.114632 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:47:18.114467    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/eb8c513a-bb2a-40d4-8a81-33782f9d6585-cert\") pod \"llmisvc-controller-manager-6466c554d8-6rqgs\" (UID: \"eb8c513a-bb2a-40d4-8a81-33782f9d6585\") " pod="opendatahub/llmisvc-controller-manager-6466c554d8-6rqgs"
Oct 30 20:47:18.214999 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:47:18.214956    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dhhc6\" (UniqueName: \"kubernetes.io/projected/eb8c513a-bb2a-40d4-8a81-33782f9d6585-kube-api-access-dhhc6\") pod \"llmisvc-controller-manager-6466c554d8-6rqgs\" (UID: \"eb8c513a-bb2a-40d4-8a81-33782f9d6585\") " pod="opendatahub/llmisvc-controller-manager-6466c554d8-6rqgs"
Oct 30 20:47:18.215233 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:47:18.215009    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/eb8c513a-bb2a-40d4-8a81-33782f9d6585-cert\") pod \"llmisvc-controller-manager-6466c554d8-6rqgs\" (UID: \"eb8c513a-bb2a-40d4-8a81-33782f9d6585\") " pod="opendatahub/llmisvc-controller-manager-6466c554d8-6rqgs"
Oct 30 20:47:18.217470 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:47:18.217441    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/eb8c513a-bb2a-40d4-8a81-33782f9d6585-cert\") pod \"llmisvc-controller-manager-6466c554d8-6rqgs\" (UID: \"eb8c513a-bb2a-40d4-8a81-33782f9d6585\") " pod="opendatahub/llmisvc-controller-manager-6466c554d8-6rqgs"
Oct 30 20:47:18.272590 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:47:18.272521    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dhhc6\" (UniqueName: \"kubernetes.io/projected/eb8c513a-bb2a-40d4-8a81-33782f9d6585-kube-api-access-dhhc6\") pod \"llmisvc-controller-manager-6466c554d8-6rqgs\" (UID: \"eb8c513a-bb2a-40d4-8a81-33782f9d6585\") " pod="opendatahub/llmisvc-controller-manager-6466c554d8-6rqgs"
Oct 30 20:47:18.288367 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:47:18.288341    6004 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-6466c554d8-6rqgs"
Oct 30 20:47:18.658253 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:47:18.658229    6004 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-6466c554d8-6rqgs"]
Oct 30 20:47:18.660179 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:47:18.660135    6004 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeb8c513a_bb2a_40d4_8a81_33782f9d6585.slice/crio-4f92e3f066da03f7df947c3cba7065d871a72bd99ce820e3f8a626927700e3b2 WatchSource:0}: Error finding container 4f92e3f066da03f7df947c3cba7065d871a72bd99ce820e3f8a626927700e3b2: Status 404 returned error can't find the container with id 4f92e3f066da03f7df947c3cba7065d871a72bd99ce820e3f8a626927700e3b2
Oct 30 20:47:18.961953 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:47:18.961910    6004 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-6466c554d8-6rqgs" event={"ID":"eb8c513a-bb2a-40d4-8a81-33782f9d6585","Type":"ContainerStarted","Data":"4f92e3f066da03f7df947c3cba7065d871a72bd99ce820e3f8a626927700e3b2"}
Oct 30 20:47:19.968257 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:47:19.968221    6004 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-6466c554d8-6rqgs" event={"ID":"eb8c513a-bb2a-40d4-8a81-33782f9d6585","Type":"ContainerStarted","Data":"c50a75f2094f20b55ecce916ee5ee7989bf156d1c4e94c15b2431909d1a43085"}
Oct 30 20:47:19.968644 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:47:19.968326    6004 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-6466c554d8-6rqgs"
Oct 30 20:47:20.085298 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:47:20.085248    6004 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-6466c554d8-6rqgs" podStartSLOduration=2.332433678 podStartE2EDuration="3.085233619s" totalImagesPullingTime="752.799941ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:47:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:47:20.084793041 +0000 UTC m=+546.004579159" watchObservedRunningTime="2026-10-30 20:47:20.085233619 +0000 UTC m=+546.005019737"
Oct 30 20:47:44.285615 ip-10-0-138-85 kubenswrapper[6004]: E1030 20:47:44.285574    6004 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-zz4wr" containerName="extractor"
Oct 30 20:47:50.976035 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:47:50.976002    6004 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-6466c554d8-6rqgs"
Oct 30 20:47:51.143815 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:47:51.143778    6004 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["opendatahub/llmisvc-controller-manager-869d5dcc5d-7sg49"]
Oct 30 20:47:51.144132 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:47:51.144100    6004 kuberuntime_container.go:898] "Killing container with a grace period" pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-7sg49" podUID="ff3ae525-4cfd-4641-b7b7-d27967956924" containerName="manager" containerID="cri-o://828cc242fe6cac99989ae372a8a38661958635a8d0f046983c607d29bac2fc2b" gracePeriod=30
Oct 30 20:47:51.399910 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:47:51.399881    6004 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-7sg49"
Oct 30 20:47:51.514071 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:47:51.513976    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/ff3ae525-4cfd-4641-b7b7-d27967956924-cert\" (UniqueName: \"kubernetes.io/secret/ff3ae525-4cfd-4641-b7b7-d27967956924-cert\") pod \"ff3ae525-4cfd-4641-b7b7-d27967956924\" (UID: \"ff3ae525-4cfd-4641-b7b7-d27967956924\") "
Oct 30 20:47:51.514071 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:47:51.514020    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/ff3ae525-4cfd-4641-b7b7-d27967956924-kube-api-access-h5qpn\" (UniqueName: \"kubernetes.io/projected/ff3ae525-4cfd-4641-b7b7-d27967956924-kube-api-access-h5qpn\") pod \"ff3ae525-4cfd-4641-b7b7-d27967956924\" (UID: \"ff3ae525-4cfd-4641-b7b7-d27967956924\") "
Oct 30 20:47:51.516326 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:47:51.516293    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ff3ae525-4cfd-4641-b7b7-d27967956924-cert" pod "ff3ae525-4cfd-4641-b7b7-d27967956924" (UID: "ff3ae525-4cfd-4641-b7b7-d27967956924"). InnerVolumeSpecName "cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 20:47:51.516496 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:47:51.516476    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ff3ae525-4cfd-4641-b7b7-d27967956924-kube-api-access-h5qpn" pod "ff3ae525-4cfd-4641-b7b7-d27967956924" (UID: "ff3ae525-4cfd-4641-b7b7-d27967956924"). InnerVolumeSpecName "kube-api-access-h5qpn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:47:51.614768 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:47:51.614738    6004 reconciler_common.go:299] "Volume detached for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ff3ae525-4cfd-4641-b7b7-d27967956924-cert\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:47:51.614768 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:47:51.614766    6004 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h5qpn\" (UniqueName: \"kubernetes.io/projected/ff3ae525-4cfd-4641-b7b7-d27967956924-kube-api-access-h5qpn\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:47:52.131675 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:47:52.131641    6004 generic.go:356] "Generic (PLEG): container finished" podID="ff3ae525-4cfd-4641-b7b7-d27967956924" containerID="828cc242fe6cac99989ae372a8a38661958635a8d0f046983c607d29bac2fc2b" exitCode=0
Oct 30 20:47:52.132119 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:47:52.131689    6004 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-7sg49"
Oct 30 20:47:52.132119 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:47:52.131720    6004 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-7sg49" event={"ID":"ff3ae525-4cfd-4641-b7b7-d27967956924","Type":"ContainerDied","Data":"828cc242fe6cac99989ae372a8a38661958635a8d0f046983c607d29bac2fc2b"}
Oct 30 20:47:52.132119 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:47:52.131776    6004 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-7sg49" event={"ID":"ff3ae525-4cfd-4641-b7b7-d27967956924","Type":"ContainerDied","Data":"13a1d1153eb2d497d935a23cef8730b3ffcb949933833bf5893d5cd4829ac5bc"}
Oct 30 20:47:52.132119 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:47:52.131800    6004 scope.go:122] "RemoveContainer" containerID="828cc242fe6cac99989ae372a8a38661958635a8d0f046983c607d29bac2fc2b"
Oct 30 20:47:52.141423 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:47:52.141405    6004 scope.go:122] "RemoveContainer" containerID="828cc242fe6cac99989ae372a8a38661958635a8d0f046983c607d29bac2fc2b"
Oct 30 20:47:52.141697 ip-10-0-138-85 kubenswrapper[6004]: E1030 20:47:52.141678    6004 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"828cc242fe6cac99989ae372a8a38661958635a8d0f046983c607d29bac2fc2b\": container with ID starting with 828cc242fe6cac99989ae372a8a38661958635a8d0f046983c607d29bac2fc2b not found: ID does not exist" containerID="828cc242fe6cac99989ae372a8a38661958635a8d0f046983c607d29bac2fc2b"
Oct 30 20:47:52.141737 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:47:52.141708    6004 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"828cc242fe6cac99989ae372a8a38661958635a8d0f046983c607d29bac2fc2b"} err="failed to get container status \"828cc242fe6cac99989ae372a8a38661958635a8d0f046983c607d29bac2fc2b\": rpc error: code = NotFound desc = could not find container \"828cc242fe6cac99989ae372a8a38661958635a8d0f046983c607d29bac2fc2b\": container with ID starting with 828cc242fe6cac99989ae372a8a38661958635a8d0f046983c607d29bac2fc2b not found: ID does not exist"
Oct 30 20:47:52.299026 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:47:52.298995    6004 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["opendatahub/llmisvc-controller-manager-869d5dcc5d-7sg49"]
Oct 30 20:47:52.349462 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:47:52.349415    6004 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["opendatahub/llmisvc-controller-manager-869d5dcc5d-7sg49"]
Oct 30 20:47:54.230409 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:47:54.230370    6004 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="ff3ae525-4cfd-4641-b7b7-d27967956924" path="/var/lib/kubelet/pods/ff3ae525-4cfd-4641-b7b7-d27967956924/volumes"
Oct 30 20:48:14.290006 ip-10-0-138-85 kubenswrapper[6004]: E1030 20:48:14.289967    6004 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-zz4wr" containerName="extractor"
Oct 30 20:48:14.292460 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:48:14.292438    6004 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-sb7ds_90cd3de0-c573-41c2-bf3e-cf0e46a41d50/console-operator/2.log"
Oct 30 20:48:14.294622 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:48:14.294603    6004 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-sb7ds_90cd3de0-c573-41c2-bf3e-cf0e46a41d50/console-operator/2.log"
Oct 30 20:48:44.288878 ip-10-0-138-85 kubenswrapper[6004]: E1030 20:48:44.288828    6004 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-zz4wr" containerName="extractor"
Oct 30 20:49:07.169838 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:49:07.169756    6004 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-769df7846c-nm6wz"]
Oct 30 20:49:07.170256 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:49:07.170221    6004 cpu_manager.go:414] "containerMap: removing container" podUID="ff3ae525-4cfd-4641-b7b7-d27967956924" containerName="manager"
Oct 30 20:49:07.170256 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:49:07.170234    6004 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="ff3ae525-4cfd-4641-b7b7-d27967956924" containerName="manager"
Oct 30 20:49:07.170333 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:49:07.170307    6004 memory_manager.go:365] "RemoveStaleState removing state" podUID="ff3ae525-4cfd-4641-b7b7-d27967956924" containerName="manager"
Oct 30 20:49:07.174426 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:49:07.174404    6004 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-nm6wz"
Oct 30 20:49:07.208559 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:49:07.208523    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a0172175-b38d-491b-a401-f70b85aa355c-istio-envoy\") pod \"maas-default-gateway-openshift-default-769df7846c-nm6wz\" (UID: \"a0172175-b38d-491b-a401-f70b85aa355c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-nm6wz"
Oct 30 20:49:07.208559 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:49:07.208560    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a0172175-b38d-491b-a401-f70b85aa355c-istio-token\") pod \"maas-default-gateway-openshift-default-769df7846c-nm6wz\" (UID: \"a0172175-b38d-491b-a401-f70b85aa355c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-nm6wz"
Oct 30 20:49:07.208813 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:49:07.208577    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a0172175-b38d-491b-a401-f70b85aa355c-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-769df7846c-nm6wz\" (UID: \"a0172175-b38d-491b-a401-f70b85aa355c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-nm6wz"
Oct 30 20:49:07.208813 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:49:07.208649    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a0172175-b38d-491b-a401-f70b85aa355c-istio-data\") pod \"maas-default-gateway-openshift-default-769df7846c-nm6wz\" (UID: \"a0172175-b38d-491b-a401-f70b85aa355c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-nm6wz"
Oct 30 20:49:07.208813 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:49:07.208698    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a0172175-b38d-491b-a401-f70b85aa355c-istio-podinfo\") pod \"maas-default-gateway-openshift-default-769df7846c-nm6wz\" (UID: \"a0172175-b38d-491b-a401-f70b85aa355c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-nm6wz"
Oct 30 20:49:07.208813 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:49:07.208805    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a0172175-b38d-491b-a401-f70b85aa355c-workload-socket\") pod \"maas-default-gateway-openshift-default-769df7846c-nm6wz\" (UID: \"a0172175-b38d-491b-a401-f70b85aa355c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-nm6wz"
Oct 30 20:49:07.209005 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:49:07.208870    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a0172175-b38d-491b-a401-f70b85aa355c-credential-socket\") pod \"maas-default-gateway-openshift-default-769df7846c-nm6wz\" (UID: \"a0172175-b38d-491b-a401-f70b85aa355c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-nm6wz"
Oct 30 20:49:07.209005 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:49:07.208930    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zd6gt\" (UniqueName: \"kubernetes.io/projected/a0172175-b38d-491b-a401-f70b85aa355c-kube-api-access-zd6gt\") pod \"maas-default-gateway-openshift-default-769df7846c-nm6wz\" (UID: \"a0172175-b38d-491b-a401-f70b85aa355c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-nm6wz"
Oct 30 20:49:07.209005 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:49:07.208977    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a0172175-b38d-491b-a401-f70b85aa355c-workload-certs\") pod \"maas-default-gateway-openshift-default-769df7846c-nm6wz\" (UID: \"a0172175-b38d-491b-a401-f70b85aa355c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-nm6wz"
Oct 30 20:49:07.279325 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:49:07.279295    6004 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-769df7846c-nm6wz"]
Oct 30 20:49:07.310003 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:49:07.309971    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a0172175-b38d-491b-a401-f70b85aa355c-istio-data\") pod \"maas-default-gateway-openshift-default-769df7846c-nm6wz\" (UID: \"a0172175-b38d-491b-a401-f70b85aa355c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-nm6wz"
Oct 30 20:49:07.310209 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:49:07.310009    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a0172175-b38d-491b-a401-f70b85aa355c-istio-podinfo\") pod \"maas-default-gateway-openshift-default-769df7846c-nm6wz\" (UID: \"a0172175-b38d-491b-a401-f70b85aa355c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-nm6wz"
Oct 30 20:49:07.310209 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:49:07.310041    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a0172175-b38d-491b-a401-f70b85aa355c-workload-socket\") pod \"maas-default-gateway-openshift-default-769df7846c-nm6wz\" (UID: \"a0172175-b38d-491b-a401-f70b85aa355c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-nm6wz"
Oct 30 20:49:07.310209 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:49:07.310157    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a0172175-b38d-491b-a401-f70b85aa355c-credential-socket\") pod \"maas-default-gateway-openshift-default-769df7846c-nm6wz\" (UID: \"a0172175-b38d-491b-a401-f70b85aa355c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-nm6wz"
Oct 30 20:49:07.310209 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:49:07.310181    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zd6gt\" (UniqueName: \"kubernetes.io/projected/a0172175-b38d-491b-a401-f70b85aa355c-kube-api-access-zd6gt\") pod \"maas-default-gateway-openshift-default-769df7846c-nm6wz\" (UID: \"a0172175-b38d-491b-a401-f70b85aa355c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-nm6wz"
Oct 30 20:49:07.310426 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:49:07.310218    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a0172175-b38d-491b-a401-f70b85aa355c-workload-certs\") pod \"maas-default-gateway-openshift-default-769df7846c-nm6wz\" (UID: \"a0172175-b38d-491b-a401-f70b85aa355c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-nm6wz"
Oct 30 20:49:07.310426 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:49:07.310287    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a0172175-b38d-491b-a401-f70b85aa355c-istio-envoy\") pod \"maas-default-gateway-openshift-default-769df7846c-nm6wz\" (UID: \"a0172175-b38d-491b-a401-f70b85aa355c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-nm6wz"
Oct 30 20:49:07.310426 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:49:07.310314    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a0172175-b38d-491b-a401-f70b85aa355c-istio-token\") pod \"maas-default-gateway-openshift-default-769df7846c-nm6wz\" (UID: \"a0172175-b38d-491b-a401-f70b85aa355c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-nm6wz"
Oct 30 20:49:07.310426 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:49:07.310339    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a0172175-b38d-491b-a401-f70b85aa355c-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-769df7846c-nm6wz\" (UID: \"a0172175-b38d-491b-a401-f70b85aa355c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-nm6wz"
Oct 30 20:49:07.310616 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:49:07.310435    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a0172175-b38d-491b-a401-f70b85aa355c-istio-data\") pod \"maas-default-gateway-openshift-default-769df7846c-nm6wz\" (UID: \"a0172175-b38d-491b-a401-f70b85aa355c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-nm6wz"
Oct 30 20:49:07.310616 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:49:07.310487    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a0172175-b38d-491b-a401-f70b85aa355c-workload-socket\") pod \"maas-default-gateway-openshift-default-769df7846c-nm6wz\" (UID: \"a0172175-b38d-491b-a401-f70b85aa355c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-nm6wz"
Oct 30 20:49:07.310616 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:49:07.310561    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a0172175-b38d-491b-a401-f70b85aa355c-credential-socket\") pod \"maas-default-gateway-openshift-default-769df7846c-nm6wz\" (UID: \"a0172175-b38d-491b-a401-f70b85aa355c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-nm6wz"
Oct 30 20:49:07.310778 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:49:07.310667    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a0172175-b38d-491b-a401-f70b85aa355c-workload-certs\") pod \"maas-default-gateway-openshift-default-769df7846c-nm6wz\" (UID: \"a0172175-b38d-491b-a401-f70b85aa355c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-nm6wz"
Oct 30 20:49:07.311041 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:49:07.311018    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a0172175-b38d-491b-a401-f70b85aa355c-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-769df7846c-nm6wz\" (UID: \"a0172175-b38d-491b-a401-f70b85aa355c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-nm6wz"
Oct 30 20:49:07.312653 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:49:07.312621    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a0172175-b38d-491b-a401-f70b85aa355c-istio-podinfo\") pod \"maas-default-gateway-openshift-default-769df7846c-nm6wz\" (UID: \"a0172175-b38d-491b-a401-f70b85aa355c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-nm6wz"
Oct 30 20:49:07.312742 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:49:07.312716    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a0172175-b38d-491b-a401-f70b85aa355c-istio-envoy\") pod \"maas-default-gateway-openshift-default-769df7846c-nm6wz\" (UID: \"a0172175-b38d-491b-a401-f70b85aa355c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-nm6wz"
Oct 30 20:49:07.367850 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:49:07.367814    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a0172175-b38d-491b-a401-f70b85aa355c-istio-token\") pod \"maas-default-gateway-openshift-default-769df7846c-nm6wz\" (UID: \"a0172175-b38d-491b-a401-f70b85aa355c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-nm6wz"
Oct 30 20:49:07.367978 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:49:07.367955    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zd6gt\" (UniqueName: \"kubernetes.io/projected/a0172175-b38d-491b-a401-f70b85aa355c-kube-api-access-zd6gt\") pod \"maas-default-gateway-openshift-default-769df7846c-nm6wz\" (UID: \"a0172175-b38d-491b-a401-f70b85aa355c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-nm6wz"
Oct 30 20:49:07.488980 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:49:07.488943    6004 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-nm6wz"
Oct 30 20:49:07.934775 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:49:07.934741    6004 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-769df7846c-nm6wz"]
Oct 30 20:49:07.942374 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:49:07.942343    6004 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda0172175_b38d_491b_a401_f70b85aa355c.slice/crio-f413283bb1dc23c873673903fcc53b90367917ef8a8c3edfd30e7592baee9b93 WatchSource:0}: Error finding container f413283bb1dc23c873673903fcc53b90367917ef8a8c3edfd30e7592baee9b93: Status 404 returned error can't find the container with id f413283bb1dc23c873673903fcc53b90367917ef8a8c3edfd30e7592baee9b93
Oct 30 20:49:07.944459 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:49:07.944429    6004 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 20:49:07.944549 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:49:07.944492    6004 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 20:49:07.944549 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:49:07.944522    6004 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 20:49:08.532625 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:49:08.532585    6004 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-nm6wz" event={"ID":"a0172175-b38d-491b-a401-f70b85aa355c","Type":"ContainerStarted","Data":"88f89e6e7f08c20d3527fa4bf2aa28823a09c5277c19d7f84bf6ed0a12634db0"}
Oct 30 20:49:08.533004 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:49:08.532649    6004 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-nm6wz" event={"ID":"a0172175-b38d-491b-a401-f70b85aa355c","Type":"ContainerStarted","Data":"f413283bb1dc23c873673903fcc53b90367917ef8a8c3edfd30e7592baee9b93"}
Oct 30 20:49:08.724467 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:49:08.724415    6004 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-nm6wz" podStartSLOduration=1.724399484 podStartE2EDuration="1.724399484s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:49:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:49:08.723827625 +0000 UTC m=+654.643613744" watchObservedRunningTime="2026-10-30 20:49:08.724399484 +0000 UTC m=+654.644185602"
Oct 30 20:49:09.489478 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:49:09.489437    6004 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-nm6wz"
Oct 30 20:49:09.490825 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:49:09.490794    6004 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-769df7846c-nm6wz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused" start-of-body=
Oct 30 20:49:09.490967 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:49:09.490850    6004 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-nm6wz" podUID="a0172175-b38d-491b-a401-f70b85aa355c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused"
Oct 30 20:49:10.489659 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:49:10.489622    6004 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-769df7846c-nm6wz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused" start-of-body=
Oct 30 20:49:10.490046 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:49:10.489679    6004 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-nm6wz" podUID="a0172175-b38d-491b-a401-f70b85aa355c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused"
Oct 30 20:49:11.489639 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:49:11.489601    6004 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-769df7846c-nm6wz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused" start-of-body=
Oct 30 20:49:11.489823 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:49:11.489656    6004 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-nm6wz" podUID="a0172175-b38d-491b-a401-f70b85aa355c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused"
Oct 30 20:49:12.489705 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:49:12.489664    6004 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-769df7846c-nm6wz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused" start-of-body=
Oct 30 20:49:12.489883 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:49:12.489720    6004 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-nm6wz" podUID="a0172175-b38d-491b-a401-f70b85aa355c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused"
Oct 30 20:49:13.489523 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:49:13.489489    6004 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-769df7846c-nm6wz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused" start-of-body=
Oct 30 20:49:13.489677 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:49:13.489543    6004 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-nm6wz" podUID="a0172175-b38d-491b-a401-f70b85aa355c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused"
Oct 30 20:49:14.288285 ip-10-0-138-85 kubenswrapper[6004]: E1030 20:49:14.288244    6004 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-zz4wr" containerName="extractor"
Oct 30 20:49:14.489920 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:49:14.489878    6004 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-769df7846c-nm6wz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused" start-of-body=
Oct 30 20:49:14.490097 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:49:14.489947    6004 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-nm6wz" podUID="a0172175-b38d-491b-a401-f70b85aa355c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused"
Oct 30 20:49:16.216192 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:49:16.216163    6004 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-nm6wz"
Oct 30 20:49:16.216783 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:49:16.216542    6004 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-nm6wz"
Oct 30 20:49:16.217455 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:49:16.217438    6004 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-nm6wz"
Oct 30 20:49:44.286896 ip-10-0-138-85 kubenswrapper[6004]: E1030 20:49:44.286857    6004 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-zz4wr" containerName="extractor"
Oct 30 20:49:58.048278 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:49:58.048237    6004 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w0-781058-openshift-default-55fb495b7-6mqk2"]
Oct 30 20:49:58.052252 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:49:58.052231    6004 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-781058-openshift-default-55fb495b7-6mqk2"
Oct 30 20:49:58.106071 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:49:58.106017    6004 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w0-781058-openshift-default-dockercfg-mkvr5\""
Oct 30 20:49:58.157421 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:49:58.157387    6004 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w0-781058-openshift-default-55fb495b7-6mqk2"]
Oct 30 20:49:58.185131 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:49:58.185096    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d8c44f87-9b8f-4838-bd12-d48dd55a08d0-workload-certs\") pod \"e2e-worker-w0-781058-openshift-default-55fb495b7-6mqk2\" (UID: \"d8c44f87-9b8f-4838-bd12-d48dd55a08d0\") " pod="openshift-ingress/e2e-worker-w0-781058-openshift-default-55fb495b7-6mqk2"
Oct 30 20:49:58.185298 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:49:58.185135    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d8c44f87-9b8f-4838-bd12-d48dd55a08d0-istio-envoy\") pod \"e2e-worker-w0-781058-openshift-default-55fb495b7-6mqk2\" (UID: \"d8c44f87-9b8f-4838-bd12-d48dd55a08d0\") " pod="openshift-ingress/e2e-worker-w0-781058-openshift-default-55fb495b7-6mqk2"
Oct 30 20:49:58.185298 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:49:58.185219    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d8c44f87-9b8f-4838-bd12-d48dd55a08d0-istio-data\") pod \"e2e-worker-w0-781058-openshift-default-55fb495b7-6mqk2\" (UID: \"d8c44f87-9b8f-4838-bd12-d48dd55a08d0\") " pod="openshift-ingress/e2e-worker-w0-781058-openshift-default-55fb495b7-6mqk2"
Oct 30 20:49:58.185298 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:49:58.185247    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d8c44f87-9b8f-4838-bd12-d48dd55a08d0-istiod-ca-cert\") pod \"e2e-worker-w0-781058-openshift-default-55fb495b7-6mqk2\" (UID: \"d8c44f87-9b8f-4838-bd12-d48dd55a08d0\") " pod="openshift-ingress/e2e-worker-w0-781058-openshift-default-55fb495b7-6mqk2"
Oct 30 20:49:58.185433 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:49:58.185318    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d8c44f87-9b8f-4838-bd12-d48dd55a08d0-istio-podinfo\") pod \"e2e-worker-w0-781058-openshift-default-55fb495b7-6mqk2\" (UID: \"d8c44f87-9b8f-4838-bd12-d48dd55a08d0\") " pod="openshift-ingress/e2e-worker-w0-781058-openshift-default-55fb495b7-6mqk2"
Oct 30 20:49:58.185433 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:49:58.185359    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d8c44f87-9b8f-4838-bd12-d48dd55a08d0-workload-socket\") pod \"e2e-worker-w0-781058-openshift-default-55fb495b7-6mqk2\" (UID: \"d8c44f87-9b8f-4838-bd12-d48dd55a08d0\") " pod="openshift-ingress/e2e-worker-w0-781058-openshift-default-55fb495b7-6mqk2"
Oct 30 20:49:58.185433 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:49:58.185376    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d8c44f87-9b8f-4838-bd12-d48dd55a08d0-credential-socket\") pod \"e2e-worker-w0-781058-openshift-default-55fb495b7-6mqk2\" (UID: \"d8c44f87-9b8f-4838-bd12-d48dd55a08d0\") " pod="openshift-ingress/e2e-worker-w0-781058-openshift-default-55fb495b7-6mqk2"
Oct 30 20:49:58.185530 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:49:58.185468    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d8c44f87-9b8f-4838-bd12-d48dd55a08d0-istio-token\") pod \"e2e-worker-w0-781058-openshift-default-55fb495b7-6mqk2\" (UID: \"d8c44f87-9b8f-4838-bd12-d48dd55a08d0\") " pod="openshift-ingress/e2e-worker-w0-781058-openshift-default-55fb495b7-6mqk2"
Oct 30 20:49:58.185530 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:49:58.185502    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9x97s\" (UniqueName: \"kubernetes.io/projected/d8c44f87-9b8f-4838-bd12-d48dd55a08d0-kube-api-access-9x97s\") pod \"e2e-worker-w0-781058-openshift-default-55fb495b7-6mqk2\" (UID: \"d8c44f87-9b8f-4838-bd12-d48dd55a08d0\") " pod="openshift-ingress/e2e-worker-w0-781058-openshift-default-55fb495b7-6mqk2"
Oct 30 20:49:58.286286 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:49:58.286252    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d8c44f87-9b8f-4838-bd12-d48dd55a08d0-istio-token\") pod \"e2e-worker-w0-781058-openshift-default-55fb495b7-6mqk2\" (UID: \"d8c44f87-9b8f-4838-bd12-d48dd55a08d0\") " pod="openshift-ingress/e2e-worker-w0-781058-openshift-default-55fb495b7-6mqk2"
Oct 30 20:49:58.286476 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:49:58.286294    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9x97s\" (UniqueName: \"kubernetes.io/projected/d8c44f87-9b8f-4838-bd12-d48dd55a08d0-kube-api-access-9x97s\") pod \"e2e-worker-w0-781058-openshift-default-55fb495b7-6mqk2\" (UID: \"d8c44f87-9b8f-4838-bd12-d48dd55a08d0\") " pod="openshift-ingress/e2e-worker-w0-781058-openshift-default-55fb495b7-6mqk2"
Oct 30 20:49:58.286476 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:49:58.286377    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d8c44f87-9b8f-4838-bd12-d48dd55a08d0-workload-certs\") pod \"e2e-worker-w0-781058-openshift-default-55fb495b7-6mqk2\" (UID: \"d8c44f87-9b8f-4838-bd12-d48dd55a08d0\") " pod="openshift-ingress/e2e-worker-w0-781058-openshift-default-55fb495b7-6mqk2"
Oct 30 20:49:58.286476 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:49:58.286400    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d8c44f87-9b8f-4838-bd12-d48dd55a08d0-istio-envoy\") pod \"e2e-worker-w0-781058-openshift-default-55fb495b7-6mqk2\" (UID: \"d8c44f87-9b8f-4838-bd12-d48dd55a08d0\") " pod="openshift-ingress/e2e-worker-w0-781058-openshift-default-55fb495b7-6mqk2"
Oct 30 20:49:58.286476 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:49:58.286456    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d8c44f87-9b8f-4838-bd12-d48dd55a08d0-istio-data\") pod \"e2e-worker-w0-781058-openshift-default-55fb495b7-6mqk2\" (UID: \"d8c44f87-9b8f-4838-bd12-d48dd55a08d0\") " pod="openshift-ingress/e2e-worker-w0-781058-openshift-default-55fb495b7-6mqk2"
Oct 30 20:49:58.286675 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:49:58.286491    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d8c44f87-9b8f-4838-bd12-d48dd55a08d0-istiod-ca-cert\") pod \"e2e-worker-w0-781058-openshift-default-55fb495b7-6mqk2\" (UID: \"d8c44f87-9b8f-4838-bd12-d48dd55a08d0\") " pod="openshift-ingress/e2e-worker-w0-781058-openshift-default-55fb495b7-6mqk2"
Oct 30 20:49:58.286675 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:49:58.286525    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d8c44f87-9b8f-4838-bd12-d48dd55a08d0-istio-podinfo\") pod \"e2e-worker-w0-781058-openshift-default-55fb495b7-6mqk2\" (UID: \"d8c44f87-9b8f-4838-bd12-d48dd55a08d0\") " pod="openshift-ingress/e2e-worker-w0-781058-openshift-default-55fb495b7-6mqk2"
Oct 30 20:49:58.286675 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:49:58.286572    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d8c44f87-9b8f-4838-bd12-d48dd55a08d0-workload-socket\") pod \"e2e-worker-w0-781058-openshift-default-55fb495b7-6mqk2\" (UID: \"d8c44f87-9b8f-4838-bd12-d48dd55a08d0\") " pod="openshift-ingress/e2e-worker-w0-781058-openshift-default-55fb495b7-6mqk2"
Oct 30 20:49:58.286675 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:49:58.286596    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d8c44f87-9b8f-4838-bd12-d48dd55a08d0-credential-socket\") pod \"e2e-worker-w0-781058-openshift-default-55fb495b7-6mqk2\" (UID: \"d8c44f87-9b8f-4838-bd12-d48dd55a08d0\") " pod="openshift-ingress/e2e-worker-w0-781058-openshift-default-55fb495b7-6mqk2"
Oct 30 20:49:58.286881 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:49:58.286865    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d8c44f87-9b8f-4838-bd12-d48dd55a08d0-istio-data\") pod \"e2e-worker-w0-781058-openshift-default-55fb495b7-6mqk2\" (UID: \"d8c44f87-9b8f-4838-bd12-d48dd55a08d0\") " pod="openshift-ingress/e2e-worker-w0-781058-openshift-default-55fb495b7-6mqk2"
Oct 30 20:49:58.287192 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:49:58.286972    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d8c44f87-9b8f-4838-bd12-d48dd55a08d0-workload-certs\") pod \"e2e-worker-w0-781058-openshift-default-55fb495b7-6mqk2\" (UID: \"d8c44f87-9b8f-4838-bd12-d48dd55a08d0\") " pod="openshift-ingress/e2e-worker-w0-781058-openshift-default-55fb495b7-6mqk2"
Oct 30 20:49:58.287293 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:49:58.287219    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d8c44f87-9b8f-4838-bd12-d48dd55a08d0-workload-socket\") pod \"e2e-worker-w0-781058-openshift-default-55fb495b7-6mqk2\" (UID: \"d8c44f87-9b8f-4838-bd12-d48dd55a08d0\") " pod="openshift-ingress/e2e-worker-w0-781058-openshift-default-55fb495b7-6mqk2"
Oct 30 20:49:58.287581 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:49:58.287559    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d8c44f87-9b8f-4838-bd12-d48dd55a08d0-credential-socket\") pod \"e2e-worker-w0-781058-openshift-default-55fb495b7-6mqk2\" (UID: \"d8c44f87-9b8f-4838-bd12-d48dd55a08d0\") " pod="openshift-ingress/e2e-worker-w0-781058-openshift-default-55fb495b7-6mqk2"
Oct 30 20:49:58.287720 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:49:58.287582    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d8c44f87-9b8f-4838-bd12-d48dd55a08d0-istiod-ca-cert\") pod \"e2e-worker-w0-781058-openshift-default-55fb495b7-6mqk2\" (UID: \"d8c44f87-9b8f-4838-bd12-d48dd55a08d0\") " pod="openshift-ingress/e2e-worker-w0-781058-openshift-default-55fb495b7-6mqk2"
Oct 30 20:49:58.289333 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:49:58.289307    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d8c44f87-9b8f-4838-bd12-d48dd55a08d0-istio-envoy\") pod \"e2e-worker-w0-781058-openshift-default-55fb495b7-6mqk2\" (UID: \"d8c44f87-9b8f-4838-bd12-d48dd55a08d0\") " pod="openshift-ingress/e2e-worker-w0-781058-openshift-default-55fb495b7-6mqk2"
Oct 30 20:49:58.289553 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:49:58.289530    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d8c44f87-9b8f-4838-bd12-d48dd55a08d0-istio-podinfo\") pod \"e2e-worker-w0-781058-openshift-default-55fb495b7-6mqk2\" (UID: \"d8c44f87-9b8f-4838-bd12-d48dd55a08d0\") " pod="openshift-ingress/e2e-worker-w0-781058-openshift-default-55fb495b7-6mqk2"
Oct 30 20:49:58.346852 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:49:58.346766    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d8c44f87-9b8f-4838-bd12-d48dd55a08d0-istio-token\") pod \"e2e-worker-w0-781058-openshift-default-55fb495b7-6mqk2\" (UID: \"d8c44f87-9b8f-4838-bd12-d48dd55a08d0\") " pod="openshift-ingress/e2e-worker-w0-781058-openshift-default-55fb495b7-6mqk2"
Oct 30 20:49:58.350888 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:49:58.350862    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9x97s\" (UniqueName: \"kubernetes.io/projected/d8c44f87-9b8f-4838-bd12-d48dd55a08d0-kube-api-access-9x97s\") pod \"e2e-worker-w0-781058-openshift-default-55fb495b7-6mqk2\" (UID: \"d8c44f87-9b8f-4838-bd12-d48dd55a08d0\") " pod="openshift-ingress/e2e-worker-w0-781058-openshift-default-55fb495b7-6mqk2"
Oct 30 20:49:58.372695 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:49:58.372664    6004 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-781058-openshift-default-55fb495b7-6mqk2"
Oct 30 20:49:58.914710 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:49:58.914676    6004 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w0-781058-openshift-default-55fb495b7-6mqk2"]
Oct 30 20:49:58.941594 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:49:58.941549    6004 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd8c44f87_9b8f_4838_bd12_d48dd55a08d0.slice/crio-36d8155b4e70f7bf1ade57d12638765b2f0e9d085217eace90441ffc09cbff8b WatchSource:0}: Error finding container 36d8155b4e70f7bf1ade57d12638765b2f0e9d085217eace90441ffc09cbff8b: Status 404 returned error can't find the container with id 36d8155b4e70f7bf1ade57d12638765b2f0e9d085217eace90441ffc09cbff8b
Oct 30 20:49:58.944221 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:49:58.944186    6004 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 20:49:58.944334 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:49:58.944255    6004 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 20:49:58.944334 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:49:58.944284    6004 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 20:49:59.813304 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:49:59.813271    6004 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-781058-openshift-default-55fb495b7-6mqk2" event={"ID":"d8c44f87-9b8f-4838-bd12-d48dd55a08d0","Type":"ContainerStarted","Data":"800e1e6882eeb4616d2615d0e9b78a9f22722f55df2dfceb33c58c8a1b32eef6"}
Oct 30 20:49:59.813718 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:49:59.813328    6004 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-781058-openshift-default-55fb495b7-6mqk2" event={"ID":"d8c44f87-9b8f-4838-bd12-d48dd55a08d0","Type":"ContainerStarted","Data":"36d8155b4e70f7bf1ade57d12638765b2f0e9d085217eace90441ffc09cbff8b"}
Oct 30 20:50:00.373735 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:50:00.373702    6004 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w0-781058-openshift-default-55fb495b7-6mqk2"
Oct 30 20:50:00.379849 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:50:00.379815    6004 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w0-781058-openshift-default-55fb495b7-6mqk2"
Oct 30 20:50:00.505096 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:50:00.502767    6004 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w0-781058-openshift-default-55fb495b7-6mqk2" podStartSLOduration=3.502748616 podStartE2EDuration="3.502748616s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:49:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:50:00.038578469 +0000 UTC m=+705.958364600" watchObservedRunningTime="2026-10-30 20:50:00.502748616 +0000 UTC m=+706.422534735"
Oct 30 20:50:00.818652 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:50:00.818582    6004 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w0-781058-openshift-default-55fb495b7-6mqk2"
Oct 30 20:50:00.819665 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:50:00.819641    6004 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w0-781058-openshift-default-55fb495b7-6mqk2"
Oct 30 20:50:07.589062 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:50:07.589017    6004 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w3-682999-5f9fdd855f-jgrfb"]
Oct 30 20:50:07.593799 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:50:07.593782    6004 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-682999-5f9fdd855f-jgrfb"
Oct 30 20:50:07.662706 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:50:07.662671    6004 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-worker-w3-682999-serving-cert\""
Oct 30 20:50:07.672149 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:50:07.672119    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/dd092751-81b5-4a63-a88d-392410a436dd-maas-api-tls\") pod \"maas-api-e2e-worker-w3-682999-5f9fdd855f-jgrfb\" (UID: \"dd092751-81b5-4a63-a88d-392410a436dd\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-682999-5f9fdd855f-jgrfb"
Oct 30 20:50:07.672268 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:50:07.672161    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/dd092751-81b5-4a63-a88d-392410a436dd-metrics-certs\") pod \"maas-api-e2e-worker-w3-682999-5f9fdd855f-jgrfb\" (UID: \"dd092751-81b5-4a63-a88d-392410a436dd\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-682999-5f9fdd855f-jgrfb"
Oct 30 20:50:07.672315 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:50:07.672294    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/dd092751-81b5-4a63-a88d-392410a436dd-openshift-service-ca\") pod \"maas-api-e2e-worker-w3-682999-5f9fdd855f-jgrfb\" (UID: \"dd092751-81b5-4a63-a88d-392410a436dd\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-682999-5f9fdd855f-jgrfb"
Oct 30 20:50:07.672355 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:50:07.672312    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n9kzt\" (UniqueName: \"kubernetes.io/projected/dd092751-81b5-4a63-a88d-392410a436dd-kube-api-access-n9kzt\") pod \"maas-api-e2e-worker-w3-682999-5f9fdd855f-jgrfb\" (UID: \"dd092751-81b5-4a63-a88d-392410a436dd\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-682999-5f9fdd855f-jgrfb"
Oct 30 20:50:07.699712 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:50:07.699679    6004 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w3-682999-5f9fdd855f-jgrfb"]
Oct 30 20:50:07.773144 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:50:07.773106    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/dd092751-81b5-4a63-a88d-392410a436dd-openshift-service-ca\") pod \"maas-api-e2e-worker-w3-682999-5f9fdd855f-jgrfb\" (UID: \"dd092751-81b5-4a63-a88d-392410a436dd\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-682999-5f9fdd855f-jgrfb"
Oct 30 20:50:07.773144 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:50:07.773143    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n9kzt\" (UniqueName: \"kubernetes.io/projected/dd092751-81b5-4a63-a88d-392410a436dd-kube-api-access-n9kzt\") pod \"maas-api-e2e-worker-w3-682999-5f9fdd855f-jgrfb\" (UID: \"dd092751-81b5-4a63-a88d-392410a436dd\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-682999-5f9fdd855f-jgrfb"
Oct 30 20:50:07.773388 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:50:07.773228    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/dd092751-81b5-4a63-a88d-392410a436dd-maas-api-tls\") pod \"maas-api-e2e-worker-w3-682999-5f9fdd855f-jgrfb\" (UID: \"dd092751-81b5-4a63-a88d-392410a436dd\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-682999-5f9fdd855f-jgrfb"
Oct 30 20:50:07.773388 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:50:07.773262    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/dd092751-81b5-4a63-a88d-392410a436dd-metrics-certs\") pod \"maas-api-e2e-worker-w3-682999-5f9fdd855f-jgrfb\" (UID: \"dd092751-81b5-4a63-a88d-392410a436dd\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-682999-5f9fdd855f-jgrfb"
Oct 30 20:50:07.773490 ip-10-0-138-85 kubenswrapper[6004]: E1030 20:50:07.773397    6004 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-worker-w3-682999-serving-cert: secret "maas-api-e2e-worker-w3-682999-serving-cert" not found
Oct 30 20:50:07.773490 ip-10-0-138-85 kubenswrapper[6004]: E1030 20:50:07.773476    6004 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dd092751-81b5-4a63-a88d-392410a436dd-maas-api-tls podName:dd092751-81b5-4a63-a88d-392410a436dd nodeName:}" failed. No retries permitted until 2026-10-30 20:50:08.273456404 +0000 UTC m=+714.193242517 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/dd092751-81b5-4a63-a88d-392410a436dd-maas-api-tls") pod "maas-api-e2e-worker-w3-682999-5f9fdd855f-jgrfb" (UID: "dd092751-81b5-4a63-a88d-392410a436dd") : secret "maas-api-e2e-worker-w3-682999-serving-cert" not found
Oct 30 20:50:07.773837 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:50:07.773818    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/dd092751-81b5-4a63-a88d-392410a436dd-openshift-service-ca\") pod \"maas-api-e2e-worker-w3-682999-5f9fdd855f-jgrfb\" (UID: \"dd092751-81b5-4a63-a88d-392410a436dd\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-682999-5f9fdd855f-jgrfb"
Oct 30 20:50:07.775792 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:50:07.775766    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/dd092751-81b5-4a63-a88d-392410a436dd-metrics-certs\") pod \"maas-api-e2e-worker-w3-682999-5f9fdd855f-jgrfb\" (UID: \"dd092751-81b5-4a63-a88d-392410a436dd\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-682999-5f9fdd855f-jgrfb"
Oct 30 20:50:07.838978 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:50:07.838943    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n9kzt\" (UniqueName: \"kubernetes.io/projected/dd092751-81b5-4a63-a88d-392410a436dd-kube-api-access-n9kzt\") pod \"maas-api-e2e-worker-w3-682999-5f9fdd855f-jgrfb\" (UID: \"dd092751-81b5-4a63-a88d-392410a436dd\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-682999-5f9fdd855f-jgrfb"
Oct 30 20:50:08.277329 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:50:08.277297    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/dd092751-81b5-4a63-a88d-392410a436dd-maas-api-tls\") pod \"maas-api-e2e-worker-w3-682999-5f9fdd855f-jgrfb\" (UID: \"dd092751-81b5-4a63-a88d-392410a436dd\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-682999-5f9fdd855f-jgrfb"
Oct 30 20:50:08.279787 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:50:08.279762    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/dd092751-81b5-4a63-a88d-392410a436dd-maas-api-tls\") pod \"maas-api-e2e-worker-w3-682999-5f9fdd855f-jgrfb\" (UID: \"dd092751-81b5-4a63-a88d-392410a436dd\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-682999-5f9fdd855f-jgrfb"
Oct 30 20:50:08.507699 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:50:08.507667    6004 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-682999-5f9fdd855f-jgrfb"
Oct 30 20:50:08.888732 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:50:08.888702    6004 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w3-682999-5f9fdd855f-jgrfb"]
Oct 30 20:50:08.890177 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:50:08.890152    6004 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddd092751_81b5_4a63_a88d_392410a436dd.slice/crio-ada934717c034c43ad4b25f0eedf75dfbda815234886d0c2b54477ffe71b036c WatchSource:0}: Error finding container ada934717c034c43ad4b25f0eedf75dfbda815234886d0c2b54477ffe71b036c: Status 404 returned error can't find the container with id ada934717c034c43ad4b25f0eedf75dfbda815234886d0c2b54477ffe71b036c
Oct 30 20:50:08.891821 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:50:08.891800    6004 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Oct 30 20:50:09.871290 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:50:09.871254    6004 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-682999-5f9fdd855f-jgrfb" event={"ID":"dd092751-81b5-4a63-a88d-392410a436dd","Type":"ContainerStarted","Data":"cb858a158391ed5ce12c9a951c3f0903740968b81f50a3e6753a6e67119b7a01"}
Oct 30 20:50:09.871397 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:50:09.871321    6004 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-682999-5f9fdd855f-jgrfb" event={"ID":"dd092751-81b5-4a63-a88d-392410a436dd","Type":"ContainerStarted","Data":"ada934717c034c43ad4b25f0eedf75dfbda815234886d0c2b54477ffe71b036c"}
Oct 30 20:50:09.871479 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:50:09.871466    6004 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-682999-5f9fdd855f-jgrfb"
Oct 30 20:50:10.060809 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:50:10.060694    6004 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-682999-5f9fdd855f-jgrfb" podStartSLOduration=2.150363285 podStartE2EDuration="3.060673331s" totalImagesPullingTime="910.310046ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:50:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:50:10.058012311 +0000 UTC m=+715.977798430" watchObservedRunningTime="2026-10-30 20:50:10.060673331 +0000 UTC m=+715.980459450"
Oct 30 20:50:13.207091 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:50:13.207044    6004 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w5-2b425d-7bd8f69d87-qtpmg"]
Oct 30 20:50:13.210728 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:50:13.210708    6004 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-2b425d-7bd8f69d87-qtpmg"
Oct 30 20:50:13.265957 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:50:13.265921    6004 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-worker-w5-2b425d-serving-cert\""
Oct 30 20:50:13.319526 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:50:13.319492    6004 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w5-2b425d-7bd8f69d87-qtpmg"]
Oct 30 20:50:13.324081 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:50:13.324029    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d7b91b87-18a8-42be-8652-137ee8b789a1-metrics-certs\") pod \"maas-api-e2e-worker-w5-2b425d-7bd8f69d87-qtpmg\" (UID: \"d7b91b87-18a8-42be-8652-137ee8b789a1\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-2b425d-7bd8f69d87-qtpmg"
Oct 30 20:50:13.324331 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:50:13.324300    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5mgqj\" (UniqueName: \"kubernetes.io/projected/d7b91b87-18a8-42be-8652-137ee8b789a1-kube-api-access-5mgqj\") pod \"maas-api-e2e-worker-w5-2b425d-7bd8f69d87-qtpmg\" (UID: \"d7b91b87-18a8-42be-8652-137ee8b789a1\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-2b425d-7bd8f69d87-qtpmg"
Oct 30 20:50:13.326599 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:50:13.324430    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d7b91b87-18a8-42be-8652-137ee8b789a1-openshift-service-ca\") pod \"maas-api-e2e-worker-w5-2b425d-7bd8f69d87-qtpmg\" (UID: \"d7b91b87-18a8-42be-8652-137ee8b789a1\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-2b425d-7bd8f69d87-qtpmg"
Oct 30 20:50:13.326951 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:50:13.326929    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d7b91b87-18a8-42be-8652-137ee8b789a1-maas-api-tls\") pod \"maas-api-e2e-worker-w5-2b425d-7bd8f69d87-qtpmg\" (UID: \"d7b91b87-18a8-42be-8652-137ee8b789a1\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-2b425d-7bd8f69d87-qtpmg"
Oct 30 20:50:13.428605 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:50:13.428569    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d7b91b87-18a8-42be-8652-137ee8b789a1-maas-api-tls\") pod \"maas-api-e2e-worker-w5-2b425d-7bd8f69d87-qtpmg\" (UID: \"d7b91b87-18a8-42be-8652-137ee8b789a1\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-2b425d-7bd8f69d87-qtpmg"
Oct 30 20:50:13.428772 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:50:13.428635    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d7b91b87-18a8-42be-8652-137ee8b789a1-metrics-certs\") pod \"maas-api-e2e-worker-w5-2b425d-7bd8f69d87-qtpmg\" (UID: \"d7b91b87-18a8-42be-8652-137ee8b789a1\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-2b425d-7bd8f69d87-qtpmg"
Oct 30 20:50:13.428772 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:50:13.428662    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5mgqj\" (UniqueName: \"kubernetes.io/projected/d7b91b87-18a8-42be-8652-137ee8b789a1-kube-api-access-5mgqj\") pod \"maas-api-e2e-worker-w5-2b425d-7bd8f69d87-qtpmg\" (UID: \"d7b91b87-18a8-42be-8652-137ee8b789a1\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-2b425d-7bd8f69d87-qtpmg"
Oct 30 20:50:13.428772 ip-10-0-138-85 kubenswrapper[6004]: E1030 20:50:13.428714    6004 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-worker-w5-2b425d-serving-cert: secret "maas-api-e2e-worker-w5-2b425d-serving-cert" not found
Oct 30 20:50:13.428772 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:50:13.428751    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d7b91b87-18a8-42be-8652-137ee8b789a1-openshift-service-ca\") pod \"maas-api-e2e-worker-w5-2b425d-7bd8f69d87-qtpmg\" (UID: \"d7b91b87-18a8-42be-8652-137ee8b789a1\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-2b425d-7bd8f69d87-qtpmg"
Oct 30 20:50:13.428933 ip-10-0-138-85 kubenswrapper[6004]: E1030 20:50:13.428798    6004 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d7b91b87-18a8-42be-8652-137ee8b789a1-maas-api-tls podName:d7b91b87-18a8-42be-8652-137ee8b789a1 nodeName:}" failed. No retries permitted until 2026-10-30 20:50:13.928773897 +0000 UTC m=+719.848559998 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/d7b91b87-18a8-42be-8652-137ee8b789a1-maas-api-tls") pod "maas-api-e2e-worker-w5-2b425d-7bd8f69d87-qtpmg" (UID: "d7b91b87-18a8-42be-8652-137ee8b789a1") : secret "maas-api-e2e-worker-w5-2b425d-serving-cert" not found
Oct 30 20:50:13.429562 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:50:13.429536    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d7b91b87-18a8-42be-8652-137ee8b789a1-openshift-service-ca\") pod \"maas-api-e2e-worker-w5-2b425d-7bd8f69d87-qtpmg\" (UID: \"d7b91b87-18a8-42be-8652-137ee8b789a1\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-2b425d-7bd8f69d87-qtpmg"
Oct 30 20:50:13.431139 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:50:13.431118    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d7b91b87-18a8-42be-8652-137ee8b789a1-metrics-certs\") pod \"maas-api-e2e-worker-w5-2b425d-7bd8f69d87-qtpmg\" (UID: \"d7b91b87-18a8-42be-8652-137ee8b789a1\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-2b425d-7bd8f69d87-qtpmg"
Oct 30 20:50:13.488155 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:50:13.488082    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5mgqj\" (UniqueName: \"kubernetes.io/projected/d7b91b87-18a8-42be-8652-137ee8b789a1-kube-api-access-5mgqj\") pod \"maas-api-e2e-worker-w5-2b425d-7bd8f69d87-qtpmg\" (UID: \"d7b91b87-18a8-42be-8652-137ee8b789a1\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-2b425d-7bd8f69d87-qtpmg"
Oct 30 20:50:13.933105 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:50:13.933074    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d7b91b87-18a8-42be-8652-137ee8b789a1-maas-api-tls\") pod \"maas-api-e2e-worker-w5-2b425d-7bd8f69d87-qtpmg\" (UID: \"d7b91b87-18a8-42be-8652-137ee8b789a1\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-2b425d-7bd8f69d87-qtpmg"
Oct 30 20:50:13.935602 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:50:13.935569    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d7b91b87-18a8-42be-8652-137ee8b789a1-maas-api-tls\") pod \"maas-api-e2e-worker-w5-2b425d-7bd8f69d87-qtpmg\" (UID: \"d7b91b87-18a8-42be-8652-137ee8b789a1\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-2b425d-7bd8f69d87-qtpmg"
Oct 30 20:50:14.123236 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:50:14.123196    6004 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-2b425d-7bd8f69d87-qtpmg"
Oct 30 20:50:14.289960 ip-10-0-138-85 kubenswrapper[6004]: E1030 20:50:14.289879    6004 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-zz4wr" containerName="extractor"
Oct 30 20:50:14.495362 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:50:14.495335    6004 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w5-2b425d-7bd8f69d87-qtpmg"]
Oct 30 20:50:14.497998 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:50:14.497972    6004 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd7b91b87_18a8_42be_8652_137ee8b789a1.slice/crio-7c85442bc6bc08b79a2739fcb0ad333d13b2b8b446c1e4fceeb340232d7a2dc1 WatchSource:0}: Error finding container 7c85442bc6bc08b79a2739fcb0ad333d13b2b8b446c1e4fceeb340232d7a2dc1: Status 404 returned error can't find the container with id 7c85442bc6bc08b79a2739fcb0ad333d13b2b8b446c1e4fceeb340232d7a2dc1
Oct 30 20:50:14.898210 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:50:14.898176    6004 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-2b425d-7bd8f69d87-qtpmg" event={"ID":"d7b91b87-18a8-42be-8652-137ee8b789a1","Type":"ContainerStarted","Data":"7c85442bc6bc08b79a2739fcb0ad333d13b2b8b446c1e4fceeb340232d7a2dc1"}
Oct 30 20:50:15.882924 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:50:15.882892    6004 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-682999-5f9fdd855f-jgrfb"
Oct 30 20:50:15.905684 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:50:15.905650    6004 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-2b425d-7bd8f69d87-qtpmg" event={"ID":"d7b91b87-18a8-42be-8652-137ee8b789a1","Type":"ContainerStarted","Data":"a462ef876272b72c1d55b97cc7a5bb2301e6d504294aa90e10a9bc4215a100dd"}
Oct 30 20:50:15.905853 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:50:15.905716    6004 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-2b425d-7bd8f69d87-qtpmg"
Oct 30 20:50:16.129031 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:50:16.128974    6004 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-2b425d-7bd8f69d87-qtpmg" podStartSLOduration=2.309101828 podStartE2EDuration="3.128958685s" totalImagesPullingTime="819.856857ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:50:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:50:16.126898278 +0000 UTC m=+722.046684397" watchObservedRunningTime="2026-10-30 20:50:16.128958685 +0000 UTC m=+722.048744799"
Oct 30 20:50:21.916801 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:50:21.916772    6004 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-2b425d-7bd8f69d87-qtpmg"
Oct 30 20:50:24.254427 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:50:24.254392    6004 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w1-f9f277-89dcd697f-45nmx"]
Oct 30 20:50:24.258357 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:50:24.258335    6004 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-f9f277-89dcd697f-45nmx"
Oct 30 20:50:24.317788 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:50:24.317749    6004 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-worker-w1-f9f277-serving-cert\""
Oct 30 20:50:24.319250 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:50:24.319223    6004 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w1-f9f277-89dcd697f-45nmx"]
Oct 30 20:50:24.335236 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:50:24.335205    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a651327d-e3a3-4fcb-8070-1e0deeb0ea90-openshift-service-ca\") pod \"maas-api-e2e-worker-w1-f9f277-89dcd697f-45nmx\" (UID: \"a651327d-e3a3-4fcb-8070-1e0deeb0ea90\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-f9f277-89dcd697f-45nmx"
Oct 30 20:50:24.335362 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:50:24.335288    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a651327d-e3a3-4fcb-8070-1e0deeb0ea90-maas-api-tls\") pod \"maas-api-e2e-worker-w1-f9f277-89dcd697f-45nmx\" (UID: \"a651327d-e3a3-4fcb-8070-1e0deeb0ea90\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-f9f277-89dcd697f-45nmx"
Oct 30 20:50:24.335416 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:50:24.335385    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a651327d-e3a3-4fcb-8070-1e0deeb0ea90-metrics-certs\") pod \"maas-api-e2e-worker-w1-f9f277-89dcd697f-45nmx\" (UID: \"a651327d-e3a3-4fcb-8070-1e0deeb0ea90\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-f9f277-89dcd697f-45nmx"
Oct 30 20:50:24.335506 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:50:24.335490    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bscvw\" (UniqueName: \"kubernetes.io/projected/a651327d-e3a3-4fcb-8070-1e0deeb0ea90-kube-api-access-bscvw\") pod \"maas-api-e2e-worker-w1-f9f277-89dcd697f-45nmx\" (UID: \"a651327d-e3a3-4fcb-8070-1e0deeb0ea90\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-f9f277-89dcd697f-45nmx"
Oct 30 20:50:24.436149 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:50:24.436110    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a651327d-e3a3-4fcb-8070-1e0deeb0ea90-maas-api-tls\") pod \"maas-api-e2e-worker-w1-f9f277-89dcd697f-45nmx\" (UID: \"a651327d-e3a3-4fcb-8070-1e0deeb0ea90\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-f9f277-89dcd697f-45nmx"
Oct 30 20:50:24.436149 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:50:24.436151    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a651327d-e3a3-4fcb-8070-1e0deeb0ea90-metrics-certs\") pod \"maas-api-e2e-worker-w1-f9f277-89dcd697f-45nmx\" (UID: \"a651327d-e3a3-4fcb-8070-1e0deeb0ea90\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-f9f277-89dcd697f-45nmx"
Oct 30 20:50:24.436358 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:50:24.436193    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bscvw\" (UniqueName: \"kubernetes.io/projected/a651327d-e3a3-4fcb-8070-1e0deeb0ea90-kube-api-access-bscvw\") pod \"maas-api-e2e-worker-w1-f9f277-89dcd697f-45nmx\" (UID: \"a651327d-e3a3-4fcb-8070-1e0deeb0ea90\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-f9f277-89dcd697f-45nmx"
Oct 30 20:50:24.436358 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:50:24.436238    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a651327d-e3a3-4fcb-8070-1e0deeb0ea90-openshift-service-ca\") pod \"maas-api-e2e-worker-w1-f9f277-89dcd697f-45nmx\" (UID: \"a651327d-e3a3-4fcb-8070-1e0deeb0ea90\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-f9f277-89dcd697f-45nmx"
Oct 30 20:50:24.436358 ip-10-0-138-85 kubenswrapper[6004]: E1030 20:50:24.436259    6004 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-worker-w1-f9f277-serving-cert: secret "maas-api-e2e-worker-w1-f9f277-serving-cert" not found
Oct 30 20:50:24.436358 ip-10-0-138-85 kubenswrapper[6004]: E1030 20:50:24.436323    6004 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a651327d-e3a3-4fcb-8070-1e0deeb0ea90-maas-api-tls podName:a651327d-e3a3-4fcb-8070-1e0deeb0ea90 nodeName:}" failed. No retries permitted until 2026-10-30 20:50:24.936307648 +0000 UTC m=+730.856093747 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/a651327d-e3a3-4fcb-8070-1e0deeb0ea90-maas-api-tls") pod "maas-api-e2e-worker-w1-f9f277-89dcd697f-45nmx" (UID: "a651327d-e3a3-4fcb-8070-1e0deeb0ea90") : secret "maas-api-e2e-worker-w1-f9f277-serving-cert" not found
Oct 30 20:50:24.436910 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:50:24.436888    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a651327d-e3a3-4fcb-8070-1e0deeb0ea90-openshift-service-ca\") pod \"maas-api-e2e-worker-w1-f9f277-89dcd697f-45nmx\" (UID: \"a651327d-e3a3-4fcb-8070-1e0deeb0ea90\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-f9f277-89dcd697f-45nmx"
Oct 30 20:50:24.438675 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:50:24.438652    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a651327d-e3a3-4fcb-8070-1e0deeb0ea90-metrics-certs\") pod \"maas-api-e2e-worker-w1-f9f277-89dcd697f-45nmx\" (UID: \"a651327d-e3a3-4fcb-8070-1e0deeb0ea90\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-f9f277-89dcd697f-45nmx"
Oct 30 20:50:24.493965 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:50:24.493932    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bscvw\" (UniqueName: \"kubernetes.io/projected/a651327d-e3a3-4fcb-8070-1e0deeb0ea90-kube-api-access-bscvw\") pod \"maas-api-e2e-worker-w1-f9f277-89dcd697f-45nmx\" (UID: \"a651327d-e3a3-4fcb-8070-1e0deeb0ea90\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-f9f277-89dcd697f-45nmx"
Oct 30 20:50:24.941629 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:50:24.941594    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a651327d-e3a3-4fcb-8070-1e0deeb0ea90-maas-api-tls\") pod \"maas-api-e2e-worker-w1-f9f277-89dcd697f-45nmx\" (UID: \"a651327d-e3a3-4fcb-8070-1e0deeb0ea90\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-f9f277-89dcd697f-45nmx"
Oct 30 20:50:24.943979 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:50:24.943953    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a651327d-e3a3-4fcb-8070-1e0deeb0ea90-maas-api-tls\") pod \"maas-api-e2e-worker-w1-f9f277-89dcd697f-45nmx\" (UID: \"a651327d-e3a3-4fcb-8070-1e0deeb0ea90\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-f9f277-89dcd697f-45nmx"
Oct 30 20:50:25.172853 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:50:25.172767    6004 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-f9f277-89dcd697f-45nmx"
Oct 30 20:50:25.550895 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:50:25.550870    6004 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w1-f9f277-89dcd697f-45nmx"]
Oct 30 20:50:25.552908 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:50:25.552877    6004 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda651327d_e3a3_4fcb_8070_1e0deeb0ea90.slice/crio-b620dab4b480e874a7e2177727e056bac564d6560c601e1384ea13c024e689d7 WatchSource:0}: Error finding container b620dab4b480e874a7e2177727e056bac564d6560c601e1384ea13c024e689d7: Status 404 returned error can't find the container with id b620dab4b480e874a7e2177727e056bac564d6560c601e1384ea13c024e689d7
Oct 30 20:50:25.962569 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:50:25.962532    6004 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-f9f277-89dcd697f-45nmx" event={"ID":"a651327d-e3a3-4fcb-8070-1e0deeb0ea90","Type":"ContainerStarted","Data":"b620dab4b480e874a7e2177727e056bac564d6560c601e1384ea13c024e689d7"}
Oct 30 20:50:26.970595 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:50:26.970551    6004 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-f9f277-89dcd697f-45nmx" event={"ID":"a651327d-e3a3-4fcb-8070-1e0deeb0ea90","Type":"ContainerStarted","Data":"f58af8fa5de7727afee975da444819862bd4f234b6549849df295e9124459e89"}
Oct 30 20:50:26.970965 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:50:26.970630    6004 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-f9f277-89dcd697f-45nmx"
Oct 30 20:50:27.090282 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:50:27.090230    6004 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-f9f277-89dcd697f-45nmx" podStartSLOduration=2.298349147 podStartE2EDuration="3.090216427s" totalImagesPullingTime="791.86728ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:50:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:50:27.088041325 +0000 UTC m=+733.007827444" watchObservedRunningTime="2026-10-30 20:50:27.090216427 +0000 UTC m=+733.010002578"
Oct 30 20:50:29.593712 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:50:29.593679    6004 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w6-8fa2a7-bcb7857c4-j462s"]
Oct 30 20:50:29.597472 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:50:29.597452    6004 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w6-8fa2a7-bcb7857c4-j462s"
Oct 30 20:50:29.651783 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:50:29.651750    6004 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-worker-w6-8fa2a7-serving-cert\""
Oct 30 20:50:29.693434 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:50:29.693397    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xldqk\" (UniqueName: \"kubernetes.io/projected/1e68c949-8e47-4bcd-afcd-780761bdc02a-kube-api-access-xldqk\") pod \"maas-api-e2e-worker-w6-8fa2a7-bcb7857c4-j462s\" (UID: \"1e68c949-8e47-4bcd-afcd-780761bdc02a\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w6-8fa2a7-bcb7857c4-j462s"
Oct 30 20:50:29.693603 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:50:29.693513    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1e68c949-8e47-4bcd-afcd-780761bdc02a-metrics-certs\") pod \"maas-api-e2e-worker-w6-8fa2a7-bcb7857c4-j462s\" (UID: \"1e68c949-8e47-4bcd-afcd-780761bdc02a\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w6-8fa2a7-bcb7857c4-j462s"
Oct 30 20:50:29.693645 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:50:29.693598    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1e68c949-8e47-4bcd-afcd-780761bdc02a-openshift-service-ca\") pod \"maas-api-e2e-worker-w6-8fa2a7-bcb7857c4-j462s\" (UID: \"1e68c949-8e47-4bcd-afcd-780761bdc02a\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w6-8fa2a7-bcb7857c4-j462s"
Oct 30 20:50:29.693740 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:50:29.693715    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1e68c949-8e47-4bcd-afcd-780761bdc02a-maas-api-tls\") pod \"maas-api-e2e-worker-w6-8fa2a7-bcb7857c4-j462s\" (UID: \"1e68c949-8e47-4bcd-afcd-780761bdc02a\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w6-8fa2a7-bcb7857c4-j462s"
Oct 30 20:50:29.703731 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:50:29.703701    6004 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w6-8fa2a7-bcb7857c4-j462s"]
Oct 30 20:50:29.794571 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:50:29.794540    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1e68c949-8e47-4bcd-afcd-780761bdc02a-openshift-service-ca\") pod \"maas-api-e2e-worker-w6-8fa2a7-bcb7857c4-j462s\" (UID: \"1e68c949-8e47-4bcd-afcd-780761bdc02a\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w6-8fa2a7-bcb7857c4-j462s"
Oct 30 20:50:29.794757 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:50:29.794593    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1e68c949-8e47-4bcd-afcd-780761bdc02a-maas-api-tls\") pod \"maas-api-e2e-worker-w6-8fa2a7-bcb7857c4-j462s\" (UID: \"1e68c949-8e47-4bcd-afcd-780761bdc02a\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w6-8fa2a7-bcb7857c4-j462s"
Oct 30 20:50:29.794757 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:50:29.794620    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xldqk\" (UniqueName: \"kubernetes.io/projected/1e68c949-8e47-4bcd-afcd-780761bdc02a-kube-api-access-xldqk\") pod \"maas-api-e2e-worker-w6-8fa2a7-bcb7857c4-j462s\" (UID: \"1e68c949-8e47-4bcd-afcd-780761bdc02a\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w6-8fa2a7-bcb7857c4-j462s"
Oct 30 20:50:29.794757 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:50:29.794666    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1e68c949-8e47-4bcd-afcd-780761bdc02a-metrics-certs\") pod \"maas-api-e2e-worker-w6-8fa2a7-bcb7857c4-j462s\" (UID: \"1e68c949-8e47-4bcd-afcd-780761bdc02a\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w6-8fa2a7-bcb7857c4-j462s"
Oct 30 20:50:29.794757 ip-10-0-138-85 kubenswrapper[6004]: E1030 20:50:29.794716    6004 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-worker-w6-8fa2a7-serving-cert: secret "maas-api-e2e-worker-w6-8fa2a7-serving-cert" not found
Oct 30 20:50:29.794921 ip-10-0-138-85 kubenswrapper[6004]: E1030 20:50:29.794805    6004 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1e68c949-8e47-4bcd-afcd-780761bdc02a-maas-api-tls podName:1e68c949-8e47-4bcd-afcd-780761bdc02a nodeName:}" failed. No retries permitted until 2026-10-30 20:50:30.294784078 +0000 UTC m=+736.214570176 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/1e68c949-8e47-4bcd-afcd-780761bdc02a-maas-api-tls") pod "maas-api-e2e-worker-w6-8fa2a7-bcb7857c4-j462s" (UID: "1e68c949-8e47-4bcd-afcd-780761bdc02a") : secret "maas-api-e2e-worker-w6-8fa2a7-serving-cert" not found
Oct 30 20:50:29.795460 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:50:29.795439    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1e68c949-8e47-4bcd-afcd-780761bdc02a-openshift-service-ca\") pod \"maas-api-e2e-worker-w6-8fa2a7-bcb7857c4-j462s\" (UID: \"1e68c949-8e47-4bcd-afcd-780761bdc02a\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w6-8fa2a7-bcb7857c4-j462s"
Oct 30 20:50:29.797224 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:50:29.797205    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1e68c949-8e47-4bcd-afcd-780761bdc02a-metrics-certs\") pod \"maas-api-e2e-worker-w6-8fa2a7-bcb7857c4-j462s\" (UID: \"1e68c949-8e47-4bcd-afcd-780761bdc02a\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w6-8fa2a7-bcb7857c4-j462s"
Oct 30 20:50:29.854278 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:50:29.854207    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xldqk\" (UniqueName: \"kubernetes.io/projected/1e68c949-8e47-4bcd-afcd-780761bdc02a-kube-api-access-xldqk\") pod \"maas-api-e2e-worker-w6-8fa2a7-bcb7857c4-j462s\" (UID: \"1e68c949-8e47-4bcd-afcd-780761bdc02a\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w6-8fa2a7-bcb7857c4-j462s"
Oct 30 20:50:30.299334 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:50:30.299300    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1e68c949-8e47-4bcd-afcd-780761bdc02a-maas-api-tls\") pod \"maas-api-e2e-worker-w6-8fa2a7-bcb7857c4-j462s\" (UID: \"1e68c949-8e47-4bcd-afcd-780761bdc02a\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w6-8fa2a7-bcb7857c4-j462s"
Oct 30 20:50:30.301797 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:50:30.301769    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1e68c949-8e47-4bcd-afcd-780761bdc02a-maas-api-tls\") pod \"maas-api-e2e-worker-w6-8fa2a7-bcb7857c4-j462s\" (UID: \"1e68c949-8e47-4bcd-afcd-780761bdc02a\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w6-8fa2a7-bcb7857c4-j462s"
Oct 30 20:50:30.510771 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:50:30.510738    6004 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w6-8fa2a7-bcb7857c4-j462s"
Oct 30 20:50:30.889572 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:50:30.889483    6004 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w6-8fa2a7-bcb7857c4-j462s"]
Oct 30 20:50:30.893109 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:50:30.893080    6004 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1e68c949_8e47_4bcd_afcd_780761bdc02a.slice/crio-5f69600652ca5347a689e57dcb524696219bb2309261c34de84429fc2e06a611 WatchSource:0}: Error finding container 5f69600652ca5347a689e57dcb524696219bb2309261c34de84429fc2e06a611: Status 404 returned error can't find the container with id 5f69600652ca5347a689e57dcb524696219bb2309261c34de84429fc2e06a611
Oct 30 20:50:31.004584 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:50:31.004541    6004 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w6-8fa2a7-bcb7857c4-j462s" event={"ID":"1e68c949-8e47-4bcd-afcd-780761bdc02a","Type":"ContainerStarted","Data":"5f69600652ca5347a689e57dcb524696219bb2309261c34de84429fc2e06a611"}
Oct 30 20:50:32.010874 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:50:32.010788    6004 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w6-8fa2a7-bcb7857c4-j462s" event={"ID":"1e68c949-8e47-4bcd-afcd-780761bdc02a","Type":"ContainerStarted","Data":"3287f610fb0f82463a75a5cbb4618ff3f383294f185afb1550823b66cdffe6fa"}
Oct 30 20:50:32.010874 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:50:32.010870    6004 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w6-8fa2a7-bcb7857c4-j462s"
Oct 30 20:50:32.130356 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:50:32.130308    6004 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w6-8fa2a7-bcb7857c4-j462s" podStartSLOduration=2.317668224 podStartE2EDuration="3.130294111s" totalImagesPullingTime="812.625887ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:50:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:50:32.129020538 +0000 UTC m=+738.048806656" watchObservedRunningTime="2026-10-30 20:50:32.130294111 +0000 UTC m=+738.050080229"
Oct 30 20:50:32.987940 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:50:32.987911    6004 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-f9f277-89dcd697f-45nmx"
Oct 30 20:50:38.021891 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:50:38.021858    6004 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w6-8fa2a7-bcb7857c4-j462s"
Oct 30 20:50:39.732941 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:50:39.732899    6004 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w0-781058-774f49c6f8-vlsxt"]
Oct 30 20:50:39.738399 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:50:39.738366    6004 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-781058-774f49c6f8-vlsxt"
Oct 30 20:50:39.792950 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:50:39.792918    6004 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-worker-w0-781058-serving-cert\""
Oct 30 20:50:39.845356 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:50:39.845324    6004 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w0-781058-774f49c6f8-vlsxt"]
Oct 30 20:50:39.891524 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:50:39.891488    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ffe16c53-414f-495c-b864-497edeab3871-metrics-certs\") pod \"maas-api-e2e-worker-w0-781058-774f49c6f8-vlsxt\" (UID: \"ffe16c53-414f-495c-b864-497edeab3871\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-781058-774f49c6f8-vlsxt"
Oct 30 20:50:39.891710 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:50:39.891556    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ffe16c53-414f-495c-b864-497edeab3871-maas-api-tls\") pod \"maas-api-e2e-worker-w0-781058-774f49c6f8-vlsxt\" (UID: \"ffe16c53-414f-495c-b864-497edeab3871\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-781058-774f49c6f8-vlsxt"
Oct 30 20:50:39.891710 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:50:39.891651    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lzfrs\" (UniqueName: \"kubernetes.io/projected/ffe16c53-414f-495c-b864-497edeab3871-kube-api-access-lzfrs\") pod \"maas-api-e2e-worker-w0-781058-774f49c6f8-vlsxt\" (UID: \"ffe16c53-414f-495c-b864-497edeab3871\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-781058-774f49c6f8-vlsxt"
Oct 30 20:50:39.891710 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:50:39.891687    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ffe16c53-414f-495c-b864-497edeab3871-openshift-service-ca\") pod \"maas-api-e2e-worker-w0-781058-774f49c6f8-vlsxt\" (UID: \"ffe16c53-414f-495c-b864-497edeab3871\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-781058-774f49c6f8-vlsxt"
Oct 30 20:50:39.992963 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:50:39.992873    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ffe16c53-414f-495c-b864-497edeab3871-metrics-certs\") pod \"maas-api-e2e-worker-w0-781058-774f49c6f8-vlsxt\" (UID: \"ffe16c53-414f-495c-b864-497edeab3871\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-781058-774f49c6f8-vlsxt"
Oct 30 20:50:39.993166 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:50:39.992983    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ffe16c53-414f-495c-b864-497edeab3871-maas-api-tls\") pod \"maas-api-e2e-worker-w0-781058-774f49c6f8-vlsxt\" (UID: \"ffe16c53-414f-495c-b864-497edeab3871\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-781058-774f49c6f8-vlsxt"
Oct 30 20:50:39.993166 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:50:39.993014    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lzfrs\" (UniqueName: \"kubernetes.io/projected/ffe16c53-414f-495c-b864-497edeab3871-kube-api-access-lzfrs\") pod \"maas-api-e2e-worker-w0-781058-774f49c6f8-vlsxt\" (UID: \"ffe16c53-414f-495c-b864-497edeab3871\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-781058-774f49c6f8-vlsxt"
Oct 30 20:50:39.993166 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:50:39.993043    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ffe16c53-414f-495c-b864-497edeab3871-openshift-service-ca\") pod \"maas-api-e2e-worker-w0-781058-774f49c6f8-vlsxt\" (UID: \"ffe16c53-414f-495c-b864-497edeab3871\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-781058-774f49c6f8-vlsxt"
Oct 30 20:50:39.993352 ip-10-0-138-85 kubenswrapper[6004]: E1030 20:50:39.993192    6004 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-worker-w0-781058-serving-cert: secret "maas-api-e2e-worker-w0-781058-serving-cert" not found
Oct 30 20:50:39.993352 ip-10-0-138-85 kubenswrapper[6004]: E1030 20:50:39.993279    6004 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ffe16c53-414f-495c-b864-497edeab3871-maas-api-tls podName:ffe16c53-414f-495c-b864-497edeab3871 nodeName:}" failed. No retries permitted until 2026-10-30 20:50:40.493255925 +0000 UTC m=+746.413042039 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/ffe16c53-414f-495c-b864-497edeab3871-maas-api-tls") pod "maas-api-e2e-worker-w0-781058-774f49c6f8-vlsxt" (UID: "ffe16c53-414f-495c-b864-497edeab3871") : secret "maas-api-e2e-worker-w0-781058-serving-cert" not found
Oct 30 20:50:39.994030 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:50:39.994002    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ffe16c53-414f-495c-b864-497edeab3871-openshift-service-ca\") pod \"maas-api-e2e-worker-w0-781058-774f49c6f8-vlsxt\" (UID: \"ffe16c53-414f-495c-b864-497edeab3871\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-781058-774f49c6f8-vlsxt"
Oct 30 20:50:39.995724 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:50:39.995702    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ffe16c53-414f-495c-b864-497edeab3871-metrics-certs\") pod \"maas-api-e2e-worker-w0-781058-774f49c6f8-vlsxt\" (UID: \"ffe16c53-414f-495c-b864-497edeab3871\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-781058-774f49c6f8-vlsxt"
Oct 30 20:50:40.053766 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:50:40.053733    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lzfrs\" (UniqueName: \"kubernetes.io/projected/ffe16c53-414f-495c-b864-497edeab3871-kube-api-access-lzfrs\") pod \"maas-api-e2e-worker-w0-781058-774f49c6f8-vlsxt\" (UID: \"ffe16c53-414f-495c-b864-497edeab3871\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-781058-774f49c6f8-vlsxt"
Oct 30 20:50:40.497338 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:50:40.497303    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ffe16c53-414f-495c-b864-497edeab3871-maas-api-tls\") pod \"maas-api-e2e-worker-w0-781058-774f49c6f8-vlsxt\" (UID: \"ffe16c53-414f-495c-b864-497edeab3871\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-781058-774f49c6f8-vlsxt"
Oct 30 20:50:40.499678 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:50:40.499657    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ffe16c53-414f-495c-b864-497edeab3871-maas-api-tls\") pod \"maas-api-e2e-worker-w0-781058-774f49c6f8-vlsxt\" (UID: \"ffe16c53-414f-495c-b864-497edeab3871\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-781058-774f49c6f8-vlsxt"
Oct 30 20:50:40.652668 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:50:40.652633    6004 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-781058-774f49c6f8-vlsxt"
Oct 30 20:50:41.033529 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:50:41.033503    6004 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w0-781058-774f49c6f8-vlsxt"]
Oct 30 20:50:41.036930 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:50:41.036897    6004 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podffe16c53_414f_495c_b864_497edeab3871.slice/crio-7e02d5f7443fb1c2a1604eccc498f0df8c37ed7a836d69c25ff4486327cdfe95 WatchSource:0}: Error finding container 7e02d5f7443fb1c2a1604eccc498f0df8c37ed7a836d69c25ff4486327cdfe95: Status 404 returned error can't find the container with id 7e02d5f7443fb1c2a1604eccc498f0df8c37ed7a836d69c25ff4486327cdfe95
Oct 30 20:50:41.066902 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:50:41.066866    6004 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-781058-774f49c6f8-vlsxt" event={"ID":"ffe16c53-414f-495c-b864-497edeab3871","Type":"ContainerStarted","Data":"7e02d5f7443fb1c2a1604eccc498f0df8c37ed7a836d69c25ff4486327cdfe95"}
Oct 30 20:50:42.074032 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:50:42.073998    6004 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-781058-774f49c6f8-vlsxt" event={"ID":"ffe16c53-414f-495c-b864-497edeab3871","Type":"ContainerStarted","Data":"b7f168528fb575257129486e93348a0aa6bb7e2ce10e8bd78a3ccfb943f420b6"}
Oct 30 20:50:42.074431 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:50:42.074192    6004 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-781058-774f49c6f8-vlsxt"
Oct 30 20:50:42.194969 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:50:42.194916    6004 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-781058-774f49c6f8-vlsxt" podStartSLOduration=2.386619222 podStartE2EDuration="3.19490324s" totalImagesPullingTime="808.284018ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:50:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:50:42.192648456 +0000 UTC m=+748.112434586" watchObservedRunningTime="2026-10-30 20:50:42.19490324 +0000 UTC m=+748.114689390"
Oct 30 20:50:44.286544 ip-10-0-138-85 kubenswrapper[6004]: E1030 20:50:44.286500    6004 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-zz4wr" containerName="extractor"
Oct 30 20:50:48.084331 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:50:48.084303    6004 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-781058-774f49c6f8-vlsxt"
Oct 30 20:50:50.233901 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:50:50.233862    6004 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w2-d061d0-5967747b86-mkwwq"]
Oct 30 20:50:50.260734 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:50:50.260702    6004 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-d061d0-5967747b86-mkwwq"
Oct 30 20:50:50.295252 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:50:50.295183    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2193d3b6-6d8c-4060-8337-7d3d431179a9-maas-api-tls\") pod \"maas-api-e2e-worker-w2-d061d0-5967747b86-mkwwq\" (UID: \"2193d3b6-6d8c-4060-8337-7d3d431179a9\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-d061d0-5967747b86-mkwwq"
Oct 30 20:50:50.295465 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:50:50.295436    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2193d3b6-6d8c-4060-8337-7d3d431179a9-openshift-service-ca\") pod \"maas-api-e2e-worker-w2-d061d0-5967747b86-mkwwq\" (UID: \"2193d3b6-6d8c-4060-8337-7d3d431179a9\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-d061d0-5967747b86-mkwwq"
Oct 30 20:50:50.295667 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:50:50.295640    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2193d3b6-6d8c-4060-8337-7d3d431179a9-metrics-certs\") pod \"maas-api-e2e-worker-w2-d061d0-5967747b86-mkwwq\" (UID: \"2193d3b6-6d8c-4060-8337-7d3d431179a9\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-d061d0-5967747b86-mkwwq"
Oct 30 20:50:50.295775 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:50:50.295743    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x64c8\" (UniqueName: \"kubernetes.io/projected/2193d3b6-6d8c-4060-8337-7d3d431179a9-kube-api-access-x64c8\") pod \"maas-api-e2e-worker-w2-d061d0-5967747b86-mkwwq\" (UID: \"2193d3b6-6d8c-4060-8337-7d3d431179a9\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-d061d0-5967747b86-mkwwq"
Oct 30 20:50:50.297155 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:50:50.297132    6004 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w2-d061d0-5967747b86-mkwwq"]
Oct 30 20:50:50.349306 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:50:50.349275    6004 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-worker-w2-d061d0-serving-cert\""
Oct 30 20:50:50.397420 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:50:50.397374    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2193d3b6-6d8c-4060-8337-7d3d431179a9-openshift-service-ca\") pod \"maas-api-e2e-worker-w2-d061d0-5967747b86-mkwwq\" (UID: \"2193d3b6-6d8c-4060-8337-7d3d431179a9\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-d061d0-5967747b86-mkwwq"
Oct 30 20:50:50.397606 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:50:50.397438    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2193d3b6-6d8c-4060-8337-7d3d431179a9-metrics-certs\") pod \"maas-api-e2e-worker-w2-d061d0-5967747b86-mkwwq\" (UID: \"2193d3b6-6d8c-4060-8337-7d3d431179a9\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-d061d0-5967747b86-mkwwq"
Oct 30 20:50:50.397606 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:50:50.397551    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x64c8\" (UniqueName: \"kubernetes.io/projected/2193d3b6-6d8c-4060-8337-7d3d431179a9-kube-api-access-x64c8\") pod \"maas-api-e2e-worker-w2-d061d0-5967747b86-mkwwq\" (UID: \"2193d3b6-6d8c-4060-8337-7d3d431179a9\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-d061d0-5967747b86-mkwwq"
Oct 30 20:50:50.397706 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:50:50.397610    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2193d3b6-6d8c-4060-8337-7d3d431179a9-maas-api-tls\") pod \"maas-api-e2e-worker-w2-d061d0-5967747b86-mkwwq\" (UID: \"2193d3b6-6d8c-4060-8337-7d3d431179a9\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-d061d0-5967747b86-mkwwq"
Oct 30 20:50:50.397765 ip-10-0-138-85 kubenswrapper[6004]: E1030 20:50:50.397715    6004 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-worker-w2-d061d0-serving-cert: secret "maas-api-e2e-worker-w2-d061d0-serving-cert" not found
Oct 30 20:50:50.397842 ip-10-0-138-85 kubenswrapper[6004]: E1030 20:50:50.397819    6004 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2193d3b6-6d8c-4060-8337-7d3d431179a9-maas-api-tls podName:2193d3b6-6d8c-4060-8337-7d3d431179a9 nodeName:}" failed. No retries permitted until 2026-10-30 20:50:50.897796613 +0000 UTC m=+756.817582724 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/2193d3b6-6d8c-4060-8337-7d3d431179a9-maas-api-tls") pod "maas-api-e2e-worker-w2-d061d0-5967747b86-mkwwq" (UID: "2193d3b6-6d8c-4060-8337-7d3d431179a9") : secret "maas-api-e2e-worker-w2-d061d0-serving-cert" not found
Oct 30 20:50:50.398370 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:50:50.398342    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2193d3b6-6d8c-4060-8337-7d3d431179a9-openshift-service-ca\") pod \"maas-api-e2e-worker-w2-d061d0-5967747b86-mkwwq\" (UID: \"2193d3b6-6d8c-4060-8337-7d3d431179a9\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-d061d0-5967747b86-mkwwq"
Oct 30 20:50:50.400311 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:50:50.400286    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2193d3b6-6d8c-4060-8337-7d3d431179a9-metrics-certs\") pod \"maas-api-e2e-worker-w2-d061d0-5967747b86-mkwwq\" (UID: \"2193d3b6-6d8c-4060-8337-7d3d431179a9\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-d061d0-5967747b86-mkwwq"
Oct 30 20:50:50.472989 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:50:50.472949    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x64c8\" (UniqueName: \"kubernetes.io/projected/2193d3b6-6d8c-4060-8337-7d3d431179a9-kube-api-access-x64c8\") pod \"maas-api-e2e-worker-w2-d061d0-5967747b86-mkwwq\" (UID: \"2193d3b6-6d8c-4060-8337-7d3d431179a9\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-d061d0-5967747b86-mkwwq"
Oct 30 20:50:50.903855 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:50:50.903820    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2193d3b6-6d8c-4060-8337-7d3d431179a9-maas-api-tls\") pod \"maas-api-e2e-worker-w2-d061d0-5967747b86-mkwwq\" (UID: \"2193d3b6-6d8c-4060-8337-7d3d431179a9\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-d061d0-5967747b86-mkwwq"
Oct 30 20:50:50.906508 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:50:50.906477    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2193d3b6-6d8c-4060-8337-7d3d431179a9-maas-api-tls\") pod \"maas-api-e2e-worker-w2-d061d0-5967747b86-mkwwq\" (UID: \"2193d3b6-6d8c-4060-8337-7d3d431179a9\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-d061d0-5967747b86-mkwwq"
Oct 30 20:50:51.180452 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:50:51.180427    6004 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-d061d0-5967747b86-mkwwq"
Oct 30 20:50:51.566070 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:50:51.566029    6004 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w2-d061d0-5967747b86-mkwwq"]
Oct 30 20:50:51.568372 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:50:51.568343    6004 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2193d3b6_6d8c_4060_8337_7d3d431179a9.slice/crio-4a61a0162c656fcb86b7746b9886621702ecd8b0c11be2e6d9b4e245bae06242 WatchSource:0}: Error finding container 4a61a0162c656fcb86b7746b9886621702ecd8b0c11be2e6d9b4e245bae06242: Status 404 returned error can't find the container with id 4a61a0162c656fcb86b7746b9886621702ecd8b0c11be2e6d9b4e245bae06242
Oct 30 20:50:52.133714 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:50:52.133672    6004 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-d061d0-5967747b86-mkwwq" event={"ID":"2193d3b6-6d8c-4060-8337-7d3d431179a9","Type":"ContainerStarted","Data":"4a61a0162c656fcb86b7746b9886621702ecd8b0c11be2e6d9b4e245bae06242"}
Oct 30 20:50:53.163527 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:50:53.163487    6004 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-d061d0-5967747b86-mkwwq" event={"ID":"2193d3b6-6d8c-4060-8337-7d3d431179a9","Type":"ContainerStarted","Data":"ae65d3386d3a951222fb76599f00cbc37f05bf9535ba61047203cfe99e5a0227"}
Oct 30 20:50:53.163954 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:50:53.163558    6004 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-d061d0-5967747b86-mkwwq"
Oct 30 20:50:53.285010 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:50:53.284937    6004 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-d061d0-5967747b86-mkwwq" podStartSLOduration=2.464247293 podStartE2EDuration="3.284914103s" totalImagesPullingTime="820.66681ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:50:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:50:53.282932312 +0000 UTC m=+759.202718433" watchObservedRunningTime="2026-10-30 20:50:53.284914103 +0000 UTC m=+759.204700226"
Oct 30 20:50:58.193352 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:50:58.193319    6004 generic.go:356] "Generic (PLEG): container finished" podID="d8c44f87-9b8f-4838-bd12-d48dd55a08d0" containerID="800e1e6882eeb4616d2615d0e9b78a9f22722f55df2dfceb33c58c8a1b32eef6" exitCode=0
Oct 30 20:50:58.193871 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:50:58.193393    6004 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-781058-openshift-default-55fb495b7-6mqk2" event={"ID":"d8c44f87-9b8f-4838-bd12-d48dd55a08d0","Type":"ContainerDied","Data":"800e1e6882eeb4616d2615d0e9b78a9f22722f55df2dfceb33c58c8a1b32eef6"}
Oct 30 20:50:58.193944 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:50:58.193882    6004 scope.go:122] "RemoveContainer" containerID="800e1e6882eeb4616d2615d0e9b78a9f22722f55df2dfceb33c58c8a1b32eef6"
Oct 30 20:50:58.195209 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:50:58.195176    6004 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 20:50:58.195301 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:50:58.195248    6004 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 20:50:58.195301 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:50:58.195280    6004 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 20:50:59.175998 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:50:59.175967    6004 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-d061d0-5967747b86-mkwwq"
Oct 30 20:50:59.200634 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:50:59.200602    6004 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-781058-openshift-default-55fb495b7-6mqk2" event={"ID":"d8c44f87-9b8f-4838-bd12-d48dd55a08d0","Type":"ContainerStarted","Data":"5c65a9825e6b085f3676f2e77d0bc521bf7555cc2c794fb5ba1cce9c60d79d03"}
Oct 30 20:50:59.373682 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:50:59.373645    6004 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w0-781058-openshift-default-55fb495b7-6mqk2"
Oct 30 20:50:59.374695 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:50:59.374668    6004 patch_prober.go:29] interesting pod/e2e-worker-w0-781058-openshift-default-55fb495b7-6mqk2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" start-of-body=
Oct 30 20:50:59.374837 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:50:59.374725    6004 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-781058-openshift-default-55fb495b7-6mqk2" podUID="d8c44f87-9b8f-4838-bd12-d48dd55a08d0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused"
Oct 30 20:51:00.373926 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:51:00.373892    6004 patch_prober.go:29] interesting pod/e2e-worker-w0-781058-openshift-default-55fb495b7-6mqk2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" start-of-body=
Oct 30 20:51:00.374357 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:51:00.373952    6004 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-781058-openshift-default-55fb495b7-6mqk2" podUID="d8c44f87-9b8f-4838-bd12-d48dd55a08d0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused"
Oct 30 20:51:00.818689 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:51:00.818651    6004 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w0-781058-openshift-default-55fb495b7-6mqk2"
Oct 30 20:51:01.373620 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:51:01.373580    6004 patch_prober.go:29] interesting pod/e2e-worker-w0-781058-openshift-default-55fb495b7-6mqk2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" start-of-body=
Oct 30 20:51:01.373813 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:51:01.373650    6004 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-781058-openshift-default-55fb495b7-6mqk2" podUID="d8c44f87-9b8f-4838-bd12-d48dd55a08d0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused"
Oct 30 20:51:02.373583 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:51:02.373542    6004 patch_prober.go:29] interesting pod/e2e-worker-w0-781058-openshift-default-55fb495b7-6mqk2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" start-of-body=
Oct 30 20:51:02.374016 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:51:02.373611    6004 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-781058-openshift-default-55fb495b7-6mqk2" podUID="d8c44f87-9b8f-4838-bd12-d48dd55a08d0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused"
Oct 30 20:51:03.373305 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:51:03.373270    6004 patch_prober.go:29] interesting pod/e2e-worker-w0-781058-openshift-default-55fb495b7-6mqk2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" start-of-body=
Oct 30 20:51:03.373484 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:51:03.373324    6004 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-781058-openshift-default-55fb495b7-6mqk2" podUID="d8c44f87-9b8f-4838-bd12-d48dd55a08d0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused"
Oct 30 20:51:04.373879 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:51:04.373844    6004 patch_prober.go:29] interesting pod/e2e-worker-w0-781058-openshift-default-55fb495b7-6mqk2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" start-of-body=
Oct 30 20:51:04.374323 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:51:04.373896    6004 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-781058-openshift-default-55fb495b7-6mqk2" podUID="d8c44f87-9b8f-4838-bd12-d48dd55a08d0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused"
Oct 30 20:51:05.377525 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:51:05.377488    6004 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w0-781058-openshift-default-55fb495b7-6mqk2"
Oct 30 20:51:05.378448 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:51:05.378427    6004 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w0-781058-openshift-default-55fb495b7-6mqk2"
Oct 30 20:51:14.292290 ip-10-0-138-85 kubenswrapper[6004]: E1030 20:51:14.292225    6004 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-zz4wr" containerName="extractor"
Oct 30 20:51:44.287634 ip-10-0-138-85 kubenswrapper[6004]: E1030 20:51:44.287591    6004 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-zz4wr" containerName="extractor"
Oct 30 20:52:14.285659 ip-10-0-138-85 kubenswrapper[6004]: E1030 20:52:14.285620    6004 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-zz4wr" containerName="extractor"
Oct 30 20:52:44.287591 ip-10-0-138-85 kubenswrapper[6004]: E1030 20:52:44.287553    6004 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-zz4wr" containerName="extractor"
Oct 30 20:52:58.512823 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:52:58.512783    6004 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w3-682999-openshift-default-54dcb797b5-lpdjd"]
Oct 30 20:52:58.516824 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:52:58.516800    6004 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-682999-openshift-default-54dcb797b5-lpdjd"
Oct 30 20:52:58.569759 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:52:58.569730    6004 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w3-682999-openshift-default-dockercfg-g27tl\""
Oct 30 20:52:58.608199 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:52:58.608160    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c155b964-e4f8-4a92-bcee-49cc435550b7-istio-envoy\") pod \"e2e-worker-w3-682999-openshift-default-54dcb797b5-lpdjd\" (UID: \"c155b964-e4f8-4a92-bcee-49cc435550b7\") " pod="openshift-ingress/e2e-worker-w3-682999-openshift-default-54dcb797b5-lpdjd"
Oct 30 20:52:58.608350 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:52:58.608261    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c155b964-e4f8-4a92-bcee-49cc435550b7-workload-certs\") pod \"e2e-worker-w3-682999-openshift-default-54dcb797b5-lpdjd\" (UID: \"c155b964-e4f8-4a92-bcee-49cc435550b7\") " pod="openshift-ingress/e2e-worker-w3-682999-openshift-default-54dcb797b5-lpdjd"
Oct 30 20:52:58.608350 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:52:58.608284    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c155b964-e4f8-4a92-bcee-49cc435550b7-istio-podinfo\") pod \"e2e-worker-w3-682999-openshift-default-54dcb797b5-lpdjd\" (UID: \"c155b964-e4f8-4a92-bcee-49cc435550b7\") " pod="openshift-ingress/e2e-worker-w3-682999-openshift-default-54dcb797b5-lpdjd"
Oct 30 20:52:58.608429 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:52:58.608385    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c155b964-e4f8-4a92-bcee-49cc435550b7-istio-token\") pod \"e2e-worker-w3-682999-openshift-default-54dcb797b5-lpdjd\" (UID: \"c155b964-e4f8-4a92-bcee-49cc435550b7\") " pod="openshift-ingress/e2e-worker-w3-682999-openshift-default-54dcb797b5-lpdjd"
Oct 30 20:52:58.608471 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:52:58.608434    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c155b964-e4f8-4a92-bcee-49cc435550b7-istiod-ca-cert\") pod \"e2e-worker-w3-682999-openshift-default-54dcb797b5-lpdjd\" (UID: \"c155b964-e4f8-4a92-bcee-49cc435550b7\") " pod="openshift-ingress/e2e-worker-w3-682999-openshift-default-54dcb797b5-lpdjd"
Oct 30 20:52:58.608552 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:52:58.608488    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c155b964-e4f8-4a92-bcee-49cc435550b7-workload-socket\") pod \"e2e-worker-w3-682999-openshift-default-54dcb797b5-lpdjd\" (UID: \"c155b964-e4f8-4a92-bcee-49cc435550b7\") " pod="openshift-ingress/e2e-worker-w3-682999-openshift-default-54dcb797b5-lpdjd"
Oct 30 20:52:58.608552 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:52:58.608522    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c155b964-e4f8-4a92-bcee-49cc435550b7-credential-socket\") pod \"e2e-worker-w3-682999-openshift-default-54dcb797b5-lpdjd\" (UID: \"c155b964-e4f8-4a92-bcee-49cc435550b7\") " pod="openshift-ingress/e2e-worker-w3-682999-openshift-default-54dcb797b5-lpdjd"
Oct 30 20:52:58.608552 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:52:58.608541    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c155b964-e4f8-4a92-bcee-49cc435550b7-istio-data\") pod \"e2e-worker-w3-682999-openshift-default-54dcb797b5-lpdjd\" (UID: \"c155b964-e4f8-4a92-bcee-49cc435550b7\") " pod="openshift-ingress/e2e-worker-w3-682999-openshift-default-54dcb797b5-lpdjd"
Oct 30 20:52:58.608657 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:52:58.608561    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-flzbw\" (UniqueName: \"kubernetes.io/projected/c155b964-e4f8-4a92-bcee-49cc435550b7-kube-api-access-flzbw\") pod \"e2e-worker-w3-682999-openshift-default-54dcb797b5-lpdjd\" (UID: \"c155b964-e4f8-4a92-bcee-49cc435550b7\") " pod="openshift-ingress/e2e-worker-w3-682999-openshift-default-54dcb797b5-lpdjd"
Oct 30 20:52:58.622738 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:52:58.622710    6004 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w3-682999-openshift-default-54dcb797b5-lpdjd"]
Oct 30 20:52:58.710116 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:52:58.710080    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c155b964-e4f8-4a92-bcee-49cc435550b7-credential-socket\") pod \"e2e-worker-w3-682999-openshift-default-54dcb797b5-lpdjd\" (UID: \"c155b964-e4f8-4a92-bcee-49cc435550b7\") " pod="openshift-ingress/e2e-worker-w3-682999-openshift-default-54dcb797b5-lpdjd"
Oct 30 20:52:58.710261 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:52:58.710123    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c155b964-e4f8-4a92-bcee-49cc435550b7-istio-data\") pod \"e2e-worker-w3-682999-openshift-default-54dcb797b5-lpdjd\" (UID: \"c155b964-e4f8-4a92-bcee-49cc435550b7\") " pod="openshift-ingress/e2e-worker-w3-682999-openshift-default-54dcb797b5-lpdjd"
Oct 30 20:52:58.710261 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:52:58.710150    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-flzbw\" (UniqueName: \"kubernetes.io/projected/c155b964-e4f8-4a92-bcee-49cc435550b7-kube-api-access-flzbw\") pod \"e2e-worker-w3-682999-openshift-default-54dcb797b5-lpdjd\" (UID: \"c155b964-e4f8-4a92-bcee-49cc435550b7\") " pod="openshift-ingress/e2e-worker-w3-682999-openshift-default-54dcb797b5-lpdjd"
Oct 30 20:52:58.710261 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:52:58.710241    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c155b964-e4f8-4a92-bcee-49cc435550b7-istio-envoy\") pod \"e2e-worker-w3-682999-openshift-default-54dcb797b5-lpdjd\" (UID: \"c155b964-e4f8-4a92-bcee-49cc435550b7\") " pod="openshift-ingress/e2e-worker-w3-682999-openshift-default-54dcb797b5-lpdjd"
Oct 30 20:52:58.710370 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:52:58.710310    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c155b964-e4f8-4a92-bcee-49cc435550b7-workload-certs\") pod \"e2e-worker-w3-682999-openshift-default-54dcb797b5-lpdjd\" (UID: \"c155b964-e4f8-4a92-bcee-49cc435550b7\") " pod="openshift-ingress/e2e-worker-w3-682999-openshift-default-54dcb797b5-lpdjd"
Oct 30 20:52:58.710370 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:52:58.710334    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c155b964-e4f8-4a92-bcee-49cc435550b7-istio-podinfo\") pod \"e2e-worker-w3-682999-openshift-default-54dcb797b5-lpdjd\" (UID: \"c155b964-e4f8-4a92-bcee-49cc435550b7\") " pod="openshift-ingress/e2e-worker-w3-682999-openshift-default-54dcb797b5-lpdjd"
Oct 30 20:52:58.710468 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:52:58.710378    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c155b964-e4f8-4a92-bcee-49cc435550b7-istio-token\") pod \"e2e-worker-w3-682999-openshift-default-54dcb797b5-lpdjd\" (UID: \"c155b964-e4f8-4a92-bcee-49cc435550b7\") " pod="openshift-ingress/e2e-worker-w3-682999-openshift-default-54dcb797b5-lpdjd"
Oct 30 20:52:58.710468 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:52:58.710433    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c155b964-e4f8-4a92-bcee-49cc435550b7-istiod-ca-cert\") pod \"e2e-worker-w3-682999-openshift-default-54dcb797b5-lpdjd\" (UID: \"c155b964-e4f8-4a92-bcee-49cc435550b7\") " pod="openshift-ingress/e2e-worker-w3-682999-openshift-default-54dcb797b5-lpdjd"
Oct 30 20:52:58.710468 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:52:58.710460    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c155b964-e4f8-4a92-bcee-49cc435550b7-workload-socket\") pod \"e2e-worker-w3-682999-openshift-default-54dcb797b5-lpdjd\" (UID: \"c155b964-e4f8-4a92-bcee-49cc435550b7\") " pod="openshift-ingress/e2e-worker-w3-682999-openshift-default-54dcb797b5-lpdjd"
Oct 30 20:52:58.710618 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:52:58.710517    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c155b964-e4f8-4a92-bcee-49cc435550b7-credential-socket\") pod \"e2e-worker-w3-682999-openshift-default-54dcb797b5-lpdjd\" (UID: \"c155b964-e4f8-4a92-bcee-49cc435550b7\") " pod="openshift-ingress/e2e-worker-w3-682999-openshift-default-54dcb797b5-lpdjd"
Oct 30 20:52:58.710618 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:52:58.710556    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c155b964-e4f8-4a92-bcee-49cc435550b7-istio-data\") pod \"e2e-worker-w3-682999-openshift-default-54dcb797b5-lpdjd\" (UID: \"c155b964-e4f8-4a92-bcee-49cc435550b7\") " pod="openshift-ingress/e2e-worker-w3-682999-openshift-default-54dcb797b5-lpdjd"
Oct 30 20:52:58.710727 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:52:58.710662    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c155b964-e4f8-4a92-bcee-49cc435550b7-workload-certs\") pod \"e2e-worker-w3-682999-openshift-default-54dcb797b5-lpdjd\" (UID: \"c155b964-e4f8-4a92-bcee-49cc435550b7\") " pod="openshift-ingress/e2e-worker-w3-682999-openshift-default-54dcb797b5-lpdjd"
Oct 30 20:52:58.710819 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:52:58.710792    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c155b964-e4f8-4a92-bcee-49cc435550b7-workload-socket\") pod \"e2e-worker-w3-682999-openshift-default-54dcb797b5-lpdjd\" (UID: \"c155b964-e4f8-4a92-bcee-49cc435550b7\") " pod="openshift-ingress/e2e-worker-w3-682999-openshift-default-54dcb797b5-lpdjd"
Oct 30 20:52:58.711160 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:52:58.711141    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c155b964-e4f8-4a92-bcee-49cc435550b7-istiod-ca-cert\") pod \"e2e-worker-w3-682999-openshift-default-54dcb797b5-lpdjd\" (UID: \"c155b964-e4f8-4a92-bcee-49cc435550b7\") " pod="openshift-ingress/e2e-worker-w3-682999-openshift-default-54dcb797b5-lpdjd"
Oct 30 20:52:58.712469 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:52:58.712446    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c155b964-e4f8-4a92-bcee-49cc435550b7-istio-envoy\") pod \"e2e-worker-w3-682999-openshift-default-54dcb797b5-lpdjd\" (UID: \"c155b964-e4f8-4a92-bcee-49cc435550b7\") " pod="openshift-ingress/e2e-worker-w3-682999-openshift-default-54dcb797b5-lpdjd"
Oct 30 20:52:58.712750 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:52:58.712729    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c155b964-e4f8-4a92-bcee-49cc435550b7-istio-podinfo\") pod \"e2e-worker-w3-682999-openshift-default-54dcb797b5-lpdjd\" (UID: \"c155b964-e4f8-4a92-bcee-49cc435550b7\") " pod="openshift-ingress/e2e-worker-w3-682999-openshift-default-54dcb797b5-lpdjd"
Oct 30 20:52:58.767484 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:52:58.767421    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c155b964-e4f8-4a92-bcee-49cc435550b7-istio-token\") pod \"e2e-worker-w3-682999-openshift-default-54dcb797b5-lpdjd\" (UID: \"c155b964-e4f8-4a92-bcee-49cc435550b7\") " pod="openshift-ingress/e2e-worker-w3-682999-openshift-default-54dcb797b5-lpdjd"
Oct 30 20:52:58.767587 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:52:58.767516    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-flzbw\" (UniqueName: \"kubernetes.io/projected/c155b964-e4f8-4a92-bcee-49cc435550b7-kube-api-access-flzbw\") pod \"e2e-worker-w3-682999-openshift-default-54dcb797b5-lpdjd\" (UID: \"c155b964-e4f8-4a92-bcee-49cc435550b7\") " pod="openshift-ingress/e2e-worker-w3-682999-openshift-default-54dcb797b5-lpdjd"
Oct 30 20:52:58.831045 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:52:58.831017    6004 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-682999-openshift-default-54dcb797b5-lpdjd"
Oct 30 20:52:59.255722 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:52:59.255695    6004 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w3-682999-openshift-default-54dcb797b5-lpdjd"]
Oct 30 20:52:59.257445 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:52:59.257418    6004 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc155b964_e4f8_4a92_bcee_49cc435550b7.slice/crio-31170f153a322f7e804ac0454dde3371afc48ad26659ac9b31505a2e6e9520b1 WatchSource:0}: Error finding container 31170f153a322f7e804ac0454dde3371afc48ad26659ac9b31505a2e6e9520b1: Status 404 returned error can't find the container with id 31170f153a322f7e804ac0454dde3371afc48ad26659ac9b31505a2e6e9520b1
Oct 30 20:52:59.259782 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:52:59.259752    6004 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 20:52:59.259862 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:52:59.259816    6004 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 20:52:59.259862 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:52:59.259845    6004 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 20:52:59.908288 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:52:59.908254    6004 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-682999-openshift-default-54dcb797b5-lpdjd" event={"ID":"c155b964-e4f8-4a92-bcee-49cc435550b7","Type":"ContainerStarted","Data":"a6b2141433713ec7d1883eb66361ce24f62c42a712907c645b43ff884b194ba3"}
Oct 30 20:52:59.908686 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:52:59.908303    6004 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-682999-openshift-default-54dcb797b5-lpdjd" event={"ID":"c155b964-e4f8-4a92-bcee-49cc435550b7","Type":"ContainerStarted","Data":"31170f153a322f7e804ac0454dde3371afc48ad26659ac9b31505a2e6e9520b1"}
Oct 30 20:53:00.127418 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:53:00.127364    6004 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w3-682999-openshift-default-54dcb797b5-lpdjd" podStartSLOduration=2.127349897 podStartE2EDuration="2.127349897s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:52:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:53:00.07660383 +0000 UTC m=+885.996389948" watchObservedRunningTime="2026-10-30 20:53:00.127349897 +0000 UTC m=+886.047136014"
Oct 30 20:53:00.831688 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:53:00.831655    6004 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w3-682999-openshift-default-54dcb797b5-lpdjd"
Oct 30 20:53:00.833363 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:53:00.833336    6004 patch_prober.go:29] interesting pod/e2e-worker-w3-682999-openshift-default-54dcb797b5-lpdjd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused" start-of-body=
Oct 30 20:53:00.833481 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:53:00.833384    6004 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-682999-openshift-default-54dcb797b5-lpdjd" podUID="c155b964-e4f8-4a92-bcee-49cc435550b7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused"
Oct 30 20:53:01.832168 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:53:01.832131    6004 patch_prober.go:29] interesting pod/e2e-worker-w3-682999-openshift-default-54dcb797b5-lpdjd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused" start-of-body=
Oct 30 20:53:01.832551 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:53:01.832182    6004 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-682999-openshift-default-54dcb797b5-lpdjd" podUID="c155b964-e4f8-4a92-bcee-49cc435550b7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused"
Oct 30 20:53:02.832128 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:53:02.832087    6004 patch_prober.go:29] interesting pod/e2e-worker-w3-682999-openshift-default-54dcb797b5-lpdjd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused" start-of-body=
Oct 30 20:53:02.832309 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:53:02.832153    6004 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-682999-openshift-default-54dcb797b5-lpdjd" podUID="c155b964-e4f8-4a92-bcee-49cc435550b7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused"
Oct 30 20:53:03.831963 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:53:03.831928    6004 patch_prober.go:29] interesting pod/e2e-worker-w3-682999-openshift-default-54dcb797b5-lpdjd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused" start-of-body=
Oct 30 20:53:03.832169 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:53:03.831981    6004 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-682999-openshift-default-54dcb797b5-lpdjd" podUID="c155b964-e4f8-4a92-bcee-49cc435550b7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused"
Oct 30 20:53:04.831817 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:53:04.831783    6004 patch_prober.go:29] interesting pod/e2e-worker-w3-682999-openshift-default-54dcb797b5-lpdjd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused" start-of-body=
Oct 30 20:53:04.832253 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:53:04.831840    6004 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-682999-openshift-default-54dcb797b5-lpdjd" podUID="c155b964-e4f8-4a92-bcee-49cc435550b7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused"
Oct 30 20:53:05.941298 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:53:05.941257    6004 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w3-682999-openshift-default-54dcb797b5-lpdjd"
Oct 30 20:53:05.941825 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:53:05.941800    6004 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w3-682999-openshift-default-54dcb797b5-lpdjd"
Oct 30 20:53:05.943152 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:53:05.943130    6004 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w3-682999-openshift-default-54dcb797b5-lpdjd"
Oct 30 20:53:14.287902 ip-10-0-138-85 kubenswrapper[6004]: E1030 20:53:14.287863    6004 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-zz4wr" containerName="extractor"
Oct 30 20:53:14.361192 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:53:14.361159    6004 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-sb7ds_90cd3de0-c573-41c2-bf3e-cf0e46a41d50/console-operator/2.log"
Oct 30 20:53:14.366028 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:53:14.365997    6004 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-sb7ds_90cd3de0-c573-41c2-bf3e-cf0e46a41d50/console-operator/2.log"
Oct 30 20:53:38.549430 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:53:38.549397    6004 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w2-d061d0/premium-w2-d061d0-kserve-5c589d8c9f-rt7v4"]
Oct 30 20:53:38.553768 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:53:38.553748    6004 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w2-d061d0/premium-w2-d061d0-kserve-5c589d8c9f-rt7v4"
Oct 30 20:53:38.636930 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:53:38.636892    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/769fd172-1d4c-4cd3-8eda-e8d4850c0f67-tmp-dir\") pod \"premium-w2-d061d0-kserve-5c589d8c9f-rt7v4\" (UID: \"769fd172-1d4c-4cd3-8eda-e8d4850c0f67\") " pod="e2e-models-e2e-worker-w2-d061d0/premium-w2-d061d0-kserve-5c589d8c9f-rt7v4"
Oct 30 20:53:38.637154 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:53:38.636956    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/769fd172-1d4c-4cd3-8eda-e8d4850c0f67-model-cache\") pod \"premium-w2-d061d0-kserve-5c589d8c9f-rt7v4\" (UID: \"769fd172-1d4c-4cd3-8eda-e8d4850c0f67\") " pod="e2e-models-e2e-worker-w2-d061d0/premium-w2-d061d0-kserve-5c589d8c9f-rt7v4"
Oct 30 20:53:38.637226 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:53:38.637137    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/769fd172-1d4c-4cd3-8eda-e8d4850c0f67-tls-certs\") pod \"premium-w2-d061d0-kserve-5c589d8c9f-rt7v4\" (UID: \"769fd172-1d4c-4cd3-8eda-e8d4850c0f67\") " pod="e2e-models-e2e-worker-w2-d061d0/premium-w2-d061d0-kserve-5c589d8c9f-rt7v4"
Oct 30 20:53:38.637226 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:53:38.637189    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/769fd172-1d4c-4cd3-8eda-e8d4850c0f67-home\") pod \"premium-w2-d061d0-kserve-5c589d8c9f-rt7v4\" (UID: \"769fd172-1d4c-4cd3-8eda-e8d4850c0f67\") " pod="e2e-models-e2e-worker-w2-d061d0/premium-w2-d061d0-kserve-5c589d8c9f-rt7v4"
Oct 30 20:53:38.637329 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:53:38.637301    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/769fd172-1d4c-4cd3-8eda-e8d4850c0f67-dshm\") pod \"premium-w2-d061d0-kserve-5c589d8c9f-rt7v4\" (UID: \"769fd172-1d4c-4cd3-8eda-e8d4850c0f67\") " pod="e2e-models-e2e-worker-w2-d061d0/premium-w2-d061d0-kserve-5c589d8c9f-rt7v4"
Oct 30 20:53:38.637381 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:53:38.637346    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b9lk9\" (UniqueName: \"kubernetes.io/projected/769fd172-1d4c-4cd3-8eda-e8d4850c0f67-kube-api-access-b9lk9\") pod \"premium-w2-d061d0-kserve-5c589d8c9f-rt7v4\" (UID: \"769fd172-1d4c-4cd3-8eda-e8d4850c0f67\") " pod="e2e-models-e2e-worker-w2-d061d0/premium-w2-d061d0-kserve-5c589d8c9f-rt7v4"
Oct 30 20:53:38.658735 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:53:38.658691    6004 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w2-d061d0\"/\"premium-w2-d061d0-kserve-self-signed-certs\""
Oct 30 20:53:38.658735 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:53:38.658719    6004 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w2-d061d0\"/\"kube-root-ca.crt\""
Oct 30 20:53:38.658989 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:53:38.658796    6004 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w2-d061d0\"/\"openshift-service-ca.crt\""
Oct 30 20:53:38.658989 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:53:38.658823    6004 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w2-d061d0\"/\"default-dockercfg-nxxqc\""
Oct 30 20:53:38.661394 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:53:38.661370    6004 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w2-d061d0/premium-w2-d061d0-kserve-5c589d8c9f-rt7v4"]
Oct 30 20:53:38.738460 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:53:38.738418    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/769fd172-1d4c-4cd3-8eda-e8d4850c0f67-tls-certs\") pod \"premium-w2-d061d0-kserve-5c589d8c9f-rt7v4\" (UID: \"769fd172-1d4c-4cd3-8eda-e8d4850c0f67\") " pod="e2e-models-e2e-worker-w2-d061d0/premium-w2-d061d0-kserve-5c589d8c9f-rt7v4"
Oct 30 20:53:38.738460 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:53:38.738461    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/769fd172-1d4c-4cd3-8eda-e8d4850c0f67-home\") pod \"premium-w2-d061d0-kserve-5c589d8c9f-rt7v4\" (UID: \"769fd172-1d4c-4cd3-8eda-e8d4850c0f67\") " pod="e2e-models-e2e-worker-w2-d061d0/premium-w2-d061d0-kserve-5c589d8c9f-rt7v4"
Oct 30 20:53:38.738719 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:53:38.738587    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/769fd172-1d4c-4cd3-8eda-e8d4850c0f67-dshm\") pod \"premium-w2-d061d0-kserve-5c589d8c9f-rt7v4\" (UID: \"769fd172-1d4c-4cd3-8eda-e8d4850c0f67\") " pod="e2e-models-e2e-worker-w2-d061d0/premium-w2-d061d0-kserve-5c589d8c9f-rt7v4"
Oct 30 20:53:38.738719 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:53:38.738621    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b9lk9\" (UniqueName: \"kubernetes.io/projected/769fd172-1d4c-4cd3-8eda-e8d4850c0f67-kube-api-access-b9lk9\") pod \"premium-w2-d061d0-kserve-5c589d8c9f-rt7v4\" (UID: \"769fd172-1d4c-4cd3-8eda-e8d4850c0f67\") " pod="e2e-models-e2e-worker-w2-d061d0/premium-w2-d061d0-kserve-5c589d8c9f-rt7v4"
Oct 30 20:53:38.738841 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:53:38.738721    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/769fd172-1d4c-4cd3-8eda-e8d4850c0f67-tmp-dir\") pod \"premium-w2-d061d0-kserve-5c589d8c9f-rt7v4\" (UID: \"769fd172-1d4c-4cd3-8eda-e8d4850c0f67\") " pod="e2e-models-e2e-worker-w2-d061d0/premium-w2-d061d0-kserve-5c589d8c9f-rt7v4"
Oct 30 20:53:38.738841 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:53:38.738772    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/769fd172-1d4c-4cd3-8eda-e8d4850c0f67-model-cache\") pod \"premium-w2-d061d0-kserve-5c589d8c9f-rt7v4\" (UID: \"769fd172-1d4c-4cd3-8eda-e8d4850c0f67\") " pod="e2e-models-e2e-worker-w2-d061d0/premium-w2-d061d0-kserve-5c589d8c9f-rt7v4"
Oct 30 20:53:38.738942 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:53:38.738875    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/769fd172-1d4c-4cd3-8eda-e8d4850c0f67-home\") pod \"premium-w2-d061d0-kserve-5c589d8c9f-rt7v4\" (UID: \"769fd172-1d4c-4cd3-8eda-e8d4850c0f67\") " pod="e2e-models-e2e-worker-w2-d061d0/premium-w2-d061d0-kserve-5c589d8c9f-rt7v4"
Oct 30 20:53:38.739111 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:53:38.739091    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/769fd172-1d4c-4cd3-8eda-e8d4850c0f67-tmp-dir\") pod \"premium-w2-d061d0-kserve-5c589d8c9f-rt7v4\" (UID: \"769fd172-1d4c-4cd3-8eda-e8d4850c0f67\") " pod="e2e-models-e2e-worker-w2-d061d0/premium-w2-d061d0-kserve-5c589d8c9f-rt7v4"
Oct 30 20:53:38.739256 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:53:38.739229    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/769fd172-1d4c-4cd3-8eda-e8d4850c0f67-model-cache\") pod \"premium-w2-d061d0-kserve-5c589d8c9f-rt7v4\" (UID: \"769fd172-1d4c-4cd3-8eda-e8d4850c0f67\") " pod="e2e-models-e2e-worker-w2-d061d0/premium-w2-d061d0-kserve-5c589d8c9f-rt7v4"
Oct 30 20:53:38.740859 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:53:38.740836    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/769fd172-1d4c-4cd3-8eda-e8d4850c0f67-dshm\") pod \"premium-w2-d061d0-kserve-5c589d8c9f-rt7v4\" (UID: \"769fd172-1d4c-4cd3-8eda-e8d4850c0f67\") " pod="e2e-models-e2e-worker-w2-d061d0/premium-w2-d061d0-kserve-5c589d8c9f-rt7v4"
Oct 30 20:53:38.741199 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:53:38.741183    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/769fd172-1d4c-4cd3-8eda-e8d4850c0f67-tls-certs\") pod \"premium-w2-d061d0-kserve-5c589d8c9f-rt7v4\" (UID: \"769fd172-1d4c-4cd3-8eda-e8d4850c0f67\") " pod="e2e-models-e2e-worker-w2-d061d0/premium-w2-d061d0-kserve-5c589d8c9f-rt7v4"
Oct 30 20:53:38.796665 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:53:38.796627    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b9lk9\" (UniqueName: \"kubernetes.io/projected/769fd172-1d4c-4cd3-8eda-e8d4850c0f67-kube-api-access-b9lk9\") pod \"premium-w2-d061d0-kserve-5c589d8c9f-rt7v4\" (UID: \"769fd172-1d4c-4cd3-8eda-e8d4850c0f67\") " pod="e2e-models-e2e-worker-w2-d061d0/premium-w2-d061d0-kserve-5c589d8c9f-rt7v4"
Oct 30 20:53:38.866014 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:53:38.865921    6004 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w2-d061d0/premium-w2-d061d0-kserve-5c589d8c9f-rt7v4"
Oct 30 20:53:39.275253 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:53:39.275220    6004 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w2-d061d0/premium-w2-d061d0-kserve-5c589d8c9f-rt7v4"]
Oct 30 20:53:40.177726 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:53:40.177657    6004 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w2-d061d0/premium-w2-d061d0-kserve-5c589d8c9f-rt7v4" event={"ID":"769fd172-1d4c-4cd3-8eda-e8d4850c0f67","Type":"ContainerStarted","Data":"02e526181ecaadb012efd0c66434032ffea31ea1fcd0a17e748d268db5512a12"}
Oct 30 20:53:42.192484 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:53:42.192446    6004 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w2-d061d0/premium-w2-d061d0-kserve-5c589d8c9f-rt7v4" event={"ID":"769fd172-1d4c-4cd3-8eda-e8d4850c0f67","Type":"ContainerStarted","Data":"1d28a880981a536930b6850dc783496d58f4d5e27a527ccd5ae89da8bfcd5a2a"}
Oct 30 20:53:42.310024 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:53:42.309972    6004 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-models-e2e-worker-w2-d061d0/premium-w2-d061d0-kserve-5c589d8c9f-rt7v4" podStartSLOduration=2.230940267 podStartE2EDuration="4.309957964s" totalImagesPullingTime="2.079017697s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:53:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:53:42.309041318 +0000 UTC m=+928.228827437" watchObservedRunningTime="2026-10-30 20:53:42.309957964 +0000 UTC m=+928.229744082"
Oct 30 20:53:42.866827 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:53:42.866794    6004 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w2-d061d0/premium-w2-d061d0-kserve-5c589d8c9f-rt7v4"
Oct 30 20:53:44.286550 ip-10-0-138-85 kubenswrapper[6004]: E1030 20:53:44.286513    6004 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-zz4wr" containerName="extractor"
Oct 30 20:53:48.866646 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:53:48.866607    6004 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w2-d061d0/premium-w2-d061d0-kserve-5c589d8c9f-rt7v4"
Oct 30 20:53:48.880022 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:53:48.879997    6004 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w2-d061d0/premium-w2-d061d0-kserve-5c589d8c9f-rt7v4"
Oct 30 20:53:49.251092 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:53:49.251060    6004 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w2-d061d0/premium-w2-d061d0-kserve-5c589d8c9f-rt7v4"
Oct 30 20:53:59.435035 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:53:59.434998    6004 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w5-2b425d-openshift-default-f547dbcbf-5q4qn"]
Oct 30 20:53:59.438958 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:53:59.438937    6004 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-2b425d-openshift-default-f547dbcbf-5q4qn"
Oct 30 20:53:59.541167 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:53:59.541134    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f2e32e7c-6a2f-4464-aa11-243c5b5ccbe1-istio-envoy\") pod \"e2e-worker-w5-2b425d-openshift-default-f547dbcbf-5q4qn\" (UID: \"f2e32e7c-6a2f-4464-aa11-243c5b5ccbe1\") " pod="openshift-ingress/e2e-worker-w5-2b425d-openshift-default-f547dbcbf-5q4qn"
Oct 30 20:53:59.541330 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:53:59.541178    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f2e32e7c-6a2f-4464-aa11-243c5b5ccbe1-credential-socket\") pod \"e2e-worker-w5-2b425d-openshift-default-f547dbcbf-5q4qn\" (UID: \"f2e32e7c-6a2f-4464-aa11-243c5b5ccbe1\") " pod="openshift-ingress/e2e-worker-w5-2b425d-openshift-default-f547dbcbf-5q4qn"
Oct 30 20:53:59.541330 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:53:59.541202    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dscq9\" (UniqueName: \"kubernetes.io/projected/f2e32e7c-6a2f-4464-aa11-243c5b5ccbe1-kube-api-access-dscq9\") pod \"e2e-worker-w5-2b425d-openshift-default-f547dbcbf-5q4qn\" (UID: \"f2e32e7c-6a2f-4464-aa11-243c5b5ccbe1\") " pod="openshift-ingress/e2e-worker-w5-2b425d-openshift-default-f547dbcbf-5q4qn"
Oct 30 20:53:59.541406 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:53:59.541317    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f2e32e7c-6a2f-4464-aa11-243c5b5ccbe1-workload-socket\") pod \"e2e-worker-w5-2b425d-openshift-default-f547dbcbf-5q4qn\" (UID: \"f2e32e7c-6a2f-4464-aa11-243c5b5ccbe1\") " pod="openshift-ingress/e2e-worker-w5-2b425d-openshift-default-f547dbcbf-5q4qn"
Oct 30 20:53:59.541406 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:53:59.541349    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f2e32e7c-6a2f-4464-aa11-243c5b5ccbe1-workload-certs\") pod \"e2e-worker-w5-2b425d-openshift-default-f547dbcbf-5q4qn\" (UID: \"f2e32e7c-6a2f-4464-aa11-243c5b5ccbe1\") " pod="openshift-ingress/e2e-worker-w5-2b425d-openshift-default-f547dbcbf-5q4qn"
Oct 30 20:53:59.541406 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:53:59.541385    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f2e32e7c-6a2f-4464-aa11-243c5b5ccbe1-istio-token\") pod \"e2e-worker-w5-2b425d-openshift-default-f547dbcbf-5q4qn\" (UID: \"f2e32e7c-6a2f-4464-aa11-243c5b5ccbe1\") " pod="openshift-ingress/e2e-worker-w5-2b425d-openshift-default-f547dbcbf-5q4qn"
Oct 30 20:53:59.541501 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:53:59.541469    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f2e32e7c-6a2f-4464-aa11-243c5b5ccbe1-istiod-ca-cert\") pod \"e2e-worker-w5-2b425d-openshift-default-f547dbcbf-5q4qn\" (UID: \"f2e32e7c-6a2f-4464-aa11-243c5b5ccbe1\") " pod="openshift-ingress/e2e-worker-w5-2b425d-openshift-default-f547dbcbf-5q4qn"
Oct 30 20:53:59.541534 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:53:59.541520    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f2e32e7c-6a2f-4464-aa11-243c5b5ccbe1-istio-data\") pod \"e2e-worker-w5-2b425d-openshift-default-f547dbcbf-5q4qn\" (UID: \"f2e32e7c-6a2f-4464-aa11-243c5b5ccbe1\") " pod="openshift-ingress/e2e-worker-w5-2b425d-openshift-default-f547dbcbf-5q4qn"
Oct 30 20:53:59.541621 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:53:59.541606    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f2e32e7c-6a2f-4464-aa11-243c5b5ccbe1-istio-podinfo\") pod \"e2e-worker-w5-2b425d-openshift-default-f547dbcbf-5q4qn\" (UID: \"f2e32e7c-6a2f-4464-aa11-243c5b5ccbe1\") " pod="openshift-ingress/e2e-worker-w5-2b425d-openshift-default-f547dbcbf-5q4qn"
Oct 30 20:53:59.544569 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:53:59.544541    6004 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w5-2b425d-openshift-default-f547dbcbf-5q4qn"]
Oct 30 20:53:59.564098 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:53:59.564078    6004 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w5-2b425d-openshift-default-dockercfg-mnjbj\""
Oct 30 20:53:59.642984 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:53:59.642946    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f2e32e7c-6a2f-4464-aa11-243c5b5ccbe1-workload-socket\") pod \"e2e-worker-w5-2b425d-openshift-default-f547dbcbf-5q4qn\" (UID: \"f2e32e7c-6a2f-4464-aa11-243c5b5ccbe1\") " pod="openshift-ingress/e2e-worker-w5-2b425d-openshift-default-f547dbcbf-5q4qn"
Oct 30 20:53:59.642984 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:53:59.642988    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f2e32e7c-6a2f-4464-aa11-243c5b5ccbe1-workload-certs\") pod \"e2e-worker-w5-2b425d-openshift-default-f547dbcbf-5q4qn\" (UID: \"f2e32e7c-6a2f-4464-aa11-243c5b5ccbe1\") " pod="openshift-ingress/e2e-worker-w5-2b425d-openshift-default-f547dbcbf-5q4qn"
Oct 30 20:53:59.643236 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:53:59.643038    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f2e32e7c-6a2f-4464-aa11-243c5b5ccbe1-istio-token\") pod \"e2e-worker-w5-2b425d-openshift-default-f547dbcbf-5q4qn\" (UID: \"f2e32e7c-6a2f-4464-aa11-243c5b5ccbe1\") " pod="openshift-ingress/e2e-worker-w5-2b425d-openshift-default-f547dbcbf-5q4qn"
Oct 30 20:53:59.643236 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:53:59.643113    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f2e32e7c-6a2f-4464-aa11-243c5b5ccbe1-istiod-ca-cert\") pod \"e2e-worker-w5-2b425d-openshift-default-f547dbcbf-5q4qn\" (UID: \"f2e32e7c-6a2f-4464-aa11-243c5b5ccbe1\") " pod="openshift-ingress/e2e-worker-w5-2b425d-openshift-default-f547dbcbf-5q4qn"
Oct 30 20:53:59.643346 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:53:59.643258    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f2e32e7c-6a2f-4464-aa11-243c5b5ccbe1-istio-data\") pod \"e2e-worker-w5-2b425d-openshift-default-f547dbcbf-5q4qn\" (UID: \"f2e32e7c-6a2f-4464-aa11-243c5b5ccbe1\") " pod="openshift-ingress/e2e-worker-w5-2b425d-openshift-default-f547dbcbf-5q4qn"
Oct 30 20:53:59.643406 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:53:59.643342    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f2e32e7c-6a2f-4464-aa11-243c5b5ccbe1-istio-podinfo\") pod \"e2e-worker-w5-2b425d-openshift-default-f547dbcbf-5q4qn\" (UID: \"f2e32e7c-6a2f-4464-aa11-243c5b5ccbe1\") " pod="openshift-ingress/e2e-worker-w5-2b425d-openshift-default-f547dbcbf-5q4qn"
Oct 30 20:53:59.643406 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:53:59.643384    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f2e32e7c-6a2f-4464-aa11-243c5b5ccbe1-istio-envoy\") pod \"e2e-worker-w5-2b425d-openshift-default-f547dbcbf-5q4qn\" (UID: \"f2e32e7c-6a2f-4464-aa11-243c5b5ccbe1\") " pod="openshift-ingress/e2e-worker-w5-2b425d-openshift-default-f547dbcbf-5q4qn"
Oct 30 20:53:59.643502 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:53:59.643432    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f2e32e7c-6a2f-4464-aa11-243c5b5ccbe1-credential-socket\") pod \"e2e-worker-w5-2b425d-openshift-default-f547dbcbf-5q4qn\" (UID: \"f2e32e7c-6a2f-4464-aa11-243c5b5ccbe1\") " pod="openshift-ingress/e2e-worker-w5-2b425d-openshift-default-f547dbcbf-5q4qn"
Oct 30 20:53:59.643502 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:53:59.643451    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f2e32e7c-6a2f-4464-aa11-243c5b5ccbe1-workload-socket\") pod \"e2e-worker-w5-2b425d-openshift-default-f547dbcbf-5q4qn\" (UID: \"f2e32e7c-6a2f-4464-aa11-243c5b5ccbe1\") " pod="openshift-ingress/e2e-worker-w5-2b425d-openshift-default-f547dbcbf-5q4qn"
Oct 30 20:53:59.643502 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:53:59.643468    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dscq9\" (UniqueName: \"kubernetes.io/projected/f2e32e7c-6a2f-4464-aa11-243c5b5ccbe1-kube-api-access-dscq9\") pod \"e2e-worker-w5-2b425d-openshift-default-f547dbcbf-5q4qn\" (UID: \"f2e32e7c-6a2f-4464-aa11-243c5b5ccbe1\") " pod="openshift-ingress/e2e-worker-w5-2b425d-openshift-default-f547dbcbf-5q4qn"
Oct 30 20:53:59.643502 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:53:59.643493    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f2e32e7c-6a2f-4464-aa11-243c5b5ccbe1-workload-certs\") pod \"e2e-worker-w5-2b425d-openshift-default-f547dbcbf-5q4qn\" (UID: \"f2e32e7c-6a2f-4464-aa11-243c5b5ccbe1\") " pod="openshift-ingress/e2e-worker-w5-2b425d-openshift-default-f547dbcbf-5q4qn"
Oct 30 20:53:59.643704 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:53:59.643624    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f2e32e7c-6a2f-4464-aa11-243c5b5ccbe1-istio-data\") pod \"e2e-worker-w5-2b425d-openshift-default-f547dbcbf-5q4qn\" (UID: \"f2e32e7c-6a2f-4464-aa11-243c5b5ccbe1\") " pod="openshift-ingress/e2e-worker-w5-2b425d-openshift-default-f547dbcbf-5q4qn"
Oct 30 20:53:59.643762 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:53:59.643703    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f2e32e7c-6a2f-4464-aa11-243c5b5ccbe1-credential-socket\") pod \"e2e-worker-w5-2b425d-openshift-default-f547dbcbf-5q4qn\" (UID: \"f2e32e7c-6a2f-4464-aa11-243c5b5ccbe1\") " pod="openshift-ingress/e2e-worker-w5-2b425d-openshift-default-f547dbcbf-5q4qn"
Oct 30 20:53:59.644307 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:53:59.644283    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f2e32e7c-6a2f-4464-aa11-243c5b5ccbe1-istiod-ca-cert\") pod \"e2e-worker-w5-2b425d-openshift-default-f547dbcbf-5q4qn\" (UID: \"f2e32e7c-6a2f-4464-aa11-243c5b5ccbe1\") " pod="openshift-ingress/e2e-worker-w5-2b425d-openshift-default-f547dbcbf-5q4qn"
Oct 30 20:53:59.645640 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:53:59.645619    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f2e32e7c-6a2f-4464-aa11-243c5b5ccbe1-istio-envoy\") pod \"e2e-worker-w5-2b425d-openshift-default-f547dbcbf-5q4qn\" (UID: \"f2e32e7c-6a2f-4464-aa11-243c5b5ccbe1\") " pod="openshift-ingress/e2e-worker-w5-2b425d-openshift-default-f547dbcbf-5q4qn"
Oct 30 20:53:59.645765 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:53:59.645748    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f2e32e7c-6a2f-4464-aa11-243c5b5ccbe1-istio-podinfo\") pod \"e2e-worker-w5-2b425d-openshift-default-f547dbcbf-5q4qn\" (UID: \"f2e32e7c-6a2f-4464-aa11-243c5b5ccbe1\") " pod="openshift-ingress/e2e-worker-w5-2b425d-openshift-default-f547dbcbf-5q4qn"
Oct 30 20:53:59.702219 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:53:59.702152    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f2e32e7c-6a2f-4464-aa11-243c5b5ccbe1-istio-token\") pod \"e2e-worker-w5-2b425d-openshift-default-f547dbcbf-5q4qn\" (UID: \"f2e32e7c-6a2f-4464-aa11-243c5b5ccbe1\") " pod="openshift-ingress/e2e-worker-w5-2b425d-openshift-default-f547dbcbf-5q4qn"
Oct 30 20:53:59.702371 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:53:59.702348    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dscq9\" (UniqueName: \"kubernetes.io/projected/f2e32e7c-6a2f-4464-aa11-243c5b5ccbe1-kube-api-access-dscq9\") pod \"e2e-worker-w5-2b425d-openshift-default-f547dbcbf-5q4qn\" (UID: \"f2e32e7c-6a2f-4464-aa11-243c5b5ccbe1\") " pod="openshift-ingress/e2e-worker-w5-2b425d-openshift-default-f547dbcbf-5q4qn"
Oct 30 20:53:59.752132 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:53:59.752082    6004 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-2b425d-openshift-default-f547dbcbf-5q4qn"
Oct 30 20:54:00.202444 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:54:00.202408    6004 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w5-2b425d-openshift-default-f547dbcbf-5q4qn"]
Oct 30 20:54:00.212399 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:54:00.212367    6004 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf2e32e7c_6a2f_4464_aa11_243c5b5ccbe1.slice/crio-3da74deb1fcb94878454dee156c57ab4a0059f8cd540835615f978dcf537b90c WatchSource:0}: Error finding container 3da74deb1fcb94878454dee156c57ab4a0059f8cd540835615f978dcf537b90c: Status 404 returned error can't find the container with id 3da74deb1fcb94878454dee156c57ab4a0059f8cd540835615f978dcf537b90c
Oct 30 20:54:00.214946 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:54:00.214905    6004 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 20:54:00.215136 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:54:00.214984    6004 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 20:54:00.215136 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:54:00.215016    6004 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 20:54:00.311108 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:54:00.311073    6004 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-2b425d-openshift-default-f547dbcbf-5q4qn" event={"ID":"f2e32e7c-6a2f-4464-aa11-243c5b5ccbe1","Type":"ContainerStarted","Data":"9c3d96c9cbcb0ea6f576c8fd3bf4bb751e942d5e78d85170f407d565c2b0313f"}
Oct 30 20:54:00.311288 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:54:00.311138    6004 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-2b425d-openshift-default-f547dbcbf-5q4qn" event={"ID":"f2e32e7c-6a2f-4464-aa11-243c5b5ccbe1","Type":"ContainerStarted","Data":"3da74deb1fcb94878454dee156c57ab4a0059f8cd540835615f978dcf537b90c"}
Oct 30 20:54:00.429265 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:54:00.429199    6004 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w5-2b425d-openshift-default-f547dbcbf-5q4qn" podStartSLOduration=1.429179621 podStartE2EDuration="1.429179621s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:53:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:54:00.426404315 +0000 UTC m=+946.346190415" watchObservedRunningTime="2026-10-30 20:54:00.429179621 +0000 UTC m=+946.348965743"
Oct 30 20:54:00.754345 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:54:00.754209    6004 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w5-2b425d-openshift-default-f547dbcbf-5q4qn"
Oct 30 20:54:01.760195 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:54:01.760143    6004 patch_prober.go:29] interesting pod/e2e-worker-w5-2b425d-openshift-default-f547dbcbf-5q4qn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused" start-of-body=
Oct 30 20:54:01.760597 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:54:01.760205    6004 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-2b425d-openshift-default-f547dbcbf-5q4qn" podUID="f2e32e7c-6a2f-4464-aa11-243c5b5ccbe1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused"
Oct 30 20:54:02.754073 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:54:02.753407    6004 patch_prober.go:29] interesting pod/e2e-worker-w5-2b425d-openshift-default-f547dbcbf-5q4qn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused" start-of-body=
Oct 30 20:54:02.754073 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:54:02.753470    6004 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-2b425d-openshift-default-f547dbcbf-5q4qn" podUID="f2e32e7c-6a2f-4464-aa11-243c5b5ccbe1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused"
Oct 30 20:54:03.754474 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:54:03.754431    6004 patch_prober.go:29] interesting pod/e2e-worker-w5-2b425d-openshift-default-f547dbcbf-5q4qn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused" start-of-body=
Oct 30 20:54:03.755117 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:54:03.755083    6004 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-2b425d-openshift-default-f547dbcbf-5q4qn" podUID="f2e32e7c-6a2f-4464-aa11-243c5b5ccbe1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused"
Oct 30 20:54:04.758509 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:54:04.758469    6004 patch_prober.go:29] interesting pod/e2e-worker-w5-2b425d-openshift-default-f547dbcbf-5q4qn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused" start-of-body=
Oct 30 20:54:04.759112 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:54:04.759078    6004 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-2b425d-openshift-default-f547dbcbf-5q4qn" podUID="f2e32e7c-6a2f-4464-aa11-243c5b5ccbe1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused"
Oct 30 20:54:05.757197 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:54:05.757156    6004 patch_prober.go:29] interesting pod/e2e-worker-w5-2b425d-openshift-default-f547dbcbf-5q4qn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused" start-of-body=
Oct 30 20:54:05.757467 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:54:05.757437    6004 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-2b425d-openshift-default-f547dbcbf-5q4qn" podUID="f2e32e7c-6a2f-4464-aa11-243c5b5ccbe1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused"
Oct 30 20:54:06.887773 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:54:06.887737    6004 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w5-2b425d-openshift-default-f547dbcbf-5q4qn"
Oct 30 20:54:06.888257 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:54:06.888149    6004 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w5-2b425d-openshift-default-f547dbcbf-5q4qn"
Oct 30 20:54:06.889077 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:54:06.889033    6004 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w5-2b425d-openshift-default-f547dbcbf-5q4qn"
Oct 30 20:54:13.368628 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:54:13.368600    6004 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w1-f9f277-openshift-default-869d58fb77-xbhch"]
Oct 30 20:54:13.373788 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:54:13.373767    6004 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-f9f277-openshift-default-869d58fb77-xbhch"
Oct 30 20:54:13.427556 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:54:13.427522    6004 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w1-f9f277-openshift-default-dockercfg-5xmn8\""
Oct 30 20:54:13.480375 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:54:13.480340    6004 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w1-f9f277-openshift-default-869d58fb77-xbhch"]
Oct 30 20:54:13.493921 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:54:13.493888    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7b81a18e-7cc3-4ed4-b08e-20e426d4c3e1-istio-envoy\") pod \"e2e-worker-w1-f9f277-openshift-default-869d58fb77-xbhch\" (UID: \"7b81a18e-7cc3-4ed4-b08e-20e426d4c3e1\") " pod="openshift-ingress/e2e-worker-w1-f9f277-openshift-default-869d58fb77-xbhch"
Oct 30 20:54:13.494123 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:54:13.493954    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7b81a18e-7cc3-4ed4-b08e-20e426d4c3e1-istio-token\") pod \"e2e-worker-w1-f9f277-openshift-default-869d58fb77-xbhch\" (UID: \"7b81a18e-7cc3-4ed4-b08e-20e426d4c3e1\") " pod="openshift-ingress/e2e-worker-w1-f9f277-openshift-default-869d58fb77-xbhch"
Oct 30 20:54:13.494123 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:54:13.494092    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7b81a18e-7cc3-4ed4-b08e-20e426d4c3e1-workload-certs\") pod \"e2e-worker-w1-f9f277-openshift-default-869d58fb77-xbhch\" (UID: \"7b81a18e-7cc3-4ed4-b08e-20e426d4c3e1\") " pod="openshift-ingress/e2e-worker-w1-f9f277-openshift-default-869d58fb77-xbhch"
Oct 30 20:54:13.494274 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:54:13.494250    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7b81a18e-7cc3-4ed4-b08e-20e426d4c3e1-credential-socket\") pod \"e2e-worker-w1-f9f277-openshift-default-869d58fb77-xbhch\" (UID: \"7b81a18e-7cc3-4ed4-b08e-20e426d4c3e1\") " pod="openshift-ingress/e2e-worker-w1-f9f277-openshift-default-869d58fb77-xbhch"
Oct 30 20:54:13.494346 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:54:13.494294    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7b81a18e-7cc3-4ed4-b08e-20e426d4c3e1-istio-data\") pod \"e2e-worker-w1-f9f277-openshift-default-869d58fb77-xbhch\" (UID: \"7b81a18e-7cc3-4ed4-b08e-20e426d4c3e1\") " pod="openshift-ingress/e2e-worker-w1-f9f277-openshift-default-869d58fb77-xbhch"
Oct 30 20:54:13.494346 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:54:13.494336    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7b81a18e-7cc3-4ed4-b08e-20e426d4c3e1-istiod-ca-cert\") pod \"e2e-worker-w1-f9f277-openshift-default-869d58fb77-xbhch\" (UID: \"7b81a18e-7cc3-4ed4-b08e-20e426d4c3e1\") " pod="openshift-ingress/e2e-worker-w1-f9f277-openshift-default-869d58fb77-xbhch"
Oct 30 20:54:13.494444 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:54:13.494428    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2svql\" (UniqueName: \"kubernetes.io/projected/7b81a18e-7cc3-4ed4-b08e-20e426d4c3e1-kube-api-access-2svql\") pod \"e2e-worker-w1-f9f277-openshift-default-869d58fb77-xbhch\" (UID: \"7b81a18e-7cc3-4ed4-b08e-20e426d4c3e1\") " pod="openshift-ingress/e2e-worker-w1-f9f277-openshift-default-869d58fb77-xbhch"
Oct 30 20:54:13.494500 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:54:13.494459    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7b81a18e-7cc3-4ed4-b08e-20e426d4c3e1-istio-podinfo\") pod \"e2e-worker-w1-f9f277-openshift-default-869d58fb77-xbhch\" (UID: \"7b81a18e-7cc3-4ed4-b08e-20e426d4c3e1\") " pod="openshift-ingress/e2e-worker-w1-f9f277-openshift-default-869d58fb77-xbhch"
Oct 30 20:54:13.494541 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:54:13.494508    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7b81a18e-7cc3-4ed4-b08e-20e426d4c3e1-workload-socket\") pod \"e2e-worker-w1-f9f277-openshift-default-869d58fb77-xbhch\" (UID: \"7b81a18e-7cc3-4ed4-b08e-20e426d4c3e1\") " pod="openshift-ingress/e2e-worker-w1-f9f277-openshift-default-869d58fb77-xbhch"
Oct 30 20:54:13.595304 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:54:13.595269    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7b81a18e-7cc3-4ed4-b08e-20e426d4c3e1-workload-socket\") pod \"e2e-worker-w1-f9f277-openshift-default-869d58fb77-xbhch\" (UID: \"7b81a18e-7cc3-4ed4-b08e-20e426d4c3e1\") " pod="openshift-ingress/e2e-worker-w1-f9f277-openshift-default-869d58fb77-xbhch"
Oct 30 20:54:13.595501 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:54:13.595311    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7b81a18e-7cc3-4ed4-b08e-20e426d4c3e1-istio-envoy\") pod \"e2e-worker-w1-f9f277-openshift-default-869d58fb77-xbhch\" (UID: \"7b81a18e-7cc3-4ed4-b08e-20e426d4c3e1\") " pod="openshift-ingress/e2e-worker-w1-f9f277-openshift-default-869d58fb77-xbhch"
Oct 30 20:54:13.595501 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:54:13.595360    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7b81a18e-7cc3-4ed4-b08e-20e426d4c3e1-istio-token\") pod \"e2e-worker-w1-f9f277-openshift-default-869d58fb77-xbhch\" (UID: \"7b81a18e-7cc3-4ed4-b08e-20e426d4c3e1\") " pod="openshift-ingress/e2e-worker-w1-f9f277-openshift-default-869d58fb77-xbhch"
Oct 30 20:54:13.595501 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:54:13.595397    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7b81a18e-7cc3-4ed4-b08e-20e426d4c3e1-workload-certs\") pod \"e2e-worker-w1-f9f277-openshift-default-869d58fb77-xbhch\" (UID: \"7b81a18e-7cc3-4ed4-b08e-20e426d4c3e1\") " pod="openshift-ingress/e2e-worker-w1-f9f277-openshift-default-869d58fb77-xbhch"
Oct 30 20:54:13.595501 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:54:13.595473    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7b81a18e-7cc3-4ed4-b08e-20e426d4c3e1-credential-socket\") pod \"e2e-worker-w1-f9f277-openshift-default-869d58fb77-xbhch\" (UID: \"7b81a18e-7cc3-4ed4-b08e-20e426d4c3e1\") " pod="openshift-ingress/e2e-worker-w1-f9f277-openshift-default-869d58fb77-xbhch"
Oct 30 20:54:13.595501 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:54:13.595499    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7b81a18e-7cc3-4ed4-b08e-20e426d4c3e1-istio-data\") pod \"e2e-worker-w1-f9f277-openshift-default-869d58fb77-xbhch\" (UID: \"7b81a18e-7cc3-4ed4-b08e-20e426d4c3e1\") " pod="openshift-ingress/e2e-worker-w1-f9f277-openshift-default-869d58fb77-xbhch"
Oct 30 20:54:13.595763 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:54:13.595536    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7b81a18e-7cc3-4ed4-b08e-20e426d4c3e1-istiod-ca-cert\") pod \"e2e-worker-w1-f9f277-openshift-default-869d58fb77-xbhch\" (UID: \"7b81a18e-7cc3-4ed4-b08e-20e426d4c3e1\") " pod="openshift-ingress/e2e-worker-w1-f9f277-openshift-default-869d58fb77-xbhch"
Oct 30 20:54:13.595763 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:54:13.595625    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2svql\" (UniqueName: \"kubernetes.io/projected/7b81a18e-7cc3-4ed4-b08e-20e426d4c3e1-kube-api-access-2svql\") pod \"e2e-worker-w1-f9f277-openshift-default-869d58fb77-xbhch\" (UID: \"7b81a18e-7cc3-4ed4-b08e-20e426d4c3e1\") " pod="openshift-ingress/e2e-worker-w1-f9f277-openshift-default-869d58fb77-xbhch"
Oct 30 20:54:13.595763 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:54:13.595653    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7b81a18e-7cc3-4ed4-b08e-20e426d4c3e1-istio-podinfo\") pod \"e2e-worker-w1-f9f277-openshift-default-869d58fb77-xbhch\" (UID: \"7b81a18e-7cc3-4ed4-b08e-20e426d4c3e1\") " pod="openshift-ingress/e2e-worker-w1-f9f277-openshift-default-869d58fb77-xbhch"
Oct 30 20:54:13.595763 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:54:13.595737    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7b81a18e-7cc3-4ed4-b08e-20e426d4c3e1-workload-socket\") pod \"e2e-worker-w1-f9f277-openshift-default-869d58fb77-xbhch\" (UID: \"7b81a18e-7cc3-4ed4-b08e-20e426d4c3e1\") " pod="openshift-ingress/e2e-worker-w1-f9f277-openshift-default-869d58fb77-xbhch"
Oct 30 20:54:13.595966 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:54:13.595912    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7b81a18e-7cc3-4ed4-b08e-20e426d4c3e1-credential-socket\") pod \"e2e-worker-w1-f9f277-openshift-default-869d58fb77-xbhch\" (UID: \"7b81a18e-7cc3-4ed4-b08e-20e426d4c3e1\") " pod="openshift-ingress/e2e-worker-w1-f9f277-openshift-default-869d58fb77-xbhch"
Oct 30 20:54:13.596344 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:54:13.596314    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7b81a18e-7cc3-4ed4-b08e-20e426d4c3e1-istiod-ca-cert\") pod \"e2e-worker-w1-f9f277-openshift-default-869d58fb77-xbhch\" (UID: \"7b81a18e-7cc3-4ed4-b08e-20e426d4c3e1\") " pod="openshift-ingress/e2e-worker-w1-f9f277-openshift-default-869d58fb77-xbhch"
Oct 30 20:54:13.596473 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:54:13.596454    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7b81a18e-7cc3-4ed4-b08e-20e426d4c3e1-istio-data\") pod \"e2e-worker-w1-f9f277-openshift-default-869d58fb77-xbhch\" (UID: \"7b81a18e-7cc3-4ed4-b08e-20e426d4c3e1\") " pod="openshift-ingress/e2e-worker-w1-f9f277-openshift-default-869d58fb77-xbhch"
Oct 30 20:54:13.596542 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:54:13.596458    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7b81a18e-7cc3-4ed4-b08e-20e426d4c3e1-workload-certs\") pod \"e2e-worker-w1-f9f277-openshift-default-869d58fb77-xbhch\" (UID: \"7b81a18e-7cc3-4ed4-b08e-20e426d4c3e1\") " pod="openshift-ingress/e2e-worker-w1-f9f277-openshift-default-869d58fb77-xbhch"
Oct 30 20:54:13.597807 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:54:13.597778    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7b81a18e-7cc3-4ed4-b08e-20e426d4c3e1-istio-envoy\") pod \"e2e-worker-w1-f9f277-openshift-default-869d58fb77-xbhch\" (UID: \"7b81a18e-7cc3-4ed4-b08e-20e426d4c3e1\") " pod="openshift-ingress/e2e-worker-w1-f9f277-openshift-default-869d58fb77-xbhch"
Oct 30 20:54:13.598393 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:54:13.598372    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7b81a18e-7cc3-4ed4-b08e-20e426d4c3e1-istio-podinfo\") pod \"e2e-worker-w1-f9f277-openshift-default-869d58fb77-xbhch\" (UID: \"7b81a18e-7cc3-4ed4-b08e-20e426d4c3e1\") " pod="openshift-ingress/e2e-worker-w1-f9f277-openshift-default-869d58fb77-xbhch"
Oct 30 20:54:13.663109 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:54:13.663019    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7b81a18e-7cc3-4ed4-b08e-20e426d4c3e1-istio-token\") pod \"e2e-worker-w1-f9f277-openshift-default-869d58fb77-xbhch\" (UID: \"7b81a18e-7cc3-4ed4-b08e-20e426d4c3e1\") " pod="openshift-ingress/e2e-worker-w1-f9f277-openshift-default-869d58fb77-xbhch"
Oct 30 20:54:13.663109 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:54:13.663100    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2svql\" (UniqueName: \"kubernetes.io/projected/7b81a18e-7cc3-4ed4-b08e-20e426d4c3e1-kube-api-access-2svql\") pod \"e2e-worker-w1-f9f277-openshift-default-869d58fb77-xbhch\" (UID: \"7b81a18e-7cc3-4ed4-b08e-20e426d4c3e1\") " pod="openshift-ingress/e2e-worker-w1-f9f277-openshift-default-869d58fb77-xbhch"
Oct 30 20:54:13.687854 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:54:13.687819    6004 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-f9f277-openshift-default-869d58fb77-xbhch"
Oct 30 20:54:14.118994 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:54:14.118966    6004 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w1-f9f277-openshift-default-869d58fb77-xbhch"]
Oct 30 20:54:14.120471 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:54:14.120436    6004 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7b81a18e_7cc3_4ed4_b08e_20e426d4c3e1.slice/crio-ff20a13bafeae47a6fa7b916e9e1a9f8fa6b3c9847b49a94528c724387dd6328 WatchSource:0}: Error finding container ff20a13bafeae47a6fa7b916e9e1a9f8fa6b3c9847b49a94528c724387dd6328: Status 404 returned error can't find the container with id ff20a13bafeae47a6fa7b916e9e1a9f8fa6b3c9847b49a94528c724387dd6328
Oct 30 20:54:14.123123 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:54:14.123091    6004 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 20:54:14.123201 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:54:14.123154    6004 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 20:54:14.123201 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:54:14.123183    6004 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 20:54:14.297066 ip-10-0-138-85 kubenswrapper[6004]: E1030 20:54:14.297004    6004 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-zz4wr" containerName="extractor"
Oct 30 20:54:14.421577 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:54:14.421479    6004 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-f9f277-openshift-default-869d58fb77-xbhch" event={"ID":"7b81a18e-7cc3-4ed4-b08e-20e426d4c3e1","Type":"ContainerStarted","Data":"c42b3540610ffdfbecb349d1f724ad59a74469c3492a0e717b7ad66663c801b5"}
Oct 30 20:54:14.421577 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:54:14.421538    6004 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-f9f277-openshift-default-869d58fb77-xbhch" event={"ID":"7b81a18e-7cc3-4ed4-b08e-20e426d4c3e1","Type":"ContainerStarted","Data":"ff20a13bafeae47a6fa7b916e9e1a9f8fa6b3c9847b49a94528c724387dd6328"}
Oct 30 20:54:14.542887 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:54:14.542818    6004 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w1-f9f277-openshift-default-869d58fb77-xbhch" podStartSLOduration=1.542800566 podStartE2EDuration="1.542800566s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:54:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:54:14.538505231 +0000 UTC m=+960.458291341" watchObservedRunningTime="2026-10-30 20:54:14.542800566 +0000 UTC m=+960.462586685"
Oct 30 20:54:14.688420 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:54:14.688391    6004 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w1-f9f277-openshift-default-869d58fb77-xbhch"
Oct 30 20:54:15.689692 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:54:15.689657    6004 patch_prober.go:29] interesting pod/e2e-worker-w1-f9f277-openshift-default-869d58fb77-xbhch container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.64:15021/healthz/ready\": dial tcp 10.132.0.64:15021: connect: connection refused" start-of-body=
Oct 30 20:54:15.690160 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:54:15.689732    6004 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-f9f277-openshift-default-869d58fb77-xbhch" podUID="7b81a18e-7cc3-4ed4-b08e-20e426d4c3e1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.64:15021/healthz/ready\": dial tcp 10.132.0.64:15021: connect: connection refused"
Oct 30 20:54:16.688429 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:54:16.688392    6004 patch_prober.go:29] interesting pod/e2e-worker-w1-f9f277-openshift-default-869d58fb77-xbhch container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.64:15021/healthz/ready\": dial tcp 10.132.0.64:15021: connect: connection refused" start-of-body=
Oct 30 20:54:16.688609 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:54:16.688448    6004 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-f9f277-openshift-default-869d58fb77-xbhch" podUID="7b81a18e-7cc3-4ed4-b08e-20e426d4c3e1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.64:15021/healthz/ready\": dial tcp 10.132.0.64:15021: connect: connection refused"
Oct 30 20:54:17.688138 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:54:17.688103    6004 patch_prober.go:29] interesting pod/e2e-worker-w1-f9f277-openshift-default-869d58fb77-xbhch container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.64:15021/healthz/ready\": dial tcp 10.132.0.64:15021: connect: connection refused" start-of-body=
Oct 30 20:54:17.688523 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:54:17.688161    6004 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-f9f277-openshift-default-869d58fb77-xbhch" podUID="7b81a18e-7cc3-4ed4-b08e-20e426d4c3e1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.64:15021/healthz/ready\": dial tcp 10.132.0.64:15021: connect: connection refused"
Oct 30 20:54:18.689192 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:54:18.689160    6004 patch_prober.go:29] interesting pod/e2e-worker-w1-f9f277-openshift-default-869d58fb77-xbhch container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.64:15021/healthz/ready\": dial tcp 10.132.0.64:15021: connect: connection refused" start-of-body=
Oct 30 20:54:18.689577 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:54:18.689222    6004 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-f9f277-openshift-default-869d58fb77-xbhch" podUID="7b81a18e-7cc3-4ed4-b08e-20e426d4c3e1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.64:15021/healthz/ready\": dial tcp 10.132.0.64:15021: connect: connection refused"
Oct 30 20:54:19.688568 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:54:19.688521    6004 patch_prober.go:29] interesting pod/e2e-worker-w1-f9f277-openshift-default-869d58fb77-xbhch container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.64:15021/healthz/ready\": dial tcp 10.132.0.64:15021: connect: connection refused" start-of-body=
Oct 30 20:54:19.688798 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:54:19.688585    6004 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-f9f277-openshift-default-869d58fb77-xbhch" podUID="7b81a18e-7cc3-4ed4-b08e-20e426d4c3e1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.64:15021/healthz/ready\": dial tcp 10.132.0.64:15021: connect: connection refused"
Oct 30 20:54:20.787010 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:54:20.786979    6004 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w1-f9f277-openshift-default-869d58fb77-xbhch"
Oct 30 20:54:20.787541 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:54:20.787501    6004 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w1-f9f277-openshift-default-869d58fb77-xbhch"
Oct 30 20:54:20.788340 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:54:20.788320    6004 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w1-f9f277-openshift-default-869d58fb77-xbhch"
Oct 30 20:54:39.822952 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:54:39.822916    6004 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-769df7846c-d4xk7"]
Oct 30 20:54:39.823502 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:54:39.823164    6004 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-d4xk7" podUID="0e8f5c36-1420-425c-9283-b5ecfd4419a2" containerName="istio-proxy" containerID="cri-o://34b7138493616f9fb061f2b9ff25878f1279917e60d96644725868fda888f66c" gracePeriod=30
Oct 30 20:54:43.779702 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:54:43.779667    6004 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-769df7846c-d4xk7 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Oct 30 20:54:43.780191 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:54:43.779730    6004 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-d4xk7" podUID="0e8f5c36-1420-425c-9283-b5ecfd4419a2" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 30 20:54:44.288892 ip-10-0-138-85 kubenswrapper[6004]: E1030 20:54:44.288845    6004 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-zz4wr" containerName="extractor"
Oct 30 20:54:45.090043 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:54:45.090010    6004 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-d4xk7"
Oct 30 20:54:45.173839 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:54:45.173751    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/0e8f5c36-1420-425c-9283-b5ecfd4419a2-istio-token\" (UniqueName: \"kubernetes.io/projected/0e8f5c36-1420-425c-9283-b5ecfd4419a2-istio-token\") pod \"0e8f5c36-1420-425c-9283-b5ecfd4419a2\" (UID: \"0e8f5c36-1420-425c-9283-b5ecfd4419a2\") "
Oct 30 20:54:45.173839 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:54:45.173816    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/0e8f5c36-1420-425c-9283-b5ecfd4419a2-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0e8f5c36-1420-425c-9283-b5ecfd4419a2-workload-socket\") pod \"0e8f5c36-1420-425c-9283-b5ecfd4419a2\" (UID: \"0e8f5c36-1420-425c-9283-b5ecfd4419a2\") "
Oct 30 20:54:45.174074 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:54:45.173858    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/0e8f5c36-1420-425c-9283-b5ecfd4419a2-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0e8f5c36-1420-425c-9283-b5ecfd4419a2-istio-envoy\") pod \"0e8f5c36-1420-425c-9283-b5ecfd4419a2\" (UID: \"0e8f5c36-1420-425c-9283-b5ecfd4419a2\") "
Oct 30 20:54:45.174074 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:54:45.173907    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/0e8f5c36-1420-425c-9283-b5ecfd4419a2-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0e8f5c36-1420-425c-9283-b5ecfd4419a2-credential-socket\") pod \"0e8f5c36-1420-425c-9283-b5ecfd4419a2\" (UID: \"0e8f5c36-1420-425c-9283-b5ecfd4419a2\") "
Oct 30 20:54:45.174074 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:54:45.173934    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/0e8f5c36-1420-425c-9283-b5ecfd4419a2-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0e8f5c36-1420-425c-9283-b5ecfd4419a2-istio-data\") pod \"0e8f5c36-1420-425c-9283-b5ecfd4419a2\" (UID: \"0e8f5c36-1420-425c-9283-b5ecfd4419a2\") "
Oct 30 20:54:45.174074 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:54:45.174017    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/0e8f5c36-1420-425c-9283-b5ecfd4419a2-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0e8f5c36-1420-425c-9283-b5ecfd4419a2-istio-podinfo\") pod \"0e8f5c36-1420-425c-9283-b5ecfd4419a2\" (UID: \"0e8f5c36-1420-425c-9283-b5ecfd4419a2\") "
Oct 30 20:54:45.174285 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:54:45.174093    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/0e8f5c36-1420-425c-9283-b5ecfd4419a2-kube-api-access-76sp5\" (UniqueName: \"kubernetes.io/projected/0e8f5c36-1420-425c-9283-b5ecfd4419a2-kube-api-access-76sp5\") pod \"0e8f5c36-1420-425c-9283-b5ecfd4419a2\" (UID: \"0e8f5c36-1420-425c-9283-b5ecfd4419a2\") "
Oct 30 20:54:45.174285 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:54:45.174138    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/0e8f5c36-1420-425c-9283-b5ecfd4419a2-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0e8f5c36-1420-425c-9283-b5ecfd4419a2-workload-certs\") pod \"0e8f5c36-1420-425c-9283-b5ecfd4419a2\" (UID: \"0e8f5c36-1420-425c-9283-b5ecfd4419a2\") "
Oct 30 20:54:45.174285 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:54:45.174169    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/0e8f5c36-1420-425c-9283-b5ecfd4419a2-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0e8f5c36-1420-425c-9283-b5ecfd4419a2-istiod-ca-cert\") pod \"0e8f5c36-1420-425c-9283-b5ecfd4419a2\" (UID: \"0e8f5c36-1420-425c-9283-b5ecfd4419a2\") "
Oct 30 20:54:45.174805 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:54:45.174501    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0e8f5c36-1420-425c-9283-b5ecfd4419a2-istio-data" pod "0e8f5c36-1420-425c-9283-b5ecfd4419a2" (UID: "0e8f5c36-1420-425c-9283-b5ecfd4419a2"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:54:45.174805 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:54:45.174587    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0e8f5c36-1420-425c-9283-b5ecfd4419a2-workload-socket" pod "0e8f5c36-1420-425c-9283-b5ecfd4419a2" (UID: "0e8f5c36-1420-425c-9283-b5ecfd4419a2"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:54:45.174805 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:54:45.174614    6004 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0e8f5c36-1420-425c-9283-b5ecfd4419a2-istio-data\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:54:45.175028 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:54:45.174836    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0e8f5c36-1420-425c-9283-b5ecfd4419a2-credential-socket" pod "0e8f5c36-1420-425c-9283-b5ecfd4419a2" (UID: "0e8f5c36-1420-425c-9283-b5ecfd4419a2"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:54:45.175028 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:54:45.174855    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0e8f5c36-1420-425c-9283-b5ecfd4419a2-workload-certs" pod "0e8f5c36-1420-425c-9283-b5ecfd4419a2" (UID: "0e8f5c36-1420-425c-9283-b5ecfd4419a2"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:54:45.175164 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:54:45.175132    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0e8f5c36-1420-425c-9283-b5ecfd4419a2-istiod-ca-cert" pod "0e8f5c36-1420-425c-9283-b5ecfd4419a2" (UID: "0e8f5c36-1420-425c-9283-b5ecfd4419a2"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 20:54:45.178030 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:54:45.177897    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/0e8f5c36-1420-425c-9283-b5ecfd4419a2-istio-podinfo" pod "0e8f5c36-1420-425c-9283-b5ecfd4419a2" (UID: "0e8f5c36-1420-425c-9283-b5ecfd4419a2"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 20:54:45.178030 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:54:45.177993    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0e8f5c36-1420-425c-9283-b5ecfd4419a2-kube-api-access-76sp5" pod "0e8f5c36-1420-425c-9283-b5ecfd4419a2" (UID: "0e8f5c36-1420-425c-9283-b5ecfd4419a2"). InnerVolumeSpecName "kube-api-access-76sp5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:54:45.178621 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:54:45.178592    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0e8f5c36-1420-425c-9283-b5ecfd4419a2-istio-token" pod "0e8f5c36-1420-425c-9283-b5ecfd4419a2" (UID: "0e8f5c36-1420-425c-9283-b5ecfd4419a2"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:54:45.179609 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:54:45.179582    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0e8f5c36-1420-425c-9283-b5ecfd4419a2-istio-envoy" pod "0e8f5c36-1420-425c-9283-b5ecfd4419a2" (UID: "0e8f5c36-1420-425c-9283-b5ecfd4419a2"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:54:45.276097 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:54:45.276028    6004 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-76sp5\" (UniqueName: \"kubernetes.io/projected/0e8f5c36-1420-425c-9283-b5ecfd4419a2-kube-api-access-76sp5\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:54:45.276097 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:54:45.276099    6004 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0e8f5c36-1420-425c-9283-b5ecfd4419a2-workload-certs\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:54:45.276286 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:54:45.276115    6004 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0e8f5c36-1420-425c-9283-b5ecfd4419a2-istiod-ca-cert\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:54:45.276286 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:54:45.276128    6004 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0e8f5c36-1420-425c-9283-b5ecfd4419a2-istio-token\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:54:45.276286 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:54:45.276141    6004 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0e8f5c36-1420-425c-9283-b5ecfd4419a2-workload-socket\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:54:45.276286 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:54:45.276153    6004 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0e8f5c36-1420-425c-9283-b5ecfd4419a2-istio-envoy\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:54:45.276286 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:54:45.276167    6004 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0e8f5c36-1420-425c-9283-b5ecfd4419a2-credential-socket\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:54:45.276286 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:54:45.276181    6004 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0e8f5c36-1420-425c-9283-b5ecfd4419a2-istio-podinfo\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:54:45.639129 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:54:45.639094    6004 generic.go:356] "Generic (PLEG): container finished" podID="0e8f5c36-1420-425c-9283-b5ecfd4419a2" containerID="34b7138493616f9fb061f2b9ff25878f1279917e60d96644725868fda888f66c" exitCode=0
Oct 30 20:54:45.639345 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:54:45.639166    6004 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-d4xk7"
Oct 30 20:54:45.639345 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:54:45.639185    6004 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-d4xk7" event={"ID":"0e8f5c36-1420-425c-9283-b5ecfd4419a2","Type":"ContainerDied","Data":"34b7138493616f9fb061f2b9ff25878f1279917e60d96644725868fda888f66c"}
Oct 30 20:54:45.639345 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:54:45.639243    6004 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-d4xk7" event={"ID":"0e8f5c36-1420-425c-9283-b5ecfd4419a2","Type":"ContainerDied","Data":"775f91789e4e33bfb3b9b01b8e4332582ae1bbab8e34bb32004bf2cc1ca8bbb7"}
Oct 30 20:54:45.639345 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:54:45.639261    6004 scope.go:122] "RemoveContainer" containerID="34b7138493616f9fb061f2b9ff25878f1279917e60d96644725868fda888f66c"
Oct 30 20:54:45.649438 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:54:45.649421    6004 scope.go:122] "RemoveContainer" containerID="197ce9838c8cc218dae12d24af5da9823e02fbac3d950cc19b3a9241f35d1d55"
Oct 30 20:54:45.659805 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:54:45.659775    6004 scope.go:122] "RemoveContainer" containerID="34b7138493616f9fb061f2b9ff25878f1279917e60d96644725868fda888f66c"
Oct 30 20:54:45.660209 ip-10-0-138-85 kubenswrapper[6004]: E1030 20:54:45.660178    6004 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"34b7138493616f9fb061f2b9ff25878f1279917e60d96644725868fda888f66c\": container with ID starting with 34b7138493616f9fb061f2b9ff25878f1279917e60d96644725868fda888f66c not found: ID does not exist" containerID="34b7138493616f9fb061f2b9ff25878f1279917e60d96644725868fda888f66c"
Oct 30 20:54:45.660318 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:54:45.660219    6004 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"34b7138493616f9fb061f2b9ff25878f1279917e60d96644725868fda888f66c"} err="failed to get container status \"34b7138493616f9fb061f2b9ff25878f1279917e60d96644725868fda888f66c\": rpc error: code = NotFound desc = could not find container \"34b7138493616f9fb061f2b9ff25878f1279917e60d96644725868fda888f66c\": container with ID starting with 34b7138493616f9fb061f2b9ff25878f1279917e60d96644725868fda888f66c not found: ID does not exist"
Oct 30 20:54:45.660318 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:54:45.660245    6004 scope.go:122] "RemoveContainer" containerID="197ce9838c8cc218dae12d24af5da9823e02fbac3d950cc19b3a9241f35d1d55"
Oct 30 20:54:45.660584 ip-10-0-138-85 kubenswrapper[6004]: E1030 20:54:45.660561    6004 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"197ce9838c8cc218dae12d24af5da9823e02fbac3d950cc19b3a9241f35d1d55\": container with ID starting with 197ce9838c8cc218dae12d24af5da9823e02fbac3d950cc19b3a9241f35d1d55 not found: ID does not exist" containerID="197ce9838c8cc218dae12d24af5da9823e02fbac3d950cc19b3a9241f35d1d55"
Oct 30 20:54:45.660666 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:54:45.660593    6004 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"197ce9838c8cc218dae12d24af5da9823e02fbac3d950cc19b3a9241f35d1d55"} err="failed to get container status \"197ce9838c8cc218dae12d24af5da9823e02fbac3d950cc19b3a9241f35d1d55\": rpc error: code = NotFound desc = could not find container \"197ce9838c8cc218dae12d24af5da9823e02fbac3d950cc19b3a9241f35d1d55\": container with ID starting with 197ce9838c8cc218dae12d24af5da9823e02fbac3d950cc19b3a9241f35d1d55 not found: ID does not exist"
Oct 30 20:54:45.806158 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:54:45.806123    6004 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-769df7846c-d4xk7"]
Oct 30 20:54:45.856173 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:54:45.856142    6004 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-769df7846c-d4xk7"]
Oct 30 20:54:46.231366 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:54:46.231331    6004 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="0e8f5c36-1420-425c-9283-b5ecfd4419a2" path="/var/lib/kubelet/pods/0e8f5c36-1420-425c-9283-b5ecfd4419a2/volumes"
Oct 30 20:55:14.288422 ip-10-0-138-85 kubenswrapper[6004]: E1030 20:55:14.288384    6004 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-zz4wr" containerName="extractor"
Oct 30 20:55:44.287524 ip-10-0-138-85 kubenswrapper[6004]: E1030 20:55:44.287480    6004 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-zz4wr" containerName="extractor"
Oct 30 20:55:45.511074 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:55:45.511016    6004 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w4-1fdaa7-openshift-default-84586db7d5-nk462"]
Oct 30 20:55:45.511628 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:55:45.511607    6004 cpu_manager.go:414] "containerMap: removing container" podUID="0e8f5c36-1420-425c-9283-b5ecfd4419a2" containerName="istio-proxy"
Oct 30 20:55:45.511677 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:55:45.511630    6004 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="0e8f5c36-1420-425c-9283-b5ecfd4419a2" containerName="istio-proxy"
Oct 30 20:55:45.511796 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:55:45.511785    6004 memory_manager.go:365] "RemoveStaleState removing state" podUID="0e8f5c36-1420-425c-9283-b5ecfd4419a2" containerName="istio-proxy"
Oct 30 20:55:45.511831 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:55:45.511800    6004 memory_manager.go:365] "RemoveStaleState removing state" podUID="0e8f5c36-1420-425c-9283-b5ecfd4419a2" containerName="istio-proxy"
Oct 30 20:55:45.515205 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:55:45.515189    6004 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-1fdaa7-openshift-default-84586db7d5-nk462"
Oct 30 20:55:45.568312 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:55:45.568286    6004 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w4-1fdaa7-openshift-default-dockercfg-57h8w\""
Oct 30 20:55:45.608114 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:55:45.608077    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/86e216f8-8779-4e13-963f-c12b4af68042-workload-socket\") pod \"e2e-worker-w4-1fdaa7-openshift-default-84586db7d5-nk462\" (UID: \"86e216f8-8779-4e13-963f-c12b4af68042\") " pod="openshift-ingress/e2e-worker-w4-1fdaa7-openshift-default-84586db7d5-nk462"
Oct 30 20:55:45.608268 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:55:45.608129    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/86e216f8-8779-4e13-963f-c12b4af68042-credential-socket\") pod \"e2e-worker-w4-1fdaa7-openshift-default-84586db7d5-nk462\" (UID: \"86e216f8-8779-4e13-963f-c12b4af68042\") " pod="openshift-ingress/e2e-worker-w4-1fdaa7-openshift-default-84586db7d5-nk462"
Oct 30 20:55:45.608320 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:55:45.608253    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/86e216f8-8779-4e13-963f-c12b4af68042-workload-certs\") pod \"e2e-worker-w4-1fdaa7-openshift-default-84586db7d5-nk462\" (UID: \"86e216f8-8779-4e13-963f-c12b4af68042\") " pod="openshift-ingress/e2e-worker-w4-1fdaa7-openshift-default-84586db7d5-nk462"
Oct 30 20:55:45.608320 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:55:45.608298    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v7kq8\" (UniqueName: \"kubernetes.io/projected/86e216f8-8779-4e13-963f-c12b4af68042-kube-api-access-v7kq8\") pod \"e2e-worker-w4-1fdaa7-openshift-default-84586db7d5-nk462\" (UID: \"86e216f8-8779-4e13-963f-c12b4af68042\") " pod="openshift-ingress/e2e-worker-w4-1fdaa7-openshift-default-84586db7d5-nk462"
Oct 30 20:55:45.608419 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:55:45.608395    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/86e216f8-8779-4e13-963f-c12b4af68042-istio-envoy\") pod \"e2e-worker-w4-1fdaa7-openshift-default-84586db7d5-nk462\" (UID: \"86e216f8-8779-4e13-963f-c12b4af68042\") " pod="openshift-ingress/e2e-worker-w4-1fdaa7-openshift-default-84586db7d5-nk462"
Oct 30 20:55:45.608458 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:55:45.608431    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/86e216f8-8779-4e13-963f-c12b4af68042-istiod-ca-cert\") pod \"e2e-worker-w4-1fdaa7-openshift-default-84586db7d5-nk462\" (UID: \"86e216f8-8779-4e13-963f-c12b4af68042\") " pod="openshift-ingress/e2e-worker-w4-1fdaa7-openshift-default-84586db7d5-nk462"
Oct 30 20:55:45.608519 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:55:45.608456    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/86e216f8-8779-4e13-963f-c12b4af68042-istio-token\") pod \"e2e-worker-w4-1fdaa7-openshift-default-84586db7d5-nk462\" (UID: \"86e216f8-8779-4e13-963f-c12b4af68042\") " pod="openshift-ingress/e2e-worker-w4-1fdaa7-openshift-default-84586db7d5-nk462"
Oct 30 20:55:45.608567 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:55:45.608523    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/86e216f8-8779-4e13-963f-c12b4af68042-istio-podinfo\") pod \"e2e-worker-w4-1fdaa7-openshift-default-84586db7d5-nk462\" (UID: \"86e216f8-8779-4e13-963f-c12b4af68042\") " pod="openshift-ingress/e2e-worker-w4-1fdaa7-openshift-default-84586db7d5-nk462"
Oct 30 20:55:45.608661 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:55:45.608598    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/86e216f8-8779-4e13-963f-c12b4af68042-istio-data\") pod \"e2e-worker-w4-1fdaa7-openshift-default-84586db7d5-nk462\" (UID: \"86e216f8-8779-4e13-963f-c12b4af68042\") " pod="openshift-ingress/e2e-worker-w4-1fdaa7-openshift-default-84586db7d5-nk462"
Oct 30 20:55:45.621528 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:55:45.621503    6004 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w4-1fdaa7-openshift-default-84586db7d5-nk462"]
Oct 30 20:55:45.709724 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:55:45.709688    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/86e216f8-8779-4e13-963f-c12b4af68042-istiod-ca-cert\") pod \"e2e-worker-w4-1fdaa7-openshift-default-84586db7d5-nk462\" (UID: \"86e216f8-8779-4e13-963f-c12b4af68042\") " pod="openshift-ingress/e2e-worker-w4-1fdaa7-openshift-default-84586db7d5-nk462"
Oct 30 20:55:45.709724 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:55:45.709727    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/86e216f8-8779-4e13-963f-c12b4af68042-istio-token\") pod \"e2e-worker-w4-1fdaa7-openshift-default-84586db7d5-nk462\" (UID: \"86e216f8-8779-4e13-963f-c12b4af68042\") " pod="openshift-ingress/e2e-worker-w4-1fdaa7-openshift-default-84586db7d5-nk462"
Oct 30 20:55:45.709982 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:55:45.709753    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/86e216f8-8779-4e13-963f-c12b4af68042-istio-podinfo\") pod \"e2e-worker-w4-1fdaa7-openshift-default-84586db7d5-nk462\" (UID: \"86e216f8-8779-4e13-963f-c12b4af68042\") " pod="openshift-ingress/e2e-worker-w4-1fdaa7-openshift-default-84586db7d5-nk462"
Oct 30 20:55:45.709982 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:55:45.709776    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/86e216f8-8779-4e13-963f-c12b4af68042-istio-data\") pod \"e2e-worker-w4-1fdaa7-openshift-default-84586db7d5-nk462\" (UID: \"86e216f8-8779-4e13-963f-c12b4af68042\") " pod="openshift-ingress/e2e-worker-w4-1fdaa7-openshift-default-84586db7d5-nk462"
Oct 30 20:55:45.709982 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:55:45.709802    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/86e216f8-8779-4e13-963f-c12b4af68042-workload-socket\") pod \"e2e-worker-w4-1fdaa7-openshift-default-84586db7d5-nk462\" (UID: \"86e216f8-8779-4e13-963f-c12b4af68042\") " pod="openshift-ingress/e2e-worker-w4-1fdaa7-openshift-default-84586db7d5-nk462"
Oct 30 20:55:45.709982 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:55:45.709825    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/86e216f8-8779-4e13-963f-c12b4af68042-credential-socket\") pod \"e2e-worker-w4-1fdaa7-openshift-default-84586db7d5-nk462\" (UID: \"86e216f8-8779-4e13-963f-c12b4af68042\") " pod="openshift-ingress/e2e-worker-w4-1fdaa7-openshift-default-84586db7d5-nk462"
Oct 30 20:55:45.709982 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:55:45.709872    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/86e216f8-8779-4e13-963f-c12b4af68042-workload-certs\") pod \"e2e-worker-w4-1fdaa7-openshift-default-84586db7d5-nk462\" (UID: \"86e216f8-8779-4e13-963f-c12b4af68042\") " pod="openshift-ingress/e2e-worker-w4-1fdaa7-openshift-default-84586db7d5-nk462"
Oct 30 20:55:45.709982 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:55:45.709903    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v7kq8\" (UniqueName: \"kubernetes.io/projected/86e216f8-8779-4e13-963f-c12b4af68042-kube-api-access-v7kq8\") pod \"e2e-worker-w4-1fdaa7-openshift-default-84586db7d5-nk462\" (UID: \"86e216f8-8779-4e13-963f-c12b4af68042\") " pod="openshift-ingress/e2e-worker-w4-1fdaa7-openshift-default-84586db7d5-nk462"
Oct 30 20:55:45.709982 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:55:45.709970    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/86e216f8-8779-4e13-963f-c12b4af68042-istio-envoy\") pod \"e2e-worker-w4-1fdaa7-openshift-default-84586db7d5-nk462\" (UID: \"86e216f8-8779-4e13-963f-c12b4af68042\") " pod="openshift-ingress/e2e-worker-w4-1fdaa7-openshift-default-84586db7d5-nk462"
Oct 30 20:55:45.710355 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:55:45.710328    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/86e216f8-8779-4e13-963f-c12b4af68042-workload-certs\") pod \"e2e-worker-w4-1fdaa7-openshift-default-84586db7d5-nk462\" (UID: \"86e216f8-8779-4e13-963f-c12b4af68042\") " pod="openshift-ingress/e2e-worker-w4-1fdaa7-openshift-default-84586db7d5-nk462"
Oct 30 20:55:45.710419 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:55:45.710379    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/86e216f8-8779-4e13-963f-c12b4af68042-istio-data\") pod \"e2e-worker-w4-1fdaa7-openshift-default-84586db7d5-nk462\" (UID: \"86e216f8-8779-4e13-963f-c12b4af68042\") " pod="openshift-ingress/e2e-worker-w4-1fdaa7-openshift-default-84586db7d5-nk462"
Oct 30 20:55:45.710475 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:55:45.710444    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/86e216f8-8779-4e13-963f-c12b4af68042-credential-socket\") pod \"e2e-worker-w4-1fdaa7-openshift-default-84586db7d5-nk462\" (UID: \"86e216f8-8779-4e13-963f-c12b4af68042\") " pod="openshift-ingress/e2e-worker-w4-1fdaa7-openshift-default-84586db7d5-nk462"
Oct 30 20:55:45.710587 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:55:45.710567    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/86e216f8-8779-4e13-963f-c12b4af68042-istiod-ca-cert\") pod \"e2e-worker-w4-1fdaa7-openshift-default-84586db7d5-nk462\" (UID: \"86e216f8-8779-4e13-963f-c12b4af68042\") " pod="openshift-ingress/e2e-worker-w4-1fdaa7-openshift-default-84586db7d5-nk462"
Oct 30 20:55:45.710708 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:55:45.710690    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/86e216f8-8779-4e13-963f-c12b4af68042-workload-socket\") pod \"e2e-worker-w4-1fdaa7-openshift-default-84586db7d5-nk462\" (UID: \"86e216f8-8779-4e13-963f-c12b4af68042\") " pod="openshift-ingress/e2e-worker-w4-1fdaa7-openshift-default-84586db7d5-nk462"
Oct 30 20:55:45.712146 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:55:45.712123    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/86e216f8-8779-4e13-963f-c12b4af68042-istio-envoy\") pod \"e2e-worker-w4-1fdaa7-openshift-default-84586db7d5-nk462\" (UID: \"86e216f8-8779-4e13-963f-c12b4af68042\") " pod="openshift-ingress/e2e-worker-w4-1fdaa7-openshift-default-84586db7d5-nk462"
Oct 30 20:55:45.712378 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:55:45.712359    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/86e216f8-8779-4e13-963f-c12b4af68042-istio-podinfo\") pod \"e2e-worker-w4-1fdaa7-openshift-default-84586db7d5-nk462\" (UID: \"86e216f8-8779-4e13-963f-c12b4af68042\") " pod="openshift-ingress/e2e-worker-w4-1fdaa7-openshift-default-84586db7d5-nk462"
Oct 30 20:55:45.767625 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:55:45.767552    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/86e216f8-8779-4e13-963f-c12b4af68042-istio-token\") pod \"e2e-worker-w4-1fdaa7-openshift-default-84586db7d5-nk462\" (UID: \"86e216f8-8779-4e13-963f-c12b4af68042\") " pod="openshift-ingress/e2e-worker-w4-1fdaa7-openshift-default-84586db7d5-nk462"
Oct 30 20:55:45.767760 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:55:45.767688    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v7kq8\" (UniqueName: \"kubernetes.io/projected/86e216f8-8779-4e13-963f-c12b4af68042-kube-api-access-v7kq8\") pod \"e2e-worker-w4-1fdaa7-openshift-default-84586db7d5-nk462\" (UID: \"86e216f8-8779-4e13-963f-c12b4af68042\") " pod="openshift-ingress/e2e-worker-w4-1fdaa7-openshift-default-84586db7d5-nk462"
Oct 30 20:55:45.827785 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:55:45.827749    6004 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-1fdaa7-openshift-default-84586db7d5-nk462"
Oct 30 20:55:46.252264 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:55:46.252235    6004 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w4-1fdaa7-openshift-default-84586db7d5-nk462"]
Oct 30 20:55:46.253122 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:55:46.253098    6004 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod86e216f8_8779_4e13_963f_c12b4af68042.slice/crio-7e7eea6a83b122e2a1e252c139c083198423d3bc914b7c49c68745220bb6d8e7 WatchSource:0}: Error finding container 7e7eea6a83b122e2a1e252c139c083198423d3bc914b7c49c68745220bb6d8e7: Status 404 returned error can't find the container with id 7e7eea6a83b122e2a1e252c139c083198423d3bc914b7c49c68745220bb6d8e7
Oct 30 20:55:46.255611 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:55:46.255571    6004 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 20:55:46.255702 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:55:46.255650    6004 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 20:55:46.255702 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:55:46.255681    6004 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 20:55:47.068666 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:55:47.068623    6004 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-1fdaa7-openshift-default-84586db7d5-nk462" event={"ID":"86e216f8-8779-4e13-963f-c12b4af68042","Type":"ContainerStarted","Data":"b47ca309e2b25b5921f6a3c9a0ce695a7a351284ab3c57e08d5321ce2ca15955"}
Oct 30 20:55:47.069114 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:55:47.068692    6004 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-1fdaa7-openshift-default-84586db7d5-nk462" event={"ID":"86e216f8-8779-4e13-963f-c12b4af68042","Type":"ContainerStarted","Data":"7e7eea6a83b122e2a1e252c139c083198423d3bc914b7c49c68745220bb6d8e7"}
Oct 30 20:55:47.827913 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:55:47.827880    6004 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w4-1fdaa7-openshift-default-84586db7d5-nk462"
Oct 30 20:55:47.829709 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:55:47.829680    6004 patch_prober.go:29] interesting pod/e2e-worker-w4-1fdaa7-openshift-default-84586db7d5-nk462 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.65:15021/healthz/ready\": dial tcp 10.132.0.65:15021: connect: connection refused" start-of-body=
Oct 30 20:55:47.829842 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:55:47.829735    6004 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-1fdaa7-openshift-default-84586db7d5-nk462" podUID="86e216f8-8779-4e13-963f-c12b4af68042" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.65:15021/healthz/ready\": dial tcp 10.132.0.65:15021: connect: connection refused"
Oct 30 20:55:48.828864 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:55:48.828822    6004 patch_prober.go:29] interesting pod/e2e-worker-w4-1fdaa7-openshift-default-84586db7d5-nk462 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.65:15021/healthz/ready\": dial tcp 10.132.0.65:15021: connect: connection refused" start-of-body=
Oct 30 20:55:48.829283 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:55:48.828894    6004 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-1fdaa7-openshift-default-84586db7d5-nk462" podUID="86e216f8-8779-4e13-963f-c12b4af68042" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.65:15021/healthz/ready\": dial tcp 10.132.0.65:15021: connect: connection refused"
Oct 30 20:55:49.829094 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:55:49.829039    6004 patch_prober.go:29] interesting pod/e2e-worker-w4-1fdaa7-openshift-default-84586db7d5-nk462 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.65:15021/healthz/ready\": dial tcp 10.132.0.65:15021: connect: connection refused" start-of-body=
Oct 30 20:55:49.829580 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:55:49.829114    6004 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-1fdaa7-openshift-default-84586db7d5-nk462" podUID="86e216f8-8779-4e13-963f-c12b4af68042" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.65:15021/healthz/ready\": dial tcp 10.132.0.65:15021: connect: connection refused"
Oct 30 20:55:50.828165 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:55:50.828134    6004 patch_prober.go:29] interesting pod/e2e-worker-w4-1fdaa7-openshift-default-84586db7d5-nk462 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.65:15021/healthz/ready\": dial tcp 10.132.0.65:15021: connect: connection refused" start-of-body=
Oct 30 20:55:50.828335 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:55:50.828199    6004 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-1fdaa7-openshift-default-84586db7d5-nk462" podUID="86e216f8-8779-4e13-963f-c12b4af68042" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.65:15021/healthz/ready\": dial tcp 10.132.0.65:15021: connect: connection refused"
Oct 30 20:55:51.828509 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:55:51.828475    6004 patch_prober.go:29] interesting pod/e2e-worker-w4-1fdaa7-openshift-default-84586db7d5-nk462 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.65:15021/healthz/ready\": dial tcp 10.132.0.65:15021: connect: connection refused" start-of-body=
Oct 30 20:55:51.828901 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:55:51.828526    6004 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-1fdaa7-openshift-default-84586db7d5-nk462" podUID="86e216f8-8779-4e13-963f-c12b4af68042" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.65:15021/healthz/ready\": dial tcp 10.132.0.65:15021: connect: connection refused"
Oct 30 20:55:52.861415 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:55:52.861382    6004 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w4-1fdaa7-openshift-default-84586db7d5-nk462"
Oct 30 20:55:52.861941 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:55:52.861864    6004 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w4-1fdaa7-openshift-default-84586db7d5-nk462"
Oct 30 20:55:52.862715 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:55:52.862686    6004 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w4-1fdaa7-openshift-default-84586db7d5-nk462"
Oct 30 20:55:53.043282 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:55:53.043230    6004 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w4-1fdaa7-openshift-default-84586db7d5-nk462" podStartSLOduration=8.043217229 podStartE2EDuration="8.043217229s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:55:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:55:47.245289811 +0000 UTC m=+1053.165075931" watchObservedRunningTime="2026-10-30 20:55:53.043217229 +0000 UTC m=+1058.963003397"
Oct 30 20:55:59.921381 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:55:59.921348    6004 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w3-682999-openshift-default-54dcb797b5-n25td"]
Oct 30 20:55:59.923684 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:55:59.921807    6004 cpu_manager.go:414] "containerMap: removing container" podUID="0e8f5c36-1420-425c-9283-b5ecfd4419a2" containerName="istio-proxy"
Oct 30 20:55:59.923684 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:55:59.921817    6004 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="0e8f5c36-1420-425c-9283-b5ecfd4419a2" containerName="istio-proxy"
Oct 30 20:55:59.924952 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:55:59.924936    6004 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-682999-openshift-default-54dcb797b5-n25td"
Oct 30 20:56:00.020248 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:56:00.020210    6004 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w3-682999-openshift-default-54dcb797b5-n25td"]
Oct 30 20:56:00.084959 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:56:00.084927    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a5e6ce52-9255-48ba-a723-2628da49fdd2-istio-data\") pod \"e2e-worker-w3-682999-openshift-default-54dcb797b5-n25td\" (UID: \"a5e6ce52-9255-48ba-a723-2628da49fdd2\") " pod="openshift-ingress/e2e-worker-w3-682999-openshift-default-54dcb797b5-n25td"
Oct 30 20:56:00.085179 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:56:00.084974    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a5e6ce52-9255-48ba-a723-2628da49fdd2-istio-envoy\") pod \"e2e-worker-w3-682999-openshift-default-54dcb797b5-n25td\" (UID: \"a5e6ce52-9255-48ba-a723-2628da49fdd2\") " pod="openshift-ingress/e2e-worker-w3-682999-openshift-default-54dcb797b5-n25td"
Oct 30 20:56:00.085179 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:56:00.085132    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a5e6ce52-9255-48ba-a723-2628da49fdd2-istio-podinfo\") pod \"e2e-worker-w3-682999-openshift-default-54dcb797b5-n25td\" (UID: \"a5e6ce52-9255-48ba-a723-2628da49fdd2\") " pod="openshift-ingress/e2e-worker-w3-682999-openshift-default-54dcb797b5-n25td"
Oct 30 20:56:00.085179 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:56:00.085159    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a5e6ce52-9255-48ba-a723-2628da49fdd2-workload-certs\") pod \"e2e-worker-w3-682999-openshift-default-54dcb797b5-n25td\" (UID: \"a5e6ce52-9255-48ba-a723-2628da49fdd2\") " pod="openshift-ingress/e2e-worker-w3-682999-openshift-default-54dcb797b5-n25td"
Oct 30 20:56:00.085354 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:56:00.085182    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a5e6ce52-9255-48ba-a723-2628da49fdd2-istiod-ca-cert\") pod \"e2e-worker-w3-682999-openshift-default-54dcb797b5-n25td\" (UID: \"a5e6ce52-9255-48ba-a723-2628da49fdd2\") " pod="openshift-ingress/e2e-worker-w3-682999-openshift-default-54dcb797b5-n25td"
Oct 30 20:56:00.085354 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:56:00.085290    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-npzl8\" (UniqueName: \"kubernetes.io/projected/a5e6ce52-9255-48ba-a723-2628da49fdd2-kube-api-access-npzl8\") pod \"e2e-worker-w3-682999-openshift-default-54dcb797b5-n25td\" (UID: \"a5e6ce52-9255-48ba-a723-2628da49fdd2\") " pod="openshift-ingress/e2e-worker-w3-682999-openshift-default-54dcb797b5-n25td"
Oct 30 20:56:00.085455 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:56:00.085358    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a5e6ce52-9255-48ba-a723-2628da49fdd2-credential-socket\") pod \"e2e-worker-w3-682999-openshift-default-54dcb797b5-n25td\" (UID: \"a5e6ce52-9255-48ba-a723-2628da49fdd2\") " pod="openshift-ingress/e2e-worker-w3-682999-openshift-default-54dcb797b5-n25td"
Oct 30 20:56:00.085455 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:56:00.085385    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a5e6ce52-9255-48ba-a723-2628da49fdd2-istio-token\") pod \"e2e-worker-w3-682999-openshift-default-54dcb797b5-n25td\" (UID: \"a5e6ce52-9255-48ba-a723-2628da49fdd2\") " pod="openshift-ingress/e2e-worker-w3-682999-openshift-default-54dcb797b5-n25td"
Oct 30 20:56:00.085455 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:56:00.085403    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a5e6ce52-9255-48ba-a723-2628da49fdd2-workload-socket\") pod \"e2e-worker-w3-682999-openshift-default-54dcb797b5-n25td\" (UID: \"a5e6ce52-9255-48ba-a723-2628da49fdd2\") " pod="openshift-ingress/e2e-worker-w3-682999-openshift-default-54dcb797b5-n25td"
Oct 30 20:56:00.186121 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:56:00.186082    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a5e6ce52-9255-48ba-a723-2628da49fdd2-istio-podinfo\") pod \"e2e-worker-w3-682999-openshift-default-54dcb797b5-n25td\" (UID: \"a5e6ce52-9255-48ba-a723-2628da49fdd2\") " pod="openshift-ingress/e2e-worker-w3-682999-openshift-default-54dcb797b5-n25td"
Oct 30 20:56:00.186312 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:56:00.186128    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a5e6ce52-9255-48ba-a723-2628da49fdd2-workload-certs\") pod \"e2e-worker-w3-682999-openshift-default-54dcb797b5-n25td\" (UID: \"a5e6ce52-9255-48ba-a723-2628da49fdd2\") " pod="openshift-ingress/e2e-worker-w3-682999-openshift-default-54dcb797b5-n25td"
Oct 30 20:56:00.186312 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:56:00.186164    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a5e6ce52-9255-48ba-a723-2628da49fdd2-istiod-ca-cert\") pod \"e2e-worker-w3-682999-openshift-default-54dcb797b5-n25td\" (UID: \"a5e6ce52-9255-48ba-a723-2628da49fdd2\") " pod="openshift-ingress/e2e-worker-w3-682999-openshift-default-54dcb797b5-n25td"
Oct 30 20:56:00.186312 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:56:00.186207    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-npzl8\" (UniqueName: \"kubernetes.io/projected/a5e6ce52-9255-48ba-a723-2628da49fdd2-kube-api-access-npzl8\") pod \"e2e-worker-w3-682999-openshift-default-54dcb797b5-n25td\" (UID: \"a5e6ce52-9255-48ba-a723-2628da49fdd2\") " pod="openshift-ingress/e2e-worker-w3-682999-openshift-default-54dcb797b5-n25td"
Oct 30 20:56:00.186312 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:56:00.186254    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a5e6ce52-9255-48ba-a723-2628da49fdd2-credential-socket\") pod \"e2e-worker-w3-682999-openshift-default-54dcb797b5-n25td\" (UID: \"a5e6ce52-9255-48ba-a723-2628da49fdd2\") " pod="openshift-ingress/e2e-worker-w3-682999-openshift-default-54dcb797b5-n25td"
Oct 30 20:56:00.186312 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:56:00.186277    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a5e6ce52-9255-48ba-a723-2628da49fdd2-istio-token\") pod \"e2e-worker-w3-682999-openshift-default-54dcb797b5-n25td\" (UID: \"a5e6ce52-9255-48ba-a723-2628da49fdd2\") " pod="openshift-ingress/e2e-worker-w3-682999-openshift-default-54dcb797b5-n25td"
Oct 30 20:56:00.186312 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:56:00.186303    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a5e6ce52-9255-48ba-a723-2628da49fdd2-workload-socket\") pod \"e2e-worker-w3-682999-openshift-default-54dcb797b5-n25td\" (UID: \"a5e6ce52-9255-48ba-a723-2628da49fdd2\") " pod="openshift-ingress/e2e-worker-w3-682999-openshift-default-54dcb797b5-n25td"
Oct 30 20:56:00.186619 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:56:00.186340    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a5e6ce52-9255-48ba-a723-2628da49fdd2-istio-data\") pod \"e2e-worker-w3-682999-openshift-default-54dcb797b5-n25td\" (UID: \"a5e6ce52-9255-48ba-a723-2628da49fdd2\") " pod="openshift-ingress/e2e-worker-w3-682999-openshift-default-54dcb797b5-n25td"
Oct 30 20:56:00.186619 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:56:00.186376    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a5e6ce52-9255-48ba-a723-2628da49fdd2-istio-envoy\") pod \"e2e-worker-w3-682999-openshift-default-54dcb797b5-n25td\" (UID: \"a5e6ce52-9255-48ba-a723-2628da49fdd2\") " pod="openshift-ingress/e2e-worker-w3-682999-openshift-default-54dcb797b5-n25td"
Oct 30 20:56:00.186619 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:56:00.186592    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a5e6ce52-9255-48ba-a723-2628da49fdd2-workload-certs\") pod \"e2e-worker-w3-682999-openshift-default-54dcb797b5-n25td\" (UID: \"a5e6ce52-9255-48ba-a723-2628da49fdd2\") " pod="openshift-ingress/e2e-worker-w3-682999-openshift-default-54dcb797b5-n25td"
Oct 30 20:56:00.186815 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:56:00.186789    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a5e6ce52-9255-48ba-a723-2628da49fdd2-credential-socket\") pod \"e2e-worker-w3-682999-openshift-default-54dcb797b5-n25td\" (UID: \"a5e6ce52-9255-48ba-a723-2628da49fdd2\") " pod="openshift-ingress/e2e-worker-w3-682999-openshift-default-54dcb797b5-n25td"
Oct 30 20:56:00.186966 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:56:00.186924    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a5e6ce52-9255-48ba-a723-2628da49fdd2-istio-data\") pod \"e2e-worker-w3-682999-openshift-default-54dcb797b5-n25td\" (UID: \"a5e6ce52-9255-48ba-a723-2628da49fdd2\") " pod="openshift-ingress/e2e-worker-w3-682999-openshift-default-54dcb797b5-n25td"
Oct 30 20:56:00.187114 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:56:00.187093    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a5e6ce52-9255-48ba-a723-2628da49fdd2-istiod-ca-cert\") pod \"e2e-worker-w3-682999-openshift-default-54dcb797b5-n25td\" (UID: \"a5e6ce52-9255-48ba-a723-2628da49fdd2\") " pod="openshift-ingress/e2e-worker-w3-682999-openshift-default-54dcb797b5-n25td"
Oct 30 20:56:00.187165 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:56:00.187108    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a5e6ce52-9255-48ba-a723-2628da49fdd2-workload-socket\") pod \"e2e-worker-w3-682999-openshift-default-54dcb797b5-n25td\" (UID: \"a5e6ce52-9255-48ba-a723-2628da49fdd2\") " pod="openshift-ingress/e2e-worker-w3-682999-openshift-default-54dcb797b5-n25td"
Oct 30 20:56:00.189040 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:56:00.189020    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a5e6ce52-9255-48ba-a723-2628da49fdd2-istio-envoy\") pod \"e2e-worker-w3-682999-openshift-default-54dcb797b5-n25td\" (UID: \"a5e6ce52-9255-48ba-a723-2628da49fdd2\") " pod="openshift-ingress/e2e-worker-w3-682999-openshift-default-54dcb797b5-n25td"
Oct 30 20:56:00.189388 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:56:00.189367    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a5e6ce52-9255-48ba-a723-2628da49fdd2-istio-podinfo\") pod \"e2e-worker-w3-682999-openshift-default-54dcb797b5-n25td\" (UID: \"a5e6ce52-9255-48ba-a723-2628da49fdd2\") " pod="openshift-ingress/e2e-worker-w3-682999-openshift-default-54dcb797b5-n25td"
Oct 30 20:56:00.245750 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:56:00.245713    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a5e6ce52-9255-48ba-a723-2628da49fdd2-istio-token\") pod \"e2e-worker-w3-682999-openshift-default-54dcb797b5-n25td\" (UID: \"a5e6ce52-9255-48ba-a723-2628da49fdd2\") " pod="openshift-ingress/e2e-worker-w3-682999-openshift-default-54dcb797b5-n25td"
Oct 30 20:56:00.245906 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:56:00.245757    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-npzl8\" (UniqueName: \"kubernetes.io/projected/a5e6ce52-9255-48ba-a723-2628da49fdd2-kube-api-access-npzl8\") pod \"e2e-worker-w3-682999-openshift-default-54dcb797b5-n25td\" (UID: \"a5e6ce52-9255-48ba-a723-2628da49fdd2\") " pod="openshift-ingress/e2e-worker-w3-682999-openshift-default-54dcb797b5-n25td"
Oct 30 20:56:00.539547 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:56:00.539452    6004 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-682999-openshift-default-54dcb797b5-n25td"
Oct 30 20:56:00.968247 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:56:00.968206    6004 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w3-682999-openshift-default-54dcb797b5-n25td"]
Oct 30 20:56:01.007877 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:56:01.007853    6004 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda5e6ce52_9255_48ba_a723_2628da49fdd2.slice/crio-312a90072c3a2f9fb82d3199f699b00453a829e9530c9fabfaefdce6d0bbd9d7 WatchSource:0}: Error finding container 312a90072c3a2f9fb82d3199f699b00453a829e9530c9fabfaefdce6d0bbd9d7: Status 404 returned error can't find the container with id 312a90072c3a2f9fb82d3199f699b00453a829e9530c9fabfaefdce6d0bbd9d7
Oct 30 20:56:01.010345 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:56:01.010312    6004 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 20:56:01.010451 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:56:01.010384    6004 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 20:56:01.010451 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:56:01.010424    6004 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 20:56:01.158304 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:56:01.158271    6004 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-682999-openshift-default-54dcb797b5-n25td" event={"ID":"a5e6ce52-9255-48ba-a723-2628da49fdd2","Type":"ContainerStarted","Data":"9738f5c5b5cff2375d615f2f91514e6f72e0508e01bacdbd184c5b5cb86b2e35"}
Oct 30 20:56:01.158504 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:56:01.158327    6004 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-682999-openshift-default-54dcb797b5-n25td" event={"ID":"a5e6ce52-9255-48ba-a723-2628da49fdd2","Type":"ContainerStarted","Data":"312a90072c3a2f9fb82d3199f699b00453a829e9530c9fabfaefdce6d0bbd9d7"}
Oct 30 20:56:01.277585 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:56:01.277480    6004 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w3-682999-openshift-default-54dcb797b5-n25td" podStartSLOduration=2.277463757 podStartE2EDuration="2.277463757s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:55:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:56:01.276459394 +0000 UTC m=+1067.196245513" watchObservedRunningTime="2026-10-30 20:56:01.277463757 +0000 UTC m=+1067.197249874"
Oct 30 20:56:01.550133 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:56:01.549147    6004 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w3-682999-openshift-default-54dcb797b5-n25td"
Oct 30 20:56:02.549625 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:56:02.549248    6004 patch_prober.go:29] interesting pod/e2e-worker-w3-682999-openshift-default-54dcb797b5-n25td container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.66:15021/healthz/ready\": dial tcp 10.132.0.66:15021: connect: connection refused" start-of-body=
Oct 30 20:56:02.549625 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:56:02.549327    6004 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-682999-openshift-default-54dcb797b5-n25td" podUID="a5e6ce52-9255-48ba-a723-2628da49fdd2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.66:15021/healthz/ready\": dial tcp 10.132.0.66:15021: connect: connection refused"
Oct 30 20:56:03.541489 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:56:03.541449    6004 patch_prober.go:29] interesting pod/e2e-worker-w3-682999-openshift-default-54dcb797b5-n25td container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.66:15021/healthz/ready\": dial tcp 10.132.0.66:15021: connect: connection refused" start-of-body=
Oct 30 20:56:03.541809 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:56:03.541779    6004 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-682999-openshift-default-54dcb797b5-n25td" podUID="a5e6ce52-9255-48ba-a723-2628da49fdd2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.66:15021/healthz/ready\": dial tcp 10.132.0.66:15021: connect: connection refused"
Oct 30 20:56:04.543497 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:56:04.543457    6004 patch_prober.go:29] interesting pod/e2e-worker-w3-682999-openshift-default-54dcb797b5-n25td container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.66:15021/healthz/ready\": dial tcp 10.132.0.66:15021: connect: connection refused" start-of-body=
Oct 30 20:56:04.544179 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:56:04.544142    6004 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-682999-openshift-default-54dcb797b5-n25td" podUID="a5e6ce52-9255-48ba-a723-2628da49fdd2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.66:15021/healthz/ready\": dial tcp 10.132.0.66:15021: connect: connection refused"
Oct 30 20:56:05.558076 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:56:05.557166    6004 patch_prober.go:29] interesting pod/e2e-worker-w3-682999-openshift-default-54dcb797b5-n25td container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.66:15021/healthz/ready\": dial tcp 10.132.0.66:15021: connect: connection refused" start-of-body=
Oct 30 20:56:05.558076 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:56:05.557235    6004 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-682999-openshift-default-54dcb797b5-n25td" podUID="a5e6ce52-9255-48ba-a723-2628da49fdd2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.66:15021/healthz/ready\": dial tcp 10.132.0.66:15021: connect: connection refused"
Oct 30 20:56:06.554521 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:56:06.554477    6004 patch_prober.go:29] interesting pod/e2e-worker-w3-682999-openshift-default-54dcb797b5-n25td container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.66:15021/healthz/ready\": dial tcp 10.132.0.66:15021: connect: connection refused" start-of-body=
Oct 30 20:56:06.554817 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:56:06.554782    6004 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-682999-openshift-default-54dcb797b5-n25td" podUID="a5e6ce52-9255-48ba-a723-2628da49fdd2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.66:15021/healthz/ready\": dial tcp 10.132.0.66:15021: connect: connection refused"
Oct 30 20:56:07.676183 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:56:07.676149    6004 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w3-682999-openshift-default-54dcb797b5-n25td"
Oct 30 20:56:07.677105 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:56:07.677079    6004 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w3-682999-openshift-default-54dcb797b5-n25td"
Oct 30 20:56:07.678373 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:56:07.678349    6004 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w3-682999-openshift-default-54dcb797b5-n25td"
Oct 30 20:56:10.503276 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:56:10.503244    6004 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-769df7846c-nm6wz"]
Oct 30 20:56:10.503755 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:56:10.503466    6004 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-nm6wz" podUID="a0172175-b38d-491b-a401-f70b85aa355c" containerName="istio-proxy" containerID="cri-o://88f89e6e7f08c20d3527fa4bf2aa28823a09c5277c19d7f84bf6ed0a12634db0" gracePeriod=30
Oct 30 20:56:14.286738 ip-10-0-138-85 kubenswrapper[6004]: E1030 20:56:14.286697    6004 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-zz4wr" containerName="extractor"
Oct 30 20:56:15.770991 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:56:15.770927    6004 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-nm6wz"
Oct 30 20:56:15.884561 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:56:15.884528    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/a0172175-b38d-491b-a401-f70b85aa355c-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a0172175-b38d-491b-a401-f70b85aa355c-istio-podinfo\") pod \"a0172175-b38d-491b-a401-f70b85aa355c\" (UID: \"a0172175-b38d-491b-a401-f70b85aa355c\") "
Oct 30 20:56:15.884561 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:56:15.884572    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/a0172175-b38d-491b-a401-f70b85aa355c-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a0172175-b38d-491b-a401-f70b85aa355c-workload-certs\") pod \"a0172175-b38d-491b-a401-f70b85aa355c\" (UID: \"a0172175-b38d-491b-a401-f70b85aa355c\") "
Oct 30 20:56:15.884776 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:56:15.884613    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/a0172175-b38d-491b-a401-f70b85aa355c-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a0172175-b38d-491b-a401-f70b85aa355c-istio-envoy\") pod \"a0172175-b38d-491b-a401-f70b85aa355c\" (UID: \"a0172175-b38d-491b-a401-f70b85aa355c\") "
Oct 30 20:56:15.884776 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:56:15.884650    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/a0172175-b38d-491b-a401-f70b85aa355c-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a0172175-b38d-491b-a401-f70b85aa355c-workload-socket\") pod \"a0172175-b38d-491b-a401-f70b85aa355c\" (UID: \"a0172175-b38d-491b-a401-f70b85aa355c\") "
Oct 30 20:56:15.884776 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:56:15.884709    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/a0172175-b38d-491b-a401-f70b85aa355c-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a0172175-b38d-491b-a401-f70b85aa355c-istiod-ca-cert\") pod \"a0172175-b38d-491b-a401-f70b85aa355c\" (UID: \"a0172175-b38d-491b-a401-f70b85aa355c\") "
Oct 30 20:56:15.884932 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:56:15.884799    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/a0172175-b38d-491b-a401-f70b85aa355c-kube-api-access-zd6gt\" (UniqueName: \"kubernetes.io/projected/a0172175-b38d-491b-a401-f70b85aa355c-kube-api-access-zd6gt\") pod \"a0172175-b38d-491b-a401-f70b85aa355c\" (UID: \"a0172175-b38d-491b-a401-f70b85aa355c\") "
Oct 30 20:56:15.884932 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:56:15.884847    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/a0172175-b38d-491b-a401-f70b85aa355c-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a0172175-b38d-491b-a401-f70b85aa355c-credential-socket\") pod \"a0172175-b38d-491b-a401-f70b85aa355c\" (UID: \"a0172175-b38d-491b-a401-f70b85aa355c\") "
Oct 30 20:56:15.884932 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:56:15.884889    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/a0172175-b38d-491b-a401-f70b85aa355c-istio-token\" (UniqueName: \"kubernetes.io/projected/a0172175-b38d-491b-a401-f70b85aa355c-istio-token\") pod \"a0172175-b38d-491b-a401-f70b85aa355c\" (UID: \"a0172175-b38d-491b-a401-f70b85aa355c\") "
Oct 30 20:56:15.885107 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:56:15.884933    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a0172175-b38d-491b-a401-f70b85aa355c-workload-certs" pod "a0172175-b38d-491b-a401-f70b85aa355c" (UID: "a0172175-b38d-491b-a401-f70b85aa355c"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:56:15.885107 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:56:15.884947    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/a0172175-b38d-491b-a401-f70b85aa355c-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a0172175-b38d-491b-a401-f70b85aa355c-istio-data\") pod \"a0172175-b38d-491b-a401-f70b85aa355c\" (UID: \"a0172175-b38d-491b-a401-f70b85aa355c\") "
Oct 30 20:56:15.885107 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:56:15.885040    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a0172175-b38d-491b-a401-f70b85aa355c-workload-socket" pod "a0172175-b38d-491b-a401-f70b85aa355c" (UID: "a0172175-b38d-491b-a401-f70b85aa355c"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:56:15.885275 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:56:15.885201    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a0172175-b38d-491b-a401-f70b85aa355c-istio-data" pod "a0172175-b38d-491b-a401-f70b85aa355c" (UID: "a0172175-b38d-491b-a401-f70b85aa355c"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:56:15.885275 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:56:15.885237    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a0172175-b38d-491b-a401-f70b85aa355c-credential-socket" pod "a0172175-b38d-491b-a401-f70b85aa355c" (UID: "a0172175-b38d-491b-a401-f70b85aa355c"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:56:15.885488 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:56:15.885461    6004 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a0172175-b38d-491b-a401-f70b85aa355c-workload-socket\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:56:15.885624 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:56:15.885492    6004 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a0172175-b38d-491b-a401-f70b85aa355c-credential-socket\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:56:15.885624 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:56:15.885508    6004 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a0172175-b38d-491b-a401-f70b85aa355c-istio-data\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:56:15.885624 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:56:15.885522    6004 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a0172175-b38d-491b-a401-f70b85aa355c-workload-certs\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:56:15.885805 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:56:15.885728    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a0172175-b38d-491b-a401-f70b85aa355c-istiod-ca-cert" pod "a0172175-b38d-491b-a401-f70b85aa355c" (UID: "a0172175-b38d-491b-a401-f70b85aa355c"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 20:56:15.887092 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:56:15.887040    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/a0172175-b38d-491b-a401-f70b85aa355c-istio-podinfo" pod "a0172175-b38d-491b-a401-f70b85aa355c" (UID: "a0172175-b38d-491b-a401-f70b85aa355c"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 20:56:15.887226 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:56:15.887145    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a0172175-b38d-491b-a401-f70b85aa355c-istio-envoy" pod "a0172175-b38d-491b-a401-f70b85aa355c" (UID: "a0172175-b38d-491b-a401-f70b85aa355c"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:56:15.887563 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:56:15.887539    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a0172175-b38d-491b-a401-f70b85aa355c-istio-token" pod "a0172175-b38d-491b-a401-f70b85aa355c" (UID: "a0172175-b38d-491b-a401-f70b85aa355c"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:56:15.887704 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:56:15.887681    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a0172175-b38d-491b-a401-f70b85aa355c-kube-api-access-zd6gt" pod "a0172175-b38d-491b-a401-f70b85aa355c" (UID: "a0172175-b38d-491b-a401-f70b85aa355c"). InnerVolumeSpecName "kube-api-access-zd6gt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:56:15.987101 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:56:15.987060    6004 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a0172175-b38d-491b-a401-f70b85aa355c-istio-envoy\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:56:15.987101 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:56:15.987100    6004 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a0172175-b38d-491b-a401-f70b85aa355c-istiod-ca-cert\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:56:15.987360 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:56:15.987116    6004 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zd6gt\" (UniqueName: \"kubernetes.io/projected/a0172175-b38d-491b-a401-f70b85aa355c-kube-api-access-zd6gt\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:56:15.987360 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:56:15.987129    6004 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a0172175-b38d-491b-a401-f70b85aa355c-istio-token\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:56:15.987360 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:56:15.987138    6004 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a0172175-b38d-491b-a401-f70b85aa355c-istio-podinfo\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:56:16.291223 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:56:16.291188    6004 generic.go:356] "Generic (PLEG): container finished" podID="a0172175-b38d-491b-a401-f70b85aa355c" containerID="88f89e6e7f08c20d3527fa4bf2aa28823a09c5277c19d7f84bf6ed0a12634db0" exitCode=0
Oct 30 20:56:16.291435 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:56:16.291251    6004 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-nm6wz" event={"ID":"a0172175-b38d-491b-a401-f70b85aa355c","Type":"ContainerDied","Data":"88f89e6e7f08c20d3527fa4bf2aa28823a09c5277c19d7f84bf6ed0a12634db0"}
Oct 30 20:56:16.291435 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:56:16.291309    6004 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-nm6wz" event={"ID":"a0172175-b38d-491b-a401-f70b85aa355c","Type":"ContainerDied","Data":"f413283bb1dc23c873673903fcc53b90367917ef8a8c3edfd30e7592baee9b93"}
Oct 30 20:56:16.291435 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:56:16.291336    6004 scope.go:122] "RemoveContainer" containerID="88f89e6e7f08c20d3527fa4bf2aa28823a09c5277c19d7f84bf6ed0a12634db0"
Oct 30 20:56:16.291601 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:56:16.291467    6004 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-nm6wz"
Oct 30 20:56:16.302344 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:56:16.302324    6004 scope.go:122] "RemoveContainer" containerID="88f89e6e7f08c20d3527fa4bf2aa28823a09c5277c19d7f84bf6ed0a12634db0"
Oct 30 20:56:16.302652 ip-10-0-138-85 kubenswrapper[6004]: E1030 20:56:16.302629    6004 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"88f89e6e7f08c20d3527fa4bf2aa28823a09c5277c19d7f84bf6ed0a12634db0\": container with ID starting with 88f89e6e7f08c20d3527fa4bf2aa28823a09c5277c19d7f84bf6ed0a12634db0 not found: ID does not exist" containerID="88f89e6e7f08c20d3527fa4bf2aa28823a09c5277c19d7f84bf6ed0a12634db0"
Oct 30 20:56:16.302760 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:56:16.302661    6004 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"88f89e6e7f08c20d3527fa4bf2aa28823a09c5277c19d7f84bf6ed0a12634db0"} err="failed to get container status \"88f89e6e7f08c20d3527fa4bf2aa28823a09c5277c19d7f84bf6ed0a12634db0\": rpc error: code = NotFound desc = could not find container \"88f89e6e7f08c20d3527fa4bf2aa28823a09c5277c19d7f84bf6ed0a12634db0\": container with ID starting with 88f89e6e7f08c20d3527fa4bf2aa28823a09c5277c19d7f84bf6ed0a12634db0 not found: ID does not exist"
Oct 30 20:56:16.458873 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:56:16.458840    6004 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-769df7846c-nm6wz"]
Oct 30 20:56:16.464138 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:56:16.464113    6004 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-769df7846c-nm6wz"]
Oct 30 20:56:17.524270 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:56:17.524237    6004 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w5-2b425d/distinct-w5-2b425d-kserve-dd4dcf7f-b227k"]
Oct 30 20:56:17.524791 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:56:17.524773    6004 cpu_manager.go:414] "containerMap: removing container" podUID="a0172175-b38d-491b-a401-f70b85aa355c" containerName="istio-proxy"
Oct 30 20:56:17.524834 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:56:17.524793    6004 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="a0172175-b38d-491b-a401-f70b85aa355c" containerName="istio-proxy"
Oct 30 20:56:17.524900 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:56:17.524891    6004 memory_manager.go:365] "RemoveStaleState removing state" podUID="a0172175-b38d-491b-a401-f70b85aa355c" containerName="istio-proxy"
Oct 30 20:56:17.529341 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:56:17.529322    6004 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w5-2b425d/distinct-w5-2b425d-kserve-dd4dcf7f-b227k"
Oct 30 20:56:17.586511 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:56:17.586471    6004 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w5-2b425d\"/\"default-dockercfg-h4z8l\""
Oct 30 20:56:17.586829 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:56:17.586804    6004 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w5-2b425d\"/\"openshift-service-ca.crt\""
Oct 30 20:56:17.636314 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:56:17.636285    6004 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w5-2b425d\"/\"kube-root-ca.crt\""
Oct 30 20:56:17.636508 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:56:17.636498    6004 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w5-2b425d\"/\"distinct-w5-2b425d-kserve-self-signed-certs\""
Oct 30 20:56:17.640190 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:56:17.640161    6004 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w5-2b425d/distinct-w5-2b425d-kserve-dd4dcf7f-b227k"]
Oct 30 20:56:17.704902 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:56:17.704862    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/802e5037-d6f5-4a37-a95f-b49dda7f8b1b-home\") pod \"distinct-w5-2b425d-kserve-dd4dcf7f-b227k\" (UID: \"802e5037-d6f5-4a37-a95f-b49dda7f8b1b\") " pod="e2e-models-e2e-worker-w5-2b425d/distinct-w5-2b425d-kserve-dd4dcf7f-b227k"
Oct 30 20:56:17.705147 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:56:17.704924    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cq8rq\" (UniqueName: \"kubernetes.io/projected/802e5037-d6f5-4a37-a95f-b49dda7f8b1b-kube-api-access-cq8rq\") pod \"distinct-w5-2b425d-kserve-dd4dcf7f-b227k\" (UID: \"802e5037-d6f5-4a37-a95f-b49dda7f8b1b\") " pod="e2e-models-e2e-worker-w5-2b425d/distinct-w5-2b425d-kserve-dd4dcf7f-b227k"
Oct 30 20:56:17.705147 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:56:17.705014    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/802e5037-d6f5-4a37-a95f-b49dda7f8b1b-dshm\") pod \"distinct-w5-2b425d-kserve-dd4dcf7f-b227k\" (UID: \"802e5037-d6f5-4a37-a95f-b49dda7f8b1b\") " pod="e2e-models-e2e-worker-w5-2b425d/distinct-w5-2b425d-kserve-dd4dcf7f-b227k"
Oct 30 20:56:17.705147 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:56:17.705040    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/802e5037-d6f5-4a37-a95f-b49dda7f8b1b-tls-certs\") pod \"distinct-w5-2b425d-kserve-dd4dcf7f-b227k\" (UID: \"802e5037-d6f5-4a37-a95f-b49dda7f8b1b\") " pod="e2e-models-e2e-worker-w5-2b425d/distinct-w5-2b425d-kserve-dd4dcf7f-b227k"
Oct 30 20:56:17.705313 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:56:17.705168    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/802e5037-d6f5-4a37-a95f-b49dda7f8b1b-tmp-dir\") pod \"distinct-w5-2b425d-kserve-dd4dcf7f-b227k\" (UID: \"802e5037-d6f5-4a37-a95f-b49dda7f8b1b\") " pod="e2e-models-e2e-worker-w5-2b425d/distinct-w5-2b425d-kserve-dd4dcf7f-b227k"
Oct 30 20:56:17.705313 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:56:17.705204    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/802e5037-d6f5-4a37-a95f-b49dda7f8b1b-model-cache\") pod \"distinct-w5-2b425d-kserve-dd4dcf7f-b227k\" (UID: \"802e5037-d6f5-4a37-a95f-b49dda7f8b1b\") " pod="e2e-models-e2e-worker-w5-2b425d/distinct-w5-2b425d-kserve-dd4dcf7f-b227k"
Oct 30 20:56:17.806751 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:56:17.806658    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cq8rq\" (UniqueName: \"kubernetes.io/projected/802e5037-d6f5-4a37-a95f-b49dda7f8b1b-kube-api-access-cq8rq\") pod \"distinct-w5-2b425d-kserve-dd4dcf7f-b227k\" (UID: \"802e5037-d6f5-4a37-a95f-b49dda7f8b1b\") " pod="e2e-models-e2e-worker-w5-2b425d/distinct-w5-2b425d-kserve-dd4dcf7f-b227k"
Oct 30 20:56:17.806751 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:56:17.806698    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/802e5037-d6f5-4a37-a95f-b49dda7f8b1b-dshm\") pod \"distinct-w5-2b425d-kserve-dd4dcf7f-b227k\" (UID: \"802e5037-d6f5-4a37-a95f-b49dda7f8b1b\") " pod="e2e-models-e2e-worker-w5-2b425d/distinct-w5-2b425d-kserve-dd4dcf7f-b227k"
Oct 30 20:56:17.806751 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:56:17.806730    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/802e5037-d6f5-4a37-a95f-b49dda7f8b1b-tls-certs\") pod \"distinct-w5-2b425d-kserve-dd4dcf7f-b227k\" (UID: \"802e5037-d6f5-4a37-a95f-b49dda7f8b1b\") " pod="e2e-models-e2e-worker-w5-2b425d/distinct-w5-2b425d-kserve-dd4dcf7f-b227k"
Oct 30 20:56:17.807033 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:56:17.806787    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/802e5037-d6f5-4a37-a95f-b49dda7f8b1b-tmp-dir\") pod \"distinct-w5-2b425d-kserve-dd4dcf7f-b227k\" (UID: \"802e5037-d6f5-4a37-a95f-b49dda7f8b1b\") " pod="e2e-models-e2e-worker-w5-2b425d/distinct-w5-2b425d-kserve-dd4dcf7f-b227k"
Oct 30 20:56:17.807033 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:56:17.806816    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/802e5037-d6f5-4a37-a95f-b49dda7f8b1b-model-cache\") pod \"distinct-w5-2b425d-kserve-dd4dcf7f-b227k\" (UID: \"802e5037-d6f5-4a37-a95f-b49dda7f8b1b\") " pod="e2e-models-e2e-worker-w5-2b425d/distinct-w5-2b425d-kserve-dd4dcf7f-b227k"
Oct 30 20:56:17.807033 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:56:17.806961    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/802e5037-d6f5-4a37-a95f-b49dda7f8b1b-home\") pod \"distinct-w5-2b425d-kserve-dd4dcf7f-b227k\" (UID: \"802e5037-d6f5-4a37-a95f-b49dda7f8b1b\") " pod="e2e-models-e2e-worker-w5-2b425d/distinct-w5-2b425d-kserve-dd4dcf7f-b227k"
Oct 30 20:56:17.807448 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:56:17.807369    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/802e5037-d6f5-4a37-a95f-b49dda7f8b1b-model-cache\") pod \"distinct-w5-2b425d-kserve-dd4dcf7f-b227k\" (UID: \"802e5037-d6f5-4a37-a95f-b49dda7f8b1b\") " pod="e2e-models-e2e-worker-w5-2b425d/distinct-w5-2b425d-kserve-dd4dcf7f-b227k"
Oct 30 20:56:17.807448 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:56:17.807382    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/802e5037-d6f5-4a37-a95f-b49dda7f8b1b-tmp-dir\") pod \"distinct-w5-2b425d-kserve-dd4dcf7f-b227k\" (UID: \"802e5037-d6f5-4a37-a95f-b49dda7f8b1b\") " pod="e2e-models-e2e-worker-w5-2b425d/distinct-w5-2b425d-kserve-dd4dcf7f-b227k"
Oct 30 20:56:17.807448 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:56:17.807440    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/802e5037-d6f5-4a37-a95f-b49dda7f8b1b-home\") pod \"distinct-w5-2b425d-kserve-dd4dcf7f-b227k\" (UID: \"802e5037-d6f5-4a37-a95f-b49dda7f8b1b\") " pod="e2e-models-e2e-worker-w5-2b425d/distinct-w5-2b425d-kserve-dd4dcf7f-b227k"
Oct 30 20:56:17.809435 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:56:17.809408    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/802e5037-d6f5-4a37-a95f-b49dda7f8b1b-dshm\") pod \"distinct-w5-2b425d-kserve-dd4dcf7f-b227k\" (UID: \"802e5037-d6f5-4a37-a95f-b49dda7f8b1b\") " pod="e2e-models-e2e-worker-w5-2b425d/distinct-w5-2b425d-kserve-dd4dcf7f-b227k"
Oct 30 20:56:17.809567 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:56:17.809480    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/802e5037-d6f5-4a37-a95f-b49dda7f8b1b-tls-certs\") pod \"distinct-w5-2b425d-kserve-dd4dcf7f-b227k\" (UID: \"802e5037-d6f5-4a37-a95f-b49dda7f8b1b\") " pod="e2e-models-e2e-worker-w5-2b425d/distinct-w5-2b425d-kserve-dd4dcf7f-b227k"
Oct 30 20:56:17.865547 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:56:17.865513    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cq8rq\" (UniqueName: \"kubernetes.io/projected/802e5037-d6f5-4a37-a95f-b49dda7f8b1b-kube-api-access-cq8rq\") pod \"distinct-w5-2b425d-kserve-dd4dcf7f-b227k\" (UID: \"802e5037-d6f5-4a37-a95f-b49dda7f8b1b\") " pod="e2e-models-e2e-worker-w5-2b425d/distinct-w5-2b425d-kserve-dd4dcf7f-b227k"
Oct 30 20:56:18.141472 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:56:18.141389    6004 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w5-2b425d/distinct-w5-2b425d-kserve-dd4dcf7f-b227k"
Oct 30 20:56:18.250069 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:56:18.249431    6004 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="a0172175-b38d-491b-a401-f70b85aa355c" path="/var/lib/kubelet/pods/a0172175-b38d-491b-a401-f70b85aa355c/volumes"
Oct 30 20:56:18.520866 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:56:18.520839    6004 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w5-2b425d/distinct-w5-2b425d-kserve-dd4dcf7f-b227k"]
Oct 30 20:56:18.522095 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:56:18.522066    6004 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod802e5037_d6f5_4a37_a95f_b49dda7f8b1b.slice/crio-f14d0f6e9e2da9de53b047e205a5b8038575b99c21d25a7c366d5044e2a7b378 WatchSource:0}: Error finding container f14d0f6e9e2da9de53b047e205a5b8038575b99c21d25a7c366d5044e2a7b378: Status 404 returned error can't find the container with id f14d0f6e9e2da9de53b047e205a5b8038575b99c21d25a7c366d5044e2a7b378
Oct 30 20:56:19.312715 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:56:19.312680    6004 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w5-2b425d/distinct-w5-2b425d-kserve-dd4dcf7f-b227k" event={"ID":"802e5037-d6f5-4a37-a95f-b49dda7f8b1b","Type":"ContainerStarted","Data":"ad121a89ef0a6902a78c2bc7bd588a38d35dbb834e72cf1672c0417c7211c12e"}
Oct 30 20:56:19.312715 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:56:19.312719    6004 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w5-2b425d/distinct-w5-2b425d-kserve-dd4dcf7f-b227k" event={"ID":"802e5037-d6f5-4a37-a95f-b49dda7f8b1b","Type":"ContainerStarted","Data":"f14d0f6e9e2da9de53b047e205a5b8038575b99c21d25a7c366d5044e2a7b378"}
Oct 30 20:56:19.430746 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:56:19.430690    6004 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-models-e2e-worker-w5-2b425d/distinct-w5-2b425d-kserve-dd4dcf7f-b227k" podStartSLOduration=2.430678029 podStartE2EDuration="2.430678029s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:56:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:56:19.428866093 +0000 UTC m=+1085.348652211" watchObservedRunningTime="2026-10-30 20:56:19.430678029 +0000 UTC m=+1085.350464146"
Oct 30 20:56:20.142531 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:56:20.142485    6004 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w5-2b425d/distinct-w5-2b425d-kserve-dd4dcf7f-b227k"
Oct 30 20:56:28.141814 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:56:28.141724    6004 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w5-2b425d/distinct-w5-2b425d-kserve-dd4dcf7f-b227k"
Oct 30 20:56:28.155413 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:56:28.155385    6004 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w5-2b425d/distinct-w5-2b425d-kserve-dd4dcf7f-b227k"
Oct 30 20:56:28.380478 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:56:28.380444    6004 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w5-2b425d/distinct-w5-2b425d-kserve-dd4dcf7f-b227k"
Oct 30 20:56:29.223939 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:56:29.223898    6004 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w1-f9f277/distinct-w1-f9f277-kserve-f947bc879-lzs6w"]
Oct 30 20:56:29.227832 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:56:29.227810    6004 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w1-f9f277/distinct-w1-f9f277-kserve-f947bc879-lzs6w"
Oct 30 20:56:29.331421 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:56:29.331372    6004 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w1-f9f277\"/\"kube-root-ca.crt\""
Oct 30 20:56:29.331583 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:56:29.331448    6004 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w1-f9f277\"/\"openshift-service-ca.crt\""
Oct 30 20:56:29.331583 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:56:29.331501    6004 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w1-f9f277\"/\"default-dockercfg-xbx2p\""
Oct 30 20:56:29.331583 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:56:29.331505    6004 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w1-f9f277\"/\"distinct-w1-f9f277-kserve-self-signed-certs\""
Oct 30 20:56:29.333849 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:56:29.333829    6004 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w1-f9f277/distinct-w1-f9f277-kserve-f947bc879-lzs6w"]
Oct 30 20:56:29.336195 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:56:29.336171    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pfchm\" (UniqueName: \"kubernetes.io/projected/f4ab8826-a6f1-41e6-897f-b808635017c5-kube-api-access-pfchm\") pod \"distinct-w1-f9f277-kserve-f947bc879-lzs6w\" (UID: \"f4ab8826-a6f1-41e6-897f-b808635017c5\") " pod="e2e-models-e2e-worker-w1-f9f277/distinct-w1-f9f277-kserve-f947bc879-lzs6w"
Oct 30 20:56:29.336271 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:56:29.336223    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f4ab8826-a6f1-41e6-897f-b808635017c5-model-cache\") pod \"distinct-w1-f9f277-kserve-f947bc879-lzs6w\" (UID: \"f4ab8826-a6f1-41e6-897f-b808635017c5\") " pod="e2e-models-e2e-worker-w1-f9f277/distinct-w1-f9f277-kserve-f947bc879-lzs6w"
Oct 30 20:56:29.336384 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:56:29.336366    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f4ab8826-a6f1-41e6-897f-b808635017c5-dshm\") pod \"distinct-w1-f9f277-kserve-f947bc879-lzs6w\" (UID: \"f4ab8826-a6f1-41e6-897f-b808635017c5\") " pod="e2e-models-e2e-worker-w1-f9f277/distinct-w1-f9f277-kserve-f947bc879-lzs6w"
Oct 30 20:56:29.336423 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:56:29.336398    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f4ab8826-a6f1-41e6-897f-b808635017c5-tmp-dir\") pod \"distinct-w1-f9f277-kserve-f947bc879-lzs6w\" (UID: \"f4ab8826-a6f1-41e6-897f-b808635017c5\") " pod="e2e-models-e2e-worker-w1-f9f277/distinct-w1-f9f277-kserve-f947bc879-lzs6w"
Oct 30 20:56:29.336457 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:56:29.336423    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f4ab8826-a6f1-41e6-897f-b808635017c5-tls-certs\") pod \"distinct-w1-f9f277-kserve-f947bc879-lzs6w\" (UID: \"f4ab8826-a6f1-41e6-897f-b808635017c5\") " pod="e2e-models-e2e-worker-w1-f9f277/distinct-w1-f9f277-kserve-f947bc879-lzs6w"
Oct 30 20:56:29.336530 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:56:29.336514    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f4ab8826-a6f1-41e6-897f-b808635017c5-home\") pod \"distinct-w1-f9f277-kserve-f947bc879-lzs6w\" (UID: \"f4ab8826-a6f1-41e6-897f-b808635017c5\") " pod="e2e-models-e2e-worker-w1-f9f277/distinct-w1-f9f277-kserve-f947bc879-lzs6w"
Oct 30 20:56:29.437642 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:56:29.437598    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f4ab8826-a6f1-41e6-897f-b808635017c5-dshm\") pod \"distinct-w1-f9f277-kserve-f947bc879-lzs6w\" (UID: \"f4ab8826-a6f1-41e6-897f-b808635017c5\") " pod="e2e-models-e2e-worker-w1-f9f277/distinct-w1-f9f277-kserve-f947bc879-lzs6w"
Oct 30 20:56:29.437816 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:56:29.437655    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f4ab8826-a6f1-41e6-897f-b808635017c5-tmp-dir\") pod \"distinct-w1-f9f277-kserve-f947bc879-lzs6w\" (UID: \"f4ab8826-a6f1-41e6-897f-b808635017c5\") " pod="e2e-models-e2e-worker-w1-f9f277/distinct-w1-f9f277-kserve-f947bc879-lzs6w"
Oct 30 20:56:29.437816 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:56:29.437690    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f4ab8826-a6f1-41e6-897f-b808635017c5-tls-certs\") pod \"distinct-w1-f9f277-kserve-f947bc879-lzs6w\" (UID: \"f4ab8826-a6f1-41e6-897f-b808635017c5\") " pod="e2e-models-e2e-worker-w1-f9f277/distinct-w1-f9f277-kserve-f947bc879-lzs6w"
Oct 30 20:56:29.437952 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:56:29.437925    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f4ab8826-a6f1-41e6-897f-b808635017c5-home\") pod \"distinct-w1-f9f277-kserve-f947bc879-lzs6w\" (UID: \"f4ab8826-a6f1-41e6-897f-b808635017c5\") " pod="e2e-models-e2e-worker-w1-f9f277/distinct-w1-f9f277-kserve-f947bc879-lzs6w"
Oct 30 20:56:29.438058 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:56:29.438029    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pfchm\" (UniqueName: \"kubernetes.io/projected/f4ab8826-a6f1-41e6-897f-b808635017c5-kube-api-access-pfchm\") pod \"distinct-w1-f9f277-kserve-f947bc879-lzs6w\" (UID: \"f4ab8826-a6f1-41e6-897f-b808635017c5\") " pod="e2e-models-e2e-worker-w1-f9f277/distinct-w1-f9f277-kserve-f947bc879-lzs6w"
Oct 30 20:56:29.438132 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:56:29.438115    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f4ab8826-a6f1-41e6-897f-b808635017c5-model-cache\") pod \"distinct-w1-f9f277-kserve-f947bc879-lzs6w\" (UID: \"f4ab8826-a6f1-41e6-897f-b808635017c5\") " pod="e2e-models-e2e-worker-w1-f9f277/distinct-w1-f9f277-kserve-f947bc879-lzs6w"
Oct 30 20:56:29.438286 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:56:29.438113    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f4ab8826-a6f1-41e6-897f-b808635017c5-tmp-dir\") pod \"distinct-w1-f9f277-kserve-f947bc879-lzs6w\" (UID: \"f4ab8826-a6f1-41e6-897f-b808635017c5\") " pod="e2e-models-e2e-worker-w1-f9f277/distinct-w1-f9f277-kserve-f947bc879-lzs6w"
Oct 30 20:56:29.438444 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:56:29.438317    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f4ab8826-a6f1-41e6-897f-b808635017c5-home\") pod \"distinct-w1-f9f277-kserve-f947bc879-lzs6w\" (UID: \"f4ab8826-a6f1-41e6-897f-b808635017c5\") " pod="e2e-models-e2e-worker-w1-f9f277/distinct-w1-f9f277-kserve-f947bc879-lzs6w"
Oct 30 20:56:29.438509 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:56:29.438376    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f4ab8826-a6f1-41e6-897f-b808635017c5-model-cache\") pod \"distinct-w1-f9f277-kserve-f947bc879-lzs6w\" (UID: \"f4ab8826-a6f1-41e6-897f-b808635017c5\") " pod="e2e-models-e2e-worker-w1-f9f277/distinct-w1-f9f277-kserve-f947bc879-lzs6w"
Oct 30 20:56:29.440517 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:56:29.440492    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f4ab8826-a6f1-41e6-897f-b808635017c5-dshm\") pod \"distinct-w1-f9f277-kserve-f947bc879-lzs6w\" (UID: \"f4ab8826-a6f1-41e6-897f-b808635017c5\") " pod="e2e-models-e2e-worker-w1-f9f277/distinct-w1-f9f277-kserve-f947bc879-lzs6w"
Oct 30 20:56:29.440779 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:56:29.440760    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f4ab8826-a6f1-41e6-897f-b808635017c5-tls-certs\") pod \"distinct-w1-f9f277-kserve-f947bc879-lzs6w\" (UID: \"f4ab8826-a6f1-41e6-897f-b808635017c5\") " pod="e2e-models-e2e-worker-w1-f9f277/distinct-w1-f9f277-kserve-f947bc879-lzs6w"
Oct 30 20:56:29.500435 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:56:29.500360    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pfchm\" (UniqueName: \"kubernetes.io/projected/f4ab8826-a6f1-41e6-897f-b808635017c5-kube-api-access-pfchm\") pod \"distinct-w1-f9f277-kserve-f947bc879-lzs6w\" (UID: \"f4ab8826-a6f1-41e6-897f-b808635017c5\") " pod="e2e-models-e2e-worker-w1-f9f277/distinct-w1-f9f277-kserve-f947bc879-lzs6w"
Oct 30 20:56:29.548256 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:56:29.548219    6004 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w1-f9f277/distinct-w1-f9f277-kserve-f947bc879-lzs6w"
Oct 30 20:56:29.998298 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:56:29.998268    6004 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w1-f9f277/distinct-w1-f9f277-kserve-f947bc879-lzs6w"]
Oct 30 20:56:30.000580 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:56:30.000544    6004 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf4ab8826_a6f1_41e6_897f_b808635017c5.slice/crio-6a31c94c4bdc147db3f92300cf15d4b9af673751540d07d1c25d7442dd3ecbbe WatchSource:0}: Error finding container 6a31c94c4bdc147db3f92300cf15d4b9af673751540d07d1c25d7442dd3ecbbe: Status 404 returned error can't find the container with id 6a31c94c4bdc147db3f92300cf15d4b9af673751540d07d1c25d7442dd3ecbbe
Oct 30 20:56:30.386995 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:56:30.386912    6004 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w1-f9f277/distinct-w1-f9f277-kserve-f947bc879-lzs6w" event={"ID":"f4ab8826-a6f1-41e6-897f-b808635017c5","Type":"ContainerStarted","Data":"484fab5b5a419492e7bed18994e40d23d984685d3e8de6075310329447b9468d"}
Oct 30 20:56:30.386995 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:56:30.386953    6004 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w1-f9f277/distinct-w1-f9f277-kserve-f947bc879-lzs6w" event={"ID":"f4ab8826-a6f1-41e6-897f-b808635017c5","Type":"ContainerStarted","Data":"6a31c94c4bdc147db3f92300cf15d4b9af673751540d07d1c25d7442dd3ecbbe"}
Oct 30 20:56:30.510317 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:56:30.510265    6004 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-models-e2e-worker-w1-f9f277/distinct-w1-f9f277-kserve-f947bc879-lzs6w" podStartSLOduration=1.5102505179999999 podStartE2EDuration="1.510250518s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:56:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:56:30.509570276 +0000 UTC m=+1096.429356394" watchObservedRunningTime="2026-10-30 20:56:30.510250518 +0000 UTC m=+1096.430036637"
Oct 30 20:56:30.549063 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:56:30.549016    6004 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w1-f9f277/distinct-w1-f9f277-kserve-f947bc879-lzs6w"
Oct 30 20:56:39.548521 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:56:39.548479    6004 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w1-f9f277/distinct-w1-f9f277-kserve-f947bc879-lzs6w"
Oct 30 20:56:39.567432 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:56:39.567395    6004 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w1-f9f277/distinct-w1-f9f277-kserve-f947bc879-lzs6w"
Oct 30 20:56:40.466517 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:56:40.466485    6004 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w1-f9f277/distinct-w1-f9f277-kserve-f947bc879-lzs6w"
Oct 30 20:56:44.311091 ip-10-0-138-85 kubenswrapper[6004]: E1030 20:56:44.311026    6004 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-zz4wr" containerName="extractor"
Oct 30 20:56:46.826511 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:56:46.826472    6004 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w2-d061d0-openshift-default-86b87f495-rlgwt"]
Oct 30 20:56:46.830674 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:56:46.830652    6004 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-d061d0-openshift-default-86b87f495-rlgwt"
Oct 30 20:56:46.883640 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:56:46.883606    6004 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w2-d061d0-openshift-default-dockercfg-cwlxq\""
Oct 30 20:56:46.935653 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:56:46.935615    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f2a479c8-1fe5-4264-b6cd-dafa68621543-istio-envoy\") pod \"e2e-worker-w2-d061d0-openshift-default-86b87f495-rlgwt\" (UID: \"f2a479c8-1fe5-4264-b6cd-dafa68621543\") " pod="openshift-ingress/e2e-worker-w2-d061d0-openshift-default-86b87f495-rlgwt"
Oct 30 20:56:46.935995 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:56:46.935976    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f2a479c8-1fe5-4264-b6cd-dafa68621543-istio-data\") pod \"e2e-worker-w2-d061d0-openshift-default-86b87f495-rlgwt\" (UID: \"f2a479c8-1fe5-4264-b6cd-dafa68621543\") " pod="openshift-ingress/e2e-worker-w2-d061d0-openshift-default-86b87f495-rlgwt"
Oct 30 20:56:46.936205 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:56:46.936186    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9hzfh\" (UniqueName: \"kubernetes.io/projected/f2a479c8-1fe5-4264-b6cd-dafa68621543-kube-api-access-9hzfh\") pod \"e2e-worker-w2-d061d0-openshift-default-86b87f495-rlgwt\" (UID: \"f2a479c8-1fe5-4264-b6cd-dafa68621543\") " pod="openshift-ingress/e2e-worker-w2-d061d0-openshift-default-86b87f495-rlgwt"
Oct 30 20:56:46.936370 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:56:46.936348    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f2a479c8-1fe5-4264-b6cd-dafa68621543-istiod-ca-cert\") pod \"e2e-worker-w2-d061d0-openshift-default-86b87f495-rlgwt\" (UID: \"f2a479c8-1fe5-4264-b6cd-dafa68621543\") " pod="openshift-ingress/e2e-worker-w2-d061d0-openshift-default-86b87f495-rlgwt"
Oct 30 20:56:46.936507 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:56:46.936380    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f2a479c8-1fe5-4264-b6cd-dafa68621543-workload-socket\") pod \"e2e-worker-w2-d061d0-openshift-default-86b87f495-rlgwt\" (UID: \"f2a479c8-1fe5-4264-b6cd-dafa68621543\") " pod="openshift-ingress/e2e-worker-w2-d061d0-openshift-default-86b87f495-rlgwt"
Oct 30 20:56:46.936507 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:56:46.936409    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f2a479c8-1fe5-4264-b6cd-dafa68621543-credential-socket\") pod \"e2e-worker-w2-d061d0-openshift-default-86b87f495-rlgwt\" (UID: \"f2a479c8-1fe5-4264-b6cd-dafa68621543\") " pod="openshift-ingress/e2e-worker-w2-d061d0-openshift-default-86b87f495-rlgwt"
Oct 30 20:56:46.936507 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:56:46.936459    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f2a479c8-1fe5-4264-b6cd-dafa68621543-istio-token\") pod \"e2e-worker-w2-d061d0-openshift-default-86b87f495-rlgwt\" (UID: \"f2a479c8-1fe5-4264-b6cd-dafa68621543\") " pod="openshift-ingress/e2e-worker-w2-d061d0-openshift-default-86b87f495-rlgwt"
Oct 30 20:56:46.936692 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:56:46.936528    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f2a479c8-1fe5-4264-b6cd-dafa68621543-workload-certs\") pod \"e2e-worker-w2-d061d0-openshift-default-86b87f495-rlgwt\" (UID: \"f2a479c8-1fe5-4264-b6cd-dafa68621543\") " pod="openshift-ingress/e2e-worker-w2-d061d0-openshift-default-86b87f495-rlgwt"
Oct 30 20:56:46.936692 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:56:46.936594    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f2a479c8-1fe5-4264-b6cd-dafa68621543-istio-podinfo\") pod \"e2e-worker-w2-d061d0-openshift-default-86b87f495-rlgwt\" (UID: \"f2a479c8-1fe5-4264-b6cd-dafa68621543\") " pod="openshift-ingress/e2e-worker-w2-d061d0-openshift-default-86b87f495-rlgwt"
Oct 30 20:56:46.938083 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:56:46.938029    6004 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w2-d061d0-openshift-default-86b87f495-rlgwt"]
Oct 30 20:56:47.037422 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:56:47.037391    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f2a479c8-1fe5-4264-b6cd-dafa68621543-istiod-ca-cert\") pod \"e2e-worker-w2-d061d0-openshift-default-86b87f495-rlgwt\" (UID: \"f2a479c8-1fe5-4264-b6cd-dafa68621543\") " pod="openshift-ingress/e2e-worker-w2-d061d0-openshift-default-86b87f495-rlgwt"
Oct 30 20:56:47.037611 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:56:47.037426    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f2a479c8-1fe5-4264-b6cd-dafa68621543-workload-socket\") pod \"e2e-worker-w2-d061d0-openshift-default-86b87f495-rlgwt\" (UID: \"f2a479c8-1fe5-4264-b6cd-dafa68621543\") " pod="openshift-ingress/e2e-worker-w2-d061d0-openshift-default-86b87f495-rlgwt"
Oct 30 20:56:47.037611 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:56:47.037449    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f2a479c8-1fe5-4264-b6cd-dafa68621543-credential-socket\") pod \"e2e-worker-w2-d061d0-openshift-default-86b87f495-rlgwt\" (UID: \"f2a479c8-1fe5-4264-b6cd-dafa68621543\") " pod="openshift-ingress/e2e-worker-w2-d061d0-openshift-default-86b87f495-rlgwt"
Oct 30 20:56:47.037611 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:56:47.037480    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f2a479c8-1fe5-4264-b6cd-dafa68621543-istio-token\") pod \"e2e-worker-w2-d061d0-openshift-default-86b87f495-rlgwt\" (UID: \"f2a479c8-1fe5-4264-b6cd-dafa68621543\") " pod="openshift-ingress/e2e-worker-w2-d061d0-openshift-default-86b87f495-rlgwt"
Oct 30 20:56:47.037779 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:56:47.037611    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f2a479c8-1fe5-4264-b6cd-dafa68621543-workload-certs\") pod \"e2e-worker-w2-d061d0-openshift-default-86b87f495-rlgwt\" (UID: \"f2a479c8-1fe5-4264-b6cd-dafa68621543\") " pod="openshift-ingress/e2e-worker-w2-d061d0-openshift-default-86b87f495-rlgwt"
Oct 30 20:56:47.037779 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:56:47.037759    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f2a479c8-1fe5-4264-b6cd-dafa68621543-istio-podinfo\") pod \"e2e-worker-w2-d061d0-openshift-default-86b87f495-rlgwt\" (UID: \"f2a479c8-1fe5-4264-b6cd-dafa68621543\") " pod="openshift-ingress/e2e-worker-w2-d061d0-openshift-default-86b87f495-rlgwt"
Oct 30 20:56:47.037883 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:56:47.037837    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f2a479c8-1fe5-4264-b6cd-dafa68621543-istio-envoy\") pod \"e2e-worker-w2-d061d0-openshift-default-86b87f495-rlgwt\" (UID: \"f2a479c8-1fe5-4264-b6cd-dafa68621543\") " pod="openshift-ingress/e2e-worker-w2-d061d0-openshift-default-86b87f495-rlgwt"
Oct 30 20:56:47.037937 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:56:47.037887    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f2a479c8-1fe5-4264-b6cd-dafa68621543-workload-socket\") pod \"e2e-worker-w2-d061d0-openshift-default-86b87f495-rlgwt\" (UID: \"f2a479c8-1fe5-4264-b6cd-dafa68621543\") " pod="openshift-ingress/e2e-worker-w2-d061d0-openshift-default-86b87f495-rlgwt"
Oct 30 20:56:47.037992 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:56:47.037946    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f2a479c8-1fe5-4264-b6cd-dafa68621543-istio-data\") pod \"e2e-worker-w2-d061d0-openshift-default-86b87f495-rlgwt\" (UID: \"f2a479c8-1fe5-4264-b6cd-dafa68621543\") " pod="openshift-ingress/e2e-worker-w2-d061d0-openshift-default-86b87f495-rlgwt"
Oct 30 20:56:47.038041 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:56:47.038006    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9hzfh\" (UniqueName: \"kubernetes.io/projected/f2a479c8-1fe5-4264-b6cd-dafa68621543-kube-api-access-9hzfh\") pod \"e2e-worker-w2-d061d0-openshift-default-86b87f495-rlgwt\" (UID: \"f2a479c8-1fe5-4264-b6cd-dafa68621543\") " pod="openshift-ingress/e2e-worker-w2-d061d0-openshift-default-86b87f495-rlgwt"
Oct 30 20:56:47.038041 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:56:47.038002    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f2a479c8-1fe5-4264-b6cd-dafa68621543-credential-socket\") pod \"e2e-worker-w2-d061d0-openshift-default-86b87f495-rlgwt\" (UID: \"f2a479c8-1fe5-4264-b6cd-dafa68621543\") " pod="openshift-ingress/e2e-worker-w2-d061d0-openshift-default-86b87f495-rlgwt"
Oct 30 20:56:47.038168 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:56:47.038063    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f2a479c8-1fe5-4264-b6cd-dafa68621543-workload-certs\") pod \"e2e-worker-w2-d061d0-openshift-default-86b87f495-rlgwt\" (UID: \"f2a479c8-1fe5-4264-b6cd-dafa68621543\") " pod="openshift-ingress/e2e-worker-w2-d061d0-openshift-default-86b87f495-rlgwt"
Oct 30 20:56:47.038322 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:56:47.038297    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f2a479c8-1fe5-4264-b6cd-dafa68621543-istiod-ca-cert\") pod \"e2e-worker-w2-d061d0-openshift-default-86b87f495-rlgwt\" (UID: \"f2a479c8-1fe5-4264-b6cd-dafa68621543\") " pod="openshift-ingress/e2e-worker-w2-d061d0-openshift-default-86b87f495-rlgwt"
Oct 30 20:56:47.038462 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:56:47.038444    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f2a479c8-1fe5-4264-b6cd-dafa68621543-istio-data\") pod \"e2e-worker-w2-d061d0-openshift-default-86b87f495-rlgwt\" (UID: \"f2a479c8-1fe5-4264-b6cd-dafa68621543\") " pod="openshift-ingress/e2e-worker-w2-d061d0-openshift-default-86b87f495-rlgwt"
Oct 30 20:56:47.040298 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:56:47.040259    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f2a479c8-1fe5-4264-b6cd-dafa68621543-istio-envoy\") pod \"e2e-worker-w2-d061d0-openshift-default-86b87f495-rlgwt\" (UID: \"f2a479c8-1fe5-4264-b6cd-dafa68621543\") " pod="openshift-ingress/e2e-worker-w2-d061d0-openshift-default-86b87f495-rlgwt"
Oct 30 20:56:47.040464 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:56:47.040444    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f2a479c8-1fe5-4264-b6cd-dafa68621543-istio-podinfo\") pod \"e2e-worker-w2-d061d0-openshift-default-86b87f495-rlgwt\" (UID: \"f2a479c8-1fe5-4264-b6cd-dafa68621543\") " pod="openshift-ingress/e2e-worker-w2-d061d0-openshift-default-86b87f495-rlgwt"
Oct 30 20:56:47.095836 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:56:47.095763    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f2a479c8-1fe5-4264-b6cd-dafa68621543-istio-token\") pod \"e2e-worker-w2-d061d0-openshift-default-86b87f495-rlgwt\" (UID: \"f2a479c8-1fe5-4264-b6cd-dafa68621543\") " pod="openshift-ingress/e2e-worker-w2-d061d0-openshift-default-86b87f495-rlgwt"
Oct 30 20:56:47.096191 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:56:47.096169    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9hzfh\" (UniqueName: \"kubernetes.io/projected/f2a479c8-1fe5-4264-b6cd-dafa68621543-kube-api-access-9hzfh\") pod \"e2e-worker-w2-d061d0-openshift-default-86b87f495-rlgwt\" (UID: \"f2a479c8-1fe5-4264-b6cd-dafa68621543\") " pod="openshift-ingress/e2e-worker-w2-d061d0-openshift-default-86b87f495-rlgwt"
Oct 30 20:56:47.146742 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:56:47.146707    6004 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-d061d0-openshift-default-86b87f495-rlgwt"
Oct 30 20:56:47.579923 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:56:47.579893    6004 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w2-d061d0-openshift-default-86b87f495-rlgwt"]
Oct 30 20:56:47.580619 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:56:47.580594    6004 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf2a479c8_1fe5_4264_b6cd_dafa68621543.slice/crio-dab6a4de056b702cab489c009bb5a1805663f5bd84b4ad971ad4be8179afd1e1 WatchSource:0}: Error finding container dab6a4de056b702cab489c009bb5a1805663f5bd84b4ad971ad4be8179afd1e1: Status 404 returned error can't find the container with id dab6a4de056b702cab489c009bb5a1805663f5bd84b4ad971ad4be8179afd1e1
Oct 30 20:56:47.582944 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:56:47.582913    6004 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 20:56:47.583015 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:56:47.582991    6004 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 20:56:47.583070 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:56:47.583025    6004 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 20:56:48.513297 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:56:48.513261    6004 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-d061d0-openshift-default-86b87f495-rlgwt" event={"ID":"f2a479c8-1fe5-4264-b6cd-dafa68621543","Type":"ContainerStarted","Data":"20df18f4a46a47959d4e7dd2ce70a219163e05c85d5a53c51b4466873d901ae4"}
Oct 30 20:56:48.513742 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:56:48.513314    6004 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-d061d0-openshift-default-86b87f495-rlgwt" event={"ID":"f2a479c8-1fe5-4264-b6cd-dafa68621543","Type":"ContainerStarted","Data":"dab6a4de056b702cab489c009bb5a1805663f5bd84b4ad971ad4be8179afd1e1"}
Oct 30 20:56:49.156075 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:56:49.155438    6004 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w2-d061d0-openshift-default-86b87f495-rlgwt"
Oct 30 20:56:49.159111 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:56:49.159069    6004 patch_prober.go:29] interesting pod/e2e-worker-w2-d061d0-openshift-default-86b87f495-rlgwt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.69:15021/healthz/ready\": dial tcp 10.132.0.69:15021: connect: connection refused" start-of-body=
Oct 30 20:56:49.159276 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:56:49.159134    6004 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-d061d0-openshift-default-86b87f495-rlgwt" podUID="f2a479c8-1fe5-4264-b6cd-dafa68621543" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.69:15021/healthz/ready\": dial tcp 10.132.0.69:15021: connect: connection refused"
Oct 30 20:56:50.155074 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:56:50.153489    6004 patch_prober.go:29] interesting pod/e2e-worker-w2-d061d0-openshift-default-86b87f495-rlgwt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.69:15021/healthz/ready\": dial tcp 10.132.0.69:15021: connect: connection refused" start-of-body=
Oct 30 20:56:50.155074 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:56:50.153549    6004 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-d061d0-openshift-default-86b87f495-rlgwt" podUID="f2a479c8-1fe5-4264-b6cd-dafa68621543" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.69:15021/healthz/ready\": dial tcp 10.132.0.69:15021: connect: connection refused"
Oct 30 20:56:51.153075 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:56:51.151586    6004 patch_prober.go:29] interesting pod/e2e-worker-w2-d061d0-openshift-default-86b87f495-rlgwt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.69:15021/healthz/ready\": dial tcp 10.132.0.69:15021: connect: connection refused" start-of-body=
Oct 30 20:56:51.153075 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:56:51.151663    6004 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-d061d0-openshift-default-86b87f495-rlgwt" podUID="f2a479c8-1fe5-4264-b6cd-dafa68621543" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.69:15021/healthz/ready\": dial tcp 10.132.0.69:15021: connect: connection refused"
Oct 30 20:56:52.152071 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:56:52.148452    6004 patch_prober.go:29] interesting pod/e2e-worker-w2-d061d0-openshift-default-86b87f495-rlgwt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.69:15021/healthz/ready\": dial tcp 10.132.0.69:15021: connect: connection refused" start-of-body=
Oct 30 20:56:52.152071 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:56:52.148517    6004 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-d061d0-openshift-default-86b87f495-rlgwt" podUID="f2a479c8-1fe5-4264-b6cd-dafa68621543" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.69:15021/healthz/ready\": dial tcp 10.132.0.69:15021: connect: connection refused"
Oct 30 20:56:53.151531 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:56:53.151491    6004 patch_prober.go:29] interesting pod/e2e-worker-w2-d061d0-openshift-default-86b87f495-rlgwt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.69:15021/healthz/ready\": dial tcp 10.132.0.69:15021: connect: connection refused" start-of-body=
Oct 30 20:56:53.151822 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:56:53.151794    6004 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-d061d0-openshift-default-86b87f495-rlgwt" podUID="f2a479c8-1fe5-4264-b6cd-dafa68621543" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.69:15021/healthz/ready\": dial tcp 10.132.0.69:15021: connect: connection refused"
Oct 30 20:56:54.147704 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:56:54.147659    6004 patch_prober.go:29] interesting pod/e2e-worker-w2-d061d0-openshift-default-86b87f495-rlgwt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.69:15021/healthz/ready\": dial tcp 10.132.0.69:15021: connect: connection refused" start-of-body=
Oct 30 20:56:54.148139 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:56:54.147728    6004 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-d061d0-openshift-default-86b87f495-rlgwt" podUID="f2a479c8-1fe5-4264-b6cd-dafa68621543" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.69:15021/healthz/ready\": dial tcp 10.132.0.69:15021: connect: connection refused"
Oct 30 20:56:55.152606 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:56:55.152568    6004 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w2-d061d0-openshift-default-86b87f495-rlgwt"
Oct 30 20:56:55.153100 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:56:55.153004    6004 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w2-d061d0-openshift-default-86b87f495-rlgwt"
Oct 30 20:56:55.153784 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:56:55.153764    6004 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w2-d061d0-openshift-default-86b87f495-rlgwt"
Oct 30 20:56:55.321420 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:56:55.321367    6004 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w2-d061d0-openshift-default-86b87f495-rlgwt" podStartSLOduration=9.321352621 podStartE2EDuration="9.321352621s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:56:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:56:48.685663164 +0000 UTC m=+1114.605449281" watchObservedRunningTime="2026-10-30 20:56:55.321352621 +0000 UTC m=+1121.241138732"
Oct 30 20:57:14.286736 ip-10-0-138-85 kubenswrapper[6004]: E1030 20:57:14.286699    6004 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-zz4wr" containerName="extractor"
Oct 30 20:57:15.516600 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:57:15.516569    6004 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w3-682999-openshift-default-54dcb797b5-nmbtx"]
Oct 30 20:57:15.522044 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:57:15.522020    6004 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-682999-openshift-default-54dcb797b5-nmbtx"
Oct 30 20:57:15.630690 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:57:15.630649    6004 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w3-682999-openshift-default-54dcb797b5-nmbtx"]
Oct 30 20:57:15.687533 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:57:15.687496    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e33839df-6b8e-4947-83cc-7baec9b30e50-workload-socket\") pod \"e2e-worker-w3-682999-openshift-default-54dcb797b5-nmbtx\" (UID: \"e33839df-6b8e-4947-83cc-7baec9b30e50\") " pod="openshift-ingress/e2e-worker-w3-682999-openshift-default-54dcb797b5-nmbtx"
Oct 30 20:57:15.687533 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:57:15.687539    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e33839df-6b8e-4947-83cc-7baec9b30e50-credential-socket\") pod \"e2e-worker-w3-682999-openshift-default-54dcb797b5-nmbtx\" (UID: \"e33839df-6b8e-4947-83cc-7baec9b30e50\") " pod="openshift-ingress/e2e-worker-w3-682999-openshift-default-54dcb797b5-nmbtx"
Oct 30 20:57:15.687792 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:57:15.687635    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e33839df-6b8e-4947-83cc-7baec9b30e50-istio-envoy\") pod \"e2e-worker-w3-682999-openshift-default-54dcb797b5-nmbtx\" (UID: \"e33839df-6b8e-4947-83cc-7baec9b30e50\") " pod="openshift-ingress/e2e-worker-w3-682999-openshift-default-54dcb797b5-nmbtx"
Oct 30 20:57:15.687792 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:57:15.687672    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e33839df-6b8e-4947-83cc-7baec9b30e50-workload-certs\") pod \"e2e-worker-w3-682999-openshift-default-54dcb797b5-nmbtx\" (UID: \"e33839df-6b8e-4947-83cc-7baec9b30e50\") " pod="openshift-ingress/e2e-worker-w3-682999-openshift-default-54dcb797b5-nmbtx"
Oct 30 20:57:15.687929 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:57:15.687785    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e33839df-6b8e-4947-83cc-7baec9b30e50-istio-token\") pod \"e2e-worker-w3-682999-openshift-default-54dcb797b5-nmbtx\" (UID: \"e33839df-6b8e-4947-83cc-7baec9b30e50\") " pod="openshift-ingress/e2e-worker-w3-682999-openshift-default-54dcb797b5-nmbtx"
Oct 30 20:57:15.687929 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:57:15.687832    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e33839df-6b8e-4947-83cc-7baec9b30e50-istio-data\") pod \"e2e-worker-w3-682999-openshift-default-54dcb797b5-nmbtx\" (UID: \"e33839df-6b8e-4947-83cc-7baec9b30e50\") " pod="openshift-ingress/e2e-worker-w3-682999-openshift-default-54dcb797b5-nmbtx"
Oct 30 20:57:15.688033 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:57:15.687935    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e33839df-6b8e-4947-83cc-7baec9b30e50-istiod-ca-cert\") pod \"e2e-worker-w3-682999-openshift-default-54dcb797b5-nmbtx\" (UID: \"e33839df-6b8e-4947-83cc-7baec9b30e50\") " pod="openshift-ingress/e2e-worker-w3-682999-openshift-default-54dcb797b5-nmbtx"
Oct 30 20:57:15.688033 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:57:15.687965    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e33839df-6b8e-4947-83cc-7baec9b30e50-istio-podinfo\") pod \"e2e-worker-w3-682999-openshift-default-54dcb797b5-nmbtx\" (UID: \"e33839df-6b8e-4947-83cc-7baec9b30e50\") " pod="openshift-ingress/e2e-worker-w3-682999-openshift-default-54dcb797b5-nmbtx"
Oct 30 20:57:15.688033 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:57:15.688016    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mtbrz\" (UniqueName: \"kubernetes.io/projected/e33839df-6b8e-4947-83cc-7baec9b30e50-kube-api-access-mtbrz\") pod \"e2e-worker-w3-682999-openshift-default-54dcb797b5-nmbtx\" (UID: \"e33839df-6b8e-4947-83cc-7baec9b30e50\") " pod="openshift-ingress/e2e-worker-w3-682999-openshift-default-54dcb797b5-nmbtx"
Oct 30 20:57:15.788749 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:57:15.788655    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e33839df-6b8e-4947-83cc-7baec9b30e50-istio-token\") pod \"e2e-worker-w3-682999-openshift-default-54dcb797b5-nmbtx\" (UID: \"e33839df-6b8e-4947-83cc-7baec9b30e50\") " pod="openshift-ingress/e2e-worker-w3-682999-openshift-default-54dcb797b5-nmbtx"
Oct 30 20:57:15.788749 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:57:15.788704    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e33839df-6b8e-4947-83cc-7baec9b30e50-istio-data\") pod \"e2e-worker-w3-682999-openshift-default-54dcb797b5-nmbtx\" (UID: \"e33839df-6b8e-4947-83cc-7baec9b30e50\") " pod="openshift-ingress/e2e-worker-w3-682999-openshift-default-54dcb797b5-nmbtx"
Oct 30 20:57:15.788749 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:57:15.788745    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e33839df-6b8e-4947-83cc-7baec9b30e50-istiod-ca-cert\") pod \"e2e-worker-w3-682999-openshift-default-54dcb797b5-nmbtx\" (UID: \"e33839df-6b8e-4947-83cc-7baec9b30e50\") " pod="openshift-ingress/e2e-worker-w3-682999-openshift-default-54dcb797b5-nmbtx"
Oct 30 20:57:15.789029 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:57:15.788771    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e33839df-6b8e-4947-83cc-7baec9b30e50-istio-podinfo\") pod \"e2e-worker-w3-682999-openshift-default-54dcb797b5-nmbtx\" (UID: \"e33839df-6b8e-4947-83cc-7baec9b30e50\") " pod="openshift-ingress/e2e-worker-w3-682999-openshift-default-54dcb797b5-nmbtx"
Oct 30 20:57:15.789029 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:57:15.788792    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mtbrz\" (UniqueName: \"kubernetes.io/projected/e33839df-6b8e-4947-83cc-7baec9b30e50-kube-api-access-mtbrz\") pod \"e2e-worker-w3-682999-openshift-default-54dcb797b5-nmbtx\" (UID: \"e33839df-6b8e-4947-83cc-7baec9b30e50\") " pod="openshift-ingress/e2e-worker-w3-682999-openshift-default-54dcb797b5-nmbtx"
Oct 30 20:57:15.789029 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:57:15.788905    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e33839df-6b8e-4947-83cc-7baec9b30e50-workload-socket\") pod \"e2e-worker-w3-682999-openshift-default-54dcb797b5-nmbtx\" (UID: \"e33839df-6b8e-4947-83cc-7baec9b30e50\") " pod="openshift-ingress/e2e-worker-w3-682999-openshift-default-54dcb797b5-nmbtx"
Oct 30 20:57:15.789029 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:57:15.788942    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e33839df-6b8e-4947-83cc-7baec9b30e50-credential-socket\") pod \"e2e-worker-w3-682999-openshift-default-54dcb797b5-nmbtx\" (UID: \"e33839df-6b8e-4947-83cc-7baec9b30e50\") " pod="openshift-ingress/e2e-worker-w3-682999-openshift-default-54dcb797b5-nmbtx"
Oct 30 20:57:15.789029 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:57:15.788995    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e33839df-6b8e-4947-83cc-7baec9b30e50-istio-envoy\") pod \"e2e-worker-w3-682999-openshift-default-54dcb797b5-nmbtx\" (UID: \"e33839df-6b8e-4947-83cc-7baec9b30e50\") " pod="openshift-ingress/e2e-worker-w3-682999-openshift-default-54dcb797b5-nmbtx"
Oct 30 20:57:15.789305 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:57:15.789040    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e33839df-6b8e-4947-83cc-7baec9b30e50-workload-certs\") pod \"e2e-worker-w3-682999-openshift-default-54dcb797b5-nmbtx\" (UID: \"e33839df-6b8e-4947-83cc-7baec9b30e50\") " pod="openshift-ingress/e2e-worker-w3-682999-openshift-default-54dcb797b5-nmbtx"
Oct 30 20:57:15.789305 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:57:15.789215    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e33839df-6b8e-4947-83cc-7baec9b30e50-istio-data\") pod \"e2e-worker-w3-682999-openshift-default-54dcb797b5-nmbtx\" (UID: \"e33839df-6b8e-4947-83cc-7baec9b30e50\") " pod="openshift-ingress/e2e-worker-w3-682999-openshift-default-54dcb797b5-nmbtx"
Oct 30 20:57:15.789396 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:57:15.789319    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e33839df-6b8e-4947-83cc-7baec9b30e50-workload-socket\") pod \"e2e-worker-w3-682999-openshift-default-54dcb797b5-nmbtx\" (UID: \"e33839df-6b8e-4947-83cc-7baec9b30e50\") " pod="openshift-ingress/e2e-worker-w3-682999-openshift-default-54dcb797b5-nmbtx"
Oct 30 20:57:15.789462 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:57:15.789418    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e33839df-6b8e-4947-83cc-7baec9b30e50-credential-socket\") pod \"e2e-worker-w3-682999-openshift-default-54dcb797b5-nmbtx\" (UID: \"e33839df-6b8e-4947-83cc-7baec9b30e50\") " pod="openshift-ingress/e2e-worker-w3-682999-openshift-default-54dcb797b5-nmbtx"
Oct 30 20:57:15.789675 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:57:15.789654    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e33839df-6b8e-4947-83cc-7baec9b30e50-workload-certs\") pod \"e2e-worker-w3-682999-openshift-default-54dcb797b5-nmbtx\" (UID: \"e33839df-6b8e-4947-83cc-7baec9b30e50\") " pod="openshift-ingress/e2e-worker-w3-682999-openshift-default-54dcb797b5-nmbtx"
Oct 30 20:57:15.789761 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:57:15.789679    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e33839df-6b8e-4947-83cc-7baec9b30e50-istiod-ca-cert\") pod \"e2e-worker-w3-682999-openshift-default-54dcb797b5-nmbtx\" (UID: \"e33839df-6b8e-4947-83cc-7baec9b30e50\") " pod="openshift-ingress/e2e-worker-w3-682999-openshift-default-54dcb797b5-nmbtx"
Oct 30 20:57:15.791307 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:57:15.791275    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e33839df-6b8e-4947-83cc-7baec9b30e50-istio-envoy\") pod \"e2e-worker-w3-682999-openshift-default-54dcb797b5-nmbtx\" (UID: \"e33839df-6b8e-4947-83cc-7baec9b30e50\") " pod="openshift-ingress/e2e-worker-w3-682999-openshift-default-54dcb797b5-nmbtx"
Oct 30 20:57:15.791472 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:57:15.791452    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e33839df-6b8e-4947-83cc-7baec9b30e50-istio-podinfo\") pod \"e2e-worker-w3-682999-openshift-default-54dcb797b5-nmbtx\" (UID: \"e33839df-6b8e-4947-83cc-7baec9b30e50\") " pod="openshift-ingress/e2e-worker-w3-682999-openshift-default-54dcb797b5-nmbtx"
Oct 30 20:57:15.846561 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:57:15.846534    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e33839df-6b8e-4947-83cc-7baec9b30e50-istio-token\") pod \"e2e-worker-w3-682999-openshift-default-54dcb797b5-nmbtx\" (UID: \"e33839df-6b8e-4947-83cc-7baec9b30e50\") " pod="openshift-ingress/e2e-worker-w3-682999-openshift-default-54dcb797b5-nmbtx"
Oct 30 20:57:15.846707 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:57:15.846622    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mtbrz\" (UniqueName: \"kubernetes.io/projected/e33839df-6b8e-4947-83cc-7baec9b30e50-kube-api-access-mtbrz\") pod \"e2e-worker-w3-682999-openshift-default-54dcb797b5-nmbtx\" (UID: \"e33839df-6b8e-4947-83cc-7baec9b30e50\") " pod="openshift-ingress/e2e-worker-w3-682999-openshift-default-54dcb797b5-nmbtx"
Oct 30 20:57:16.135567 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:57:16.135475    6004 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-682999-openshift-default-54dcb797b5-nmbtx"
Oct 30 20:57:16.568146 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:57:16.568121    6004 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w3-682999-openshift-default-54dcb797b5-nmbtx"]
Oct 30 20:57:16.570239 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:57:16.570209    6004 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode33839df_6b8e_4947_83cc_7baec9b30e50.slice/crio-92d1514176302124197c4e823d887ef2c12ee91dac8516f742ad74688c37fd3c WatchSource:0}: Error finding container 92d1514176302124197c4e823d887ef2c12ee91dac8516f742ad74688c37fd3c: Status 404 returned error can't find the container with id 92d1514176302124197c4e823d887ef2c12ee91dac8516f742ad74688c37fd3c
Oct 30 20:57:16.572824 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:57:16.572788    6004 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 20:57:16.572915 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:57:16.572857    6004 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 20:57:16.572915 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:57:16.572887    6004 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 20:57:16.711180 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:57:16.711141    6004 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-682999-openshift-default-54dcb797b5-nmbtx" event={"ID":"e33839df-6b8e-4947-83cc-7baec9b30e50","Type":"ContainerStarted","Data":"806140dbe1925d8594c84222fced626620f4d02becbd74b8ab30f0d070412800"}
Oct 30 20:57:16.711376 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:57:16.711206    6004 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-682999-openshift-default-54dcb797b5-nmbtx" event={"ID":"e33839df-6b8e-4947-83cc-7baec9b30e50","Type":"ContainerStarted","Data":"92d1514176302124197c4e823d887ef2c12ee91dac8516f742ad74688c37fd3c"}
Oct 30 20:57:16.832523 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:57:16.832420    6004 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w3-682999-openshift-default-54dcb797b5-nmbtx" podStartSLOduration=1.832406701 podStartE2EDuration="1.832406701s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:57:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:57:16.830653436 +0000 UTC m=+1142.750439553" watchObservedRunningTime="2026-10-30 20:57:16.832406701 +0000 UTC m=+1142.752192896"
Oct 30 20:57:17.136662 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:57:17.136481    6004 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w3-682999-openshift-default-54dcb797b5-nmbtx"
Oct 30 20:57:17.138695 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:57:17.138664    6004 patch_prober.go:29] interesting pod/e2e-worker-w3-682999-openshift-default-54dcb797b5-nmbtx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.70:15021/healthz/ready\": dial tcp 10.132.0.70:15021: connect: connection refused" start-of-body=
Oct 30 20:57:17.138853 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:57:17.138775    6004 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-682999-openshift-default-54dcb797b5-nmbtx" podUID="e33839df-6b8e-4947-83cc-7baec9b30e50" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.70:15021/healthz/ready\": dial tcp 10.132.0.70:15021: connect: connection refused"
Oct 30 20:57:18.140978 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:57:18.140445    6004 patch_prober.go:29] interesting pod/e2e-worker-w3-682999-openshift-default-54dcb797b5-nmbtx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.70:15021/healthz/ready\": dial tcp 10.132.0.70:15021: connect: connection refused" start-of-body=
Oct 30 20:57:18.140978 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:57:18.140512    6004 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-682999-openshift-default-54dcb797b5-nmbtx" podUID="e33839df-6b8e-4947-83cc-7baec9b30e50" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.70:15021/healthz/ready\": dial tcp 10.132.0.70:15021: connect: connection refused"
Oct 30 20:57:19.138558 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:57:19.138522    6004 patch_prober.go:29] interesting pod/e2e-worker-w3-682999-openshift-default-54dcb797b5-nmbtx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.70:15021/healthz/ready\": dial tcp 10.132.0.70:15021: connect: connection refused" start-of-body=
Oct 30 20:57:19.138807 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:57:19.138779    6004 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-682999-openshift-default-54dcb797b5-nmbtx" podUID="e33839df-6b8e-4947-83cc-7baec9b30e50" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.70:15021/healthz/ready\": dial tcp 10.132.0.70:15021: connect: connection refused"
Oct 30 20:57:20.143512 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:57:20.143466    6004 patch_prober.go:29] interesting pod/e2e-worker-w3-682999-openshift-default-54dcb797b5-nmbtx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.70:15021/healthz/ready\": dial tcp 10.132.0.70:15021: connect: connection refused" start-of-body=
Oct 30 20:57:20.144134 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:57:20.144096    6004 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-682999-openshift-default-54dcb797b5-nmbtx" podUID="e33839df-6b8e-4947-83cc-7baec9b30e50" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.70:15021/healthz/ready\": dial tcp 10.132.0.70:15021: connect: connection refused"
Oct 30 20:57:21.146074 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:57:21.139390    6004 patch_prober.go:29] interesting pod/e2e-worker-w3-682999-openshift-default-54dcb797b5-nmbtx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.70:15021/healthz/ready\": dial tcp 10.132.0.70:15021: connect: connection refused" start-of-body=
Oct 30 20:57:21.146074 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:57:21.139474    6004 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-682999-openshift-default-54dcb797b5-nmbtx" podUID="e33839df-6b8e-4947-83cc-7baec9b30e50" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.70:15021/healthz/ready\": dial tcp 10.132.0.70:15021: connect: connection refused"
Oct 30 20:57:22.138335 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:57:22.138298    6004 patch_prober.go:29] interesting pod/e2e-worker-w3-682999-openshift-default-54dcb797b5-nmbtx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.70:15021/healthz/ready\": dial tcp 10.132.0.70:15021: connect: connection refused" start-of-body=
Oct 30 20:57:22.138623 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:57:22.138590    6004 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-682999-openshift-default-54dcb797b5-nmbtx" podUID="e33839df-6b8e-4947-83cc-7baec9b30e50" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.70:15021/healthz/ready\": dial tcp 10.132.0.70:15021: connect: connection refused"
Oct 30 20:57:23.136562 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:57:23.136509    6004 patch_prober.go:29] interesting pod/e2e-worker-w3-682999-openshift-default-54dcb797b5-nmbtx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.70:15021/healthz/ready\": dial tcp 10.132.0.70:15021: connect: connection refused" start-of-body=
Oct 30 20:57:23.137111 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:57:23.136594    6004 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-682999-openshift-default-54dcb797b5-nmbtx" podUID="e33839df-6b8e-4947-83cc-7baec9b30e50" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.70:15021/healthz/ready\": dial tcp 10.132.0.70:15021: connect: connection refused"
Oct 30 20:57:24.140961 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:57:24.140924    6004 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w3-682999-openshift-default-54dcb797b5-nmbtx"
Oct 30 20:57:24.141409 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:57:24.141336    6004 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w3-682999-openshift-default-54dcb797b5-nmbtx"
Oct 30 20:57:24.141998 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:57:24.141974    6004 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w3-682999-openshift-default-54dcb797b5-nmbtx"
Oct 30 20:57:44.286422 ip-10-0-138-85 kubenswrapper[6004]: E1030 20:57:44.286382    6004 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-zz4wr" containerName="extractor"
Oct 30 20:57:54.239075 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:57:54.239018    6004 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w2-d061d0/distinct-2-w2-d061d0-kserve-5c6bb99fbf-b4kqs"]
Oct 30 20:57:54.251550 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:57:54.251520    6004 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w2-d061d0/distinct-2-w2-d061d0-kserve-5c6bb99fbf-b4kqs"
Oct 30 20:57:54.299983 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:57:54.299950    6004 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w2-d061d0/distinct-2-w2-d061d0-kserve-5c6bb99fbf-b4kqs"]
Oct 30 20:57:54.347718 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:57:54.347678    6004 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w2-d061d0\"/\"distinct-2-w2-d061d0-kserve-self-signed-certs\""
Oct 30 20:57:54.438855 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:57:54.438823    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/32264f6c-999b-4bad-bd2e-7664cadc0669-dshm\") pod \"distinct-2-w2-d061d0-kserve-5c6bb99fbf-b4kqs\" (UID: \"32264f6c-999b-4bad-bd2e-7664cadc0669\") " pod="e2e-models-e2e-worker-w2-d061d0/distinct-2-w2-d061d0-kserve-5c6bb99fbf-b4kqs"
Oct 30 20:57:54.439046 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:57:54.438880    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gsrvb\" (UniqueName: \"kubernetes.io/projected/32264f6c-999b-4bad-bd2e-7664cadc0669-kube-api-access-gsrvb\") pod \"distinct-2-w2-d061d0-kserve-5c6bb99fbf-b4kqs\" (UID: \"32264f6c-999b-4bad-bd2e-7664cadc0669\") " pod="e2e-models-e2e-worker-w2-d061d0/distinct-2-w2-d061d0-kserve-5c6bb99fbf-b4kqs"
Oct 30 20:57:54.439046 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:57:54.438987    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/32264f6c-999b-4bad-bd2e-7664cadc0669-home\") pod \"distinct-2-w2-d061d0-kserve-5c6bb99fbf-b4kqs\" (UID: \"32264f6c-999b-4bad-bd2e-7664cadc0669\") " pod="e2e-models-e2e-worker-w2-d061d0/distinct-2-w2-d061d0-kserve-5c6bb99fbf-b4kqs"
Oct 30 20:57:54.439194 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:57:54.439165    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/32264f6c-999b-4bad-bd2e-7664cadc0669-tmp-dir\") pod \"distinct-2-w2-d061d0-kserve-5c6bb99fbf-b4kqs\" (UID: \"32264f6c-999b-4bad-bd2e-7664cadc0669\") " pod="e2e-models-e2e-worker-w2-d061d0/distinct-2-w2-d061d0-kserve-5c6bb99fbf-b4kqs"
Oct 30 20:57:54.439237 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:57:54.439215    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/32264f6c-999b-4bad-bd2e-7664cadc0669-model-cache\") pod \"distinct-2-w2-d061d0-kserve-5c6bb99fbf-b4kqs\" (UID: \"32264f6c-999b-4bad-bd2e-7664cadc0669\") " pod="e2e-models-e2e-worker-w2-d061d0/distinct-2-w2-d061d0-kserve-5c6bb99fbf-b4kqs"
Oct 30 20:57:54.439308 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:57:54.439259    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/32264f6c-999b-4bad-bd2e-7664cadc0669-tls-certs\") pod \"distinct-2-w2-d061d0-kserve-5c6bb99fbf-b4kqs\" (UID: \"32264f6c-999b-4bad-bd2e-7664cadc0669\") " pod="e2e-models-e2e-worker-w2-d061d0/distinct-2-w2-d061d0-kserve-5c6bb99fbf-b4kqs"
Oct 30 20:57:54.540084 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:57:54.539954    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/32264f6c-999b-4bad-bd2e-7664cadc0669-dshm\") pod \"distinct-2-w2-d061d0-kserve-5c6bb99fbf-b4kqs\" (UID: \"32264f6c-999b-4bad-bd2e-7664cadc0669\") " pod="e2e-models-e2e-worker-w2-d061d0/distinct-2-w2-d061d0-kserve-5c6bb99fbf-b4kqs"
Oct 30 20:57:54.540084 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:57:54.540002    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gsrvb\" (UniqueName: \"kubernetes.io/projected/32264f6c-999b-4bad-bd2e-7664cadc0669-kube-api-access-gsrvb\") pod \"distinct-2-w2-d061d0-kserve-5c6bb99fbf-b4kqs\" (UID: \"32264f6c-999b-4bad-bd2e-7664cadc0669\") " pod="e2e-models-e2e-worker-w2-d061d0/distinct-2-w2-d061d0-kserve-5c6bb99fbf-b4kqs"
Oct 30 20:57:54.540084 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:57:54.540078    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/32264f6c-999b-4bad-bd2e-7664cadc0669-home\") pod \"distinct-2-w2-d061d0-kserve-5c6bb99fbf-b4kqs\" (UID: \"32264f6c-999b-4bad-bd2e-7664cadc0669\") " pod="e2e-models-e2e-worker-w2-d061d0/distinct-2-w2-d061d0-kserve-5c6bb99fbf-b4kqs"
Oct 30 20:57:54.540383 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:57:54.540184    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/32264f6c-999b-4bad-bd2e-7664cadc0669-tmp-dir\") pod \"distinct-2-w2-d061d0-kserve-5c6bb99fbf-b4kqs\" (UID: \"32264f6c-999b-4bad-bd2e-7664cadc0669\") " pod="e2e-models-e2e-worker-w2-d061d0/distinct-2-w2-d061d0-kserve-5c6bb99fbf-b4kqs"
Oct 30 20:57:54.540383 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:57:54.540212    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/32264f6c-999b-4bad-bd2e-7664cadc0669-model-cache\") pod \"distinct-2-w2-d061d0-kserve-5c6bb99fbf-b4kqs\" (UID: \"32264f6c-999b-4bad-bd2e-7664cadc0669\") " pod="e2e-models-e2e-worker-w2-d061d0/distinct-2-w2-d061d0-kserve-5c6bb99fbf-b4kqs"
Oct 30 20:57:54.540383 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:57:54.540233    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/32264f6c-999b-4bad-bd2e-7664cadc0669-tls-certs\") pod \"distinct-2-w2-d061d0-kserve-5c6bb99fbf-b4kqs\" (UID: \"32264f6c-999b-4bad-bd2e-7664cadc0669\") " pod="e2e-models-e2e-worker-w2-d061d0/distinct-2-w2-d061d0-kserve-5c6bb99fbf-b4kqs"
Oct 30 20:57:54.540794 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:57:54.540755    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/32264f6c-999b-4bad-bd2e-7664cadc0669-model-cache\") pod \"distinct-2-w2-d061d0-kserve-5c6bb99fbf-b4kqs\" (UID: \"32264f6c-999b-4bad-bd2e-7664cadc0669\") " pod="e2e-models-e2e-worker-w2-d061d0/distinct-2-w2-d061d0-kserve-5c6bb99fbf-b4kqs"
Oct 30 20:57:54.541166 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:57:54.541141    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/32264f6c-999b-4bad-bd2e-7664cadc0669-tmp-dir\") pod \"distinct-2-w2-d061d0-kserve-5c6bb99fbf-b4kqs\" (UID: \"32264f6c-999b-4bad-bd2e-7664cadc0669\") " pod="e2e-models-e2e-worker-w2-d061d0/distinct-2-w2-d061d0-kserve-5c6bb99fbf-b4kqs"
Oct 30 20:57:54.541279 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:57:54.541250    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/32264f6c-999b-4bad-bd2e-7664cadc0669-home\") pod \"distinct-2-w2-d061d0-kserve-5c6bb99fbf-b4kqs\" (UID: \"32264f6c-999b-4bad-bd2e-7664cadc0669\") " pod="e2e-models-e2e-worker-w2-d061d0/distinct-2-w2-d061d0-kserve-5c6bb99fbf-b4kqs"
Oct 30 20:57:54.542637 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:57:54.542607    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/32264f6c-999b-4bad-bd2e-7664cadc0669-dshm\") pod \"distinct-2-w2-d061d0-kserve-5c6bb99fbf-b4kqs\" (UID: \"32264f6c-999b-4bad-bd2e-7664cadc0669\") " pod="e2e-models-e2e-worker-w2-d061d0/distinct-2-w2-d061d0-kserve-5c6bb99fbf-b4kqs"
Oct 30 20:57:54.543189 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:57:54.543169    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/32264f6c-999b-4bad-bd2e-7664cadc0669-tls-certs\") pod \"distinct-2-w2-d061d0-kserve-5c6bb99fbf-b4kqs\" (UID: \"32264f6c-999b-4bad-bd2e-7664cadc0669\") " pod="e2e-models-e2e-worker-w2-d061d0/distinct-2-w2-d061d0-kserve-5c6bb99fbf-b4kqs"
Oct 30 20:57:54.625081 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:57:54.624299    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gsrvb\" (UniqueName: \"kubernetes.io/projected/32264f6c-999b-4bad-bd2e-7664cadc0669-kube-api-access-gsrvb\") pod \"distinct-2-w2-d061d0-kserve-5c6bb99fbf-b4kqs\" (UID: \"32264f6c-999b-4bad-bd2e-7664cadc0669\") " pod="e2e-models-e2e-worker-w2-d061d0/distinct-2-w2-d061d0-kserve-5c6bb99fbf-b4kqs"
Oct 30 20:57:54.866486 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:57:54.866402    6004 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w2-d061d0/distinct-2-w2-d061d0-kserve-5c6bb99fbf-b4kqs"
Oct 30 20:57:55.242936 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:57:55.242909    6004 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w2-d061d0/distinct-2-w2-d061d0-kserve-5c6bb99fbf-b4kqs"]
Oct 30 20:57:55.245119 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:57:55.245087    6004 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod32264f6c_999b_4bad_bd2e_7664cadc0669.slice/crio-35105c9951f4a64d017a190918428478611c8ccbbecd221d498bb3d15e81c285 WatchSource:0}: Error finding container 35105c9951f4a64d017a190918428478611c8ccbbecd221d498bb3d15e81c285: Status 404 returned error can't find the container with id 35105c9951f4a64d017a190918428478611c8ccbbecd221d498bb3d15e81c285
Oct 30 20:57:55.975927 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:57:55.975888    6004 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w2-d061d0/distinct-2-w2-d061d0-kserve-5c6bb99fbf-b4kqs" event={"ID":"32264f6c-999b-4bad-bd2e-7664cadc0669","Type":"ContainerStarted","Data":"3d051582fdd4e9b6d4833cc86141078f4da888efa97f3523fdc03c039f0c4375"}
Oct 30 20:57:55.976123 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:57:55.975941    6004 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w2-d061d0/distinct-2-w2-d061d0-kserve-5c6bb99fbf-b4kqs" event={"ID":"32264f6c-999b-4bad-bd2e-7664cadc0669","Type":"ContainerStarted","Data":"35105c9951f4a64d017a190918428478611c8ccbbecd221d498bb3d15e81c285"}
Oct 30 20:57:56.092763 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:57:56.092699    6004 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-models-e2e-worker-w2-d061d0/distinct-2-w2-d061d0-kserve-5c6bb99fbf-b4kqs" podStartSLOduration=2.09268435 podStartE2EDuration="2.09268435s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:57:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:57:56.091713716 +0000 UTC m=+1182.011499838" watchObservedRunningTime="2026-10-30 20:57:56.09268435 +0000 UTC m=+1182.012470467"
Oct 30 20:57:56.867356 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:57:56.867322    6004 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w2-d061d0/distinct-2-w2-d061d0-kserve-5c6bb99fbf-b4kqs"
Oct 30 20:58:04.867267 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:58:04.867228    6004 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w2-d061d0/distinct-2-w2-d061d0-kserve-5c6bb99fbf-b4kqs"
Oct 30 20:58:04.880250 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:58:04.880218    6004 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w2-d061d0/distinct-2-w2-d061d0-kserve-5c6bb99fbf-b4kqs"
Oct 30 20:58:05.042976 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:58:05.042947    6004 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w2-d061d0/distinct-2-w2-d061d0-kserve-5c6bb99fbf-b4kqs"
Oct 30 20:58:14.286647 ip-10-0-138-85 kubenswrapper[6004]: E1030 20:58:14.286604    6004 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-zz4wr" containerName="extractor"
Oct 30 20:58:14.410327 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:58:14.410297    6004 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-sb7ds_90cd3de0-c573-41c2-bf3e-cf0e46a41d50/console-operator/2.log"
Oct 30 20:58:14.412872 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:58:14.412848    6004 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-sb7ds_90cd3de0-c573-41c2-bf3e-cf0e46a41d50/console-operator/2.log"
Oct 30 20:58:32.659981 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:58:32.659943    6004 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w2-d061d0-openshift-default-86b87f495-rwjhc"]
Oct 30 20:58:32.664530 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:58:32.664508    6004 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-d061d0-openshift-default-86b87f495-rwjhc"
Oct 30 20:58:32.723528 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:58:32.723485    6004 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w2-d061d0-openshift-default-86b87f495-rwjhc"]
Oct 30 20:58:32.795125 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:58:32.795089    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/60c708c3-7aec-4c49-bbe2-dfacf5f1895a-istio-envoy\") pod \"e2e-worker-w2-d061d0-openshift-default-86b87f495-rwjhc\" (UID: \"60c708c3-7aec-4c49-bbe2-dfacf5f1895a\") " pod="openshift-ingress/e2e-worker-w2-d061d0-openshift-default-86b87f495-rwjhc"
Oct 30 20:58:32.795293 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:58:32.795137    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/60c708c3-7aec-4c49-bbe2-dfacf5f1895a-istio-podinfo\") pod \"e2e-worker-w2-d061d0-openshift-default-86b87f495-rwjhc\" (UID: \"60c708c3-7aec-4c49-bbe2-dfacf5f1895a\") " pod="openshift-ingress/e2e-worker-w2-d061d0-openshift-default-86b87f495-rwjhc"
Oct 30 20:58:32.795293 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:58:32.795231    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4jx7h\" (UniqueName: \"kubernetes.io/projected/60c708c3-7aec-4c49-bbe2-dfacf5f1895a-kube-api-access-4jx7h\") pod \"e2e-worker-w2-d061d0-openshift-default-86b87f495-rwjhc\" (UID: \"60c708c3-7aec-4c49-bbe2-dfacf5f1895a\") " pod="openshift-ingress/e2e-worker-w2-d061d0-openshift-default-86b87f495-rwjhc"
Oct 30 20:58:32.795293 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:58:32.795269    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/60c708c3-7aec-4c49-bbe2-dfacf5f1895a-istio-token\") pod \"e2e-worker-w2-d061d0-openshift-default-86b87f495-rwjhc\" (UID: \"60c708c3-7aec-4c49-bbe2-dfacf5f1895a\") " pod="openshift-ingress/e2e-worker-w2-d061d0-openshift-default-86b87f495-rwjhc"
Oct 30 20:58:32.795426 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:58:32.795303    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/60c708c3-7aec-4c49-bbe2-dfacf5f1895a-istiod-ca-cert\") pod \"e2e-worker-w2-d061d0-openshift-default-86b87f495-rwjhc\" (UID: \"60c708c3-7aec-4c49-bbe2-dfacf5f1895a\") " pod="openshift-ingress/e2e-worker-w2-d061d0-openshift-default-86b87f495-rwjhc"
Oct 30 20:58:32.795462 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:58:32.795418    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/60c708c3-7aec-4c49-bbe2-dfacf5f1895a-istio-data\") pod \"e2e-worker-w2-d061d0-openshift-default-86b87f495-rwjhc\" (UID: \"60c708c3-7aec-4c49-bbe2-dfacf5f1895a\") " pod="openshift-ingress/e2e-worker-w2-d061d0-openshift-default-86b87f495-rwjhc"
Oct 30 20:58:32.795510 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:58:32.795484    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/60c708c3-7aec-4c49-bbe2-dfacf5f1895a-workload-socket\") pod \"e2e-worker-w2-d061d0-openshift-default-86b87f495-rwjhc\" (UID: \"60c708c3-7aec-4c49-bbe2-dfacf5f1895a\") " pod="openshift-ingress/e2e-worker-w2-d061d0-openshift-default-86b87f495-rwjhc"
Oct 30 20:58:32.795570 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:58:32.795557    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/60c708c3-7aec-4c49-bbe2-dfacf5f1895a-credential-socket\") pod \"e2e-worker-w2-d061d0-openshift-default-86b87f495-rwjhc\" (UID: \"60c708c3-7aec-4c49-bbe2-dfacf5f1895a\") " pod="openshift-ingress/e2e-worker-w2-d061d0-openshift-default-86b87f495-rwjhc"
Oct 30 20:58:32.795607 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:58:32.795591    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/60c708c3-7aec-4c49-bbe2-dfacf5f1895a-workload-certs\") pod \"e2e-worker-w2-d061d0-openshift-default-86b87f495-rwjhc\" (UID: \"60c708c3-7aec-4c49-bbe2-dfacf5f1895a\") " pod="openshift-ingress/e2e-worker-w2-d061d0-openshift-default-86b87f495-rwjhc"
Oct 30 20:58:32.897103 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:58:32.897033    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/60c708c3-7aec-4c49-bbe2-dfacf5f1895a-istio-envoy\") pod \"e2e-worker-w2-d061d0-openshift-default-86b87f495-rwjhc\" (UID: \"60c708c3-7aec-4c49-bbe2-dfacf5f1895a\") " pod="openshift-ingress/e2e-worker-w2-d061d0-openshift-default-86b87f495-rwjhc"
Oct 30 20:58:32.897299 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:58:32.897112    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/60c708c3-7aec-4c49-bbe2-dfacf5f1895a-istio-podinfo\") pod \"e2e-worker-w2-d061d0-openshift-default-86b87f495-rwjhc\" (UID: \"60c708c3-7aec-4c49-bbe2-dfacf5f1895a\") " pod="openshift-ingress/e2e-worker-w2-d061d0-openshift-default-86b87f495-rwjhc"
Oct 30 20:58:32.897299 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:58:32.897140    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4jx7h\" (UniqueName: \"kubernetes.io/projected/60c708c3-7aec-4c49-bbe2-dfacf5f1895a-kube-api-access-4jx7h\") pod \"e2e-worker-w2-d061d0-openshift-default-86b87f495-rwjhc\" (UID: \"60c708c3-7aec-4c49-bbe2-dfacf5f1895a\") " pod="openshift-ingress/e2e-worker-w2-d061d0-openshift-default-86b87f495-rwjhc"
Oct 30 20:58:32.897299 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:58:32.897246    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/60c708c3-7aec-4c49-bbe2-dfacf5f1895a-istio-token\") pod \"e2e-worker-w2-d061d0-openshift-default-86b87f495-rwjhc\" (UID: \"60c708c3-7aec-4c49-bbe2-dfacf5f1895a\") " pod="openshift-ingress/e2e-worker-w2-d061d0-openshift-default-86b87f495-rwjhc"
Oct 30 20:58:32.897299 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:58:32.897282    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/60c708c3-7aec-4c49-bbe2-dfacf5f1895a-istiod-ca-cert\") pod \"e2e-worker-w2-d061d0-openshift-default-86b87f495-rwjhc\" (UID: \"60c708c3-7aec-4c49-bbe2-dfacf5f1895a\") " pod="openshift-ingress/e2e-worker-w2-d061d0-openshift-default-86b87f495-rwjhc"
Oct 30 20:58:32.897535 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:58:32.897367    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/60c708c3-7aec-4c49-bbe2-dfacf5f1895a-istio-data\") pod \"e2e-worker-w2-d061d0-openshift-default-86b87f495-rwjhc\" (UID: \"60c708c3-7aec-4c49-bbe2-dfacf5f1895a\") " pod="openshift-ingress/e2e-worker-w2-d061d0-openshift-default-86b87f495-rwjhc"
Oct 30 20:58:32.897535 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:58:32.897427    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/60c708c3-7aec-4c49-bbe2-dfacf5f1895a-workload-socket\") pod \"e2e-worker-w2-d061d0-openshift-default-86b87f495-rwjhc\" (UID: \"60c708c3-7aec-4c49-bbe2-dfacf5f1895a\") " pod="openshift-ingress/e2e-worker-w2-d061d0-openshift-default-86b87f495-rwjhc"
Oct 30 20:58:32.897535 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:58:32.897507    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/60c708c3-7aec-4c49-bbe2-dfacf5f1895a-credential-socket\") pod \"e2e-worker-w2-d061d0-openshift-default-86b87f495-rwjhc\" (UID: \"60c708c3-7aec-4c49-bbe2-dfacf5f1895a\") " pod="openshift-ingress/e2e-worker-w2-d061d0-openshift-default-86b87f495-rwjhc"
Oct 30 20:58:32.897753 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:58:32.897555    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/60c708c3-7aec-4c49-bbe2-dfacf5f1895a-workload-certs\") pod \"e2e-worker-w2-d061d0-openshift-default-86b87f495-rwjhc\" (UID: \"60c708c3-7aec-4c49-bbe2-dfacf5f1895a\") " pod="openshift-ingress/e2e-worker-w2-d061d0-openshift-default-86b87f495-rwjhc"
Oct 30 20:58:32.897816 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:58:32.897750    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/60c708c3-7aec-4c49-bbe2-dfacf5f1895a-istio-data\") pod \"e2e-worker-w2-d061d0-openshift-default-86b87f495-rwjhc\" (UID: \"60c708c3-7aec-4c49-bbe2-dfacf5f1895a\") " pod="openshift-ingress/e2e-worker-w2-d061d0-openshift-default-86b87f495-rwjhc"
Oct 30 20:58:32.897976 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:58:32.897951    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/60c708c3-7aec-4c49-bbe2-dfacf5f1895a-credential-socket\") pod \"e2e-worker-w2-d061d0-openshift-default-86b87f495-rwjhc\" (UID: \"60c708c3-7aec-4c49-bbe2-dfacf5f1895a\") " pod="openshift-ingress/e2e-worker-w2-d061d0-openshift-default-86b87f495-rwjhc"
Oct 30 20:58:32.898041 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:58:32.897980    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/60c708c3-7aec-4c49-bbe2-dfacf5f1895a-workload-socket\") pod \"e2e-worker-w2-d061d0-openshift-default-86b87f495-rwjhc\" (UID: \"60c708c3-7aec-4c49-bbe2-dfacf5f1895a\") " pod="openshift-ingress/e2e-worker-w2-d061d0-openshift-default-86b87f495-rwjhc"
Oct 30 20:58:32.898041 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:58:32.898004    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/60c708c3-7aec-4c49-bbe2-dfacf5f1895a-workload-certs\") pod \"e2e-worker-w2-d061d0-openshift-default-86b87f495-rwjhc\" (UID: \"60c708c3-7aec-4c49-bbe2-dfacf5f1895a\") " pod="openshift-ingress/e2e-worker-w2-d061d0-openshift-default-86b87f495-rwjhc"
Oct 30 20:58:32.898211 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:58:32.898122    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/60c708c3-7aec-4c49-bbe2-dfacf5f1895a-istiod-ca-cert\") pod \"e2e-worker-w2-d061d0-openshift-default-86b87f495-rwjhc\" (UID: \"60c708c3-7aec-4c49-bbe2-dfacf5f1895a\") " pod="openshift-ingress/e2e-worker-w2-d061d0-openshift-default-86b87f495-rwjhc"
Oct 30 20:58:32.899537 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:58:32.899513    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/60c708c3-7aec-4c49-bbe2-dfacf5f1895a-istio-envoy\") pod \"e2e-worker-w2-d061d0-openshift-default-86b87f495-rwjhc\" (UID: \"60c708c3-7aec-4c49-bbe2-dfacf5f1895a\") " pod="openshift-ingress/e2e-worker-w2-d061d0-openshift-default-86b87f495-rwjhc"
Oct 30 20:58:32.899762 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:58:32.899745    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/60c708c3-7aec-4c49-bbe2-dfacf5f1895a-istio-podinfo\") pod \"e2e-worker-w2-d061d0-openshift-default-86b87f495-rwjhc\" (UID: \"60c708c3-7aec-4c49-bbe2-dfacf5f1895a\") " pod="openshift-ingress/e2e-worker-w2-d061d0-openshift-default-86b87f495-rwjhc"
Oct 30 20:58:32.956158 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:58:32.956132    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/60c708c3-7aec-4c49-bbe2-dfacf5f1895a-istio-token\") pod \"e2e-worker-w2-d061d0-openshift-default-86b87f495-rwjhc\" (UID: \"60c708c3-7aec-4c49-bbe2-dfacf5f1895a\") " pod="openshift-ingress/e2e-worker-w2-d061d0-openshift-default-86b87f495-rwjhc"
Oct 30 20:58:32.956374 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:58:32.956351    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4jx7h\" (UniqueName: \"kubernetes.io/projected/60c708c3-7aec-4c49-bbe2-dfacf5f1895a-kube-api-access-4jx7h\") pod \"e2e-worker-w2-d061d0-openshift-default-86b87f495-rwjhc\" (UID: \"60c708c3-7aec-4c49-bbe2-dfacf5f1895a\") " pod="openshift-ingress/e2e-worker-w2-d061d0-openshift-default-86b87f495-rwjhc"
Oct 30 20:58:32.978222 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:58:32.978200    6004 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-d061d0-openshift-default-86b87f495-rwjhc"
Oct 30 20:58:33.409030 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:58:33.409004    6004 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w2-d061d0-openshift-default-86b87f495-rwjhc"]
Oct 30 20:58:33.410601 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:58:33.410571    6004 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod60c708c3_7aec_4c49_bbe2_dfacf5f1895a.slice/crio-2fa524ae216b21d963cca1c6b48d00b88e3b341b2f83582b5aa859605ee91a62 WatchSource:0}: Error finding container 2fa524ae216b21d963cca1c6b48d00b88e3b341b2f83582b5aa859605ee91a62: Status 404 returned error can't find the container with id 2fa524ae216b21d963cca1c6b48d00b88e3b341b2f83582b5aa859605ee91a62
Oct 30 20:58:33.413064 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:58:33.413015    6004 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 20:58:33.413155 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:58:33.413105    6004 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 20:58:33.413155 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:58:33.413137    6004 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 20:58:34.222909 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:58:34.222867    6004 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-d061d0-openshift-default-86b87f495-rwjhc" event={"ID":"60c708c3-7aec-4c49-bbe2-dfacf5f1895a","Type":"ContainerStarted","Data":"54e98ba3626de69388f6b92c5d278ede213c4496bf69b5fc798adb3e7247a31e"}
Oct 30 20:58:34.223355 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:58:34.222931    6004 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-d061d0-openshift-default-86b87f495-rwjhc" event={"ID":"60c708c3-7aec-4c49-bbe2-dfacf5f1895a","Type":"ContainerStarted","Data":"2fa524ae216b21d963cca1c6b48d00b88e3b341b2f83582b5aa859605ee91a62"}
Oct 30 20:58:34.394645 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:58:34.394579    6004 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w2-d061d0-openshift-default-86b87f495-rwjhc" podStartSLOduration=2.394560639 podStartE2EDuration="2.394560639s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:58:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:58:34.390751282 +0000 UTC m=+1220.310537400" watchObservedRunningTime="2026-10-30 20:58:34.394560639 +0000 UTC m=+1220.314346757"
Oct 30 20:58:34.978619 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:58:34.978582    6004 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w2-d061d0-openshift-default-86b87f495-rwjhc"
Oct 30 20:58:34.980193 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:58:34.980154    6004 patch_prober.go:29] interesting pod/e2e-worker-w2-d061d0-openshift-default-86b87f495-rwjhc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.72:15021/healthz/ready\": dial tcp 10.132.0.72:15021: connect: connection refused" start-of-body=
Oct 30 20:58:34.980327 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:58:34.980221    6004 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-d061d0-openshift-default-86b87f495-rwjhc" podUID="60c708c3-7aec-4c49-bbe2-dfacf5f1895a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.72:15021/healthz/ready\": dial tcp 10.132.0.72:15021: connect: connection refused"
Oct 30 20:58:35.979183 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:58:35.979122    6004 patch_prober.go:29] interesting pod/e2e-worker-w2-d061d0-openshift-default-86b87f495-rwjhc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.72:15021/healthz/ready\": dial tcp 10.132.0.72:15021: connect: connection refused" start-of-body=
Oct 30 20:58:35.979836 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:58:35.979802    6004 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-d061d0-openshift-default-86b87f495-rwjhc" podUID="60c708c3-7aec-4c49-bbe2-dfacf5f1895a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.72:15021/healthz/ready\": dial tcp 10.132.0.72:15021: connect: connection refused"
Oct 30 20:58:36.978902 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:58:36.978867    6004 patch_prober.go:29] interesting pod/e2e-worker-w2-d061d0-openshift-default-86b87f495-rwjhc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.72:15021/healthz/ready\": dial tcp 10.132.0.72:15021: connect: connection refused" start-of-body=
Oct 30 20:58:36.979088 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:58:36.978919    6004 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-d061d0-openshift-default-86b87f495-rwjhc" podUID="60c708c3-7aec-4c49-bbe2-dfacf5f1895a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.72:15021/healthz/ready\": dial tcp 10.132.0.72:15021: connect: connection refused"
Oct 30 20:58:37.978638 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:58:37.978601    6004 patch_prober.go:29] interesting pod/e2e-worker-w2-d061d0-openshift-default-86b87f495-rwjhc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.72:15021/healthz/ready\": dial tcp 10.132.0.72:15021: connect: connection refused" start-of-body=
Oct 30 20:58:37.979179 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:58:37.978666    6004 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-d061d0-openshift-default-86b87f495-rwjhc" podUID="60c708c3-7aec-4c49-bbe2-dfacf5f1895a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.72:15021/healthz/ready\": dial tcp 10.132.0.72:15021: connect: connection refused"
Oct 30 20:58:38.979725 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:58:38.979681    6004 patch_prober.go:29] interesting pod/e2e-worker-w2-d061d0-openshift-default-86b87f495-rwjhc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.72:15021/healthz/ready\": dial tcp 10.132.0.72:15021: connect: connection refused" start-of-body=
Oct 30 20:58:38.980256 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:58:38.979753    6004 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-d061d0-openshift-default-86b87f495-rwjhc" podUID="60c708c3-7aec-4c49-bbe2-dfacf5f1895a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.72:15021/healthz/ready\": dial tcp 10.132.0.72:15021: connect: connection refused"
Oct 30 20:58:39.979325 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:58:39.979279    6004 patch_prober.go:29] interesting pod/e2e-worker-w2-d061d0-openshift-default-86b87f495-rwjhc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.72:15021/healthz/ready\": dial tcp 10.132.0.72:15021: connect: connection refused" start-of-body=
Oct 30 20:58:39.979500 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:58:39.979377    6004 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-d061d0-openshift-default-86b87f495-rwjhc" podUID="60c708c3-7aec-4c49-bbe2-dfacf5f1895a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.72:15021/healthz/ready\": dial tcp 10.132.0.72:15021: connect: connection refused"
Oct 30 20:58:41.008000 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:58:41.007972    6004 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w2-d061d0-openshift-default-86b87f495-rwjhc"
Oct 30 20:58:41.008486 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:58:41.008425    6004 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w2-d061d0-openshift-default-86b87f495-rwjhc"
Oct 30 20:58:41.009159 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:58:41.009141    6004 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w2-d061d0-openshift-default-86b87f495-rwjhc"
Oct 30 20:58:44.286581 ip-10-0-138-85 kubenswrapper[6004]: E1030 20:58:44.286541    6004 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-zz4wr" containerName="extractor"
Oct 30 20:58:56.264977 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:58:56.264937    6004 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w4-1fdaa7/distinct-2-w4-1fdaa7-kserve-59f4d6788b-b6gl4"]
Oct 30 20:58:56.270206 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:58:56.270181    6004 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-1fdaa7/distinct-2-w4-1fdaa7-kserve-59f4d6788b-b6gl4"
Oct 30 20:58:56.319714 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:58:56.319678    6004 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w4-1fdaa7/distinct-2-w4-1fdaa7-kserve-59f4d6788b-b6gl4"]
Oct 30 20:58:56.365723 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:58:56.365692    6004 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w4-1fdaa7\"/\"default-dockercfg-ffzcn\""
Oct 30 20:58:56.366165 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:58:56.366130    6004 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w4-1fdaa7\"/\"distinct-2-w4-1fdaa7-kserve-self-signed-certs\""
Oct 30 20:58:56.376910 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:58:56.376878    6004 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w4-1fdaa7\"/\"openshift-service-ca.crt\""
Oct 30 20:58:56.377042 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:58:56.376973    6004 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w4-1fdaa7\"/\"kube-root-ca.crt\""
Oct 30 20:58:56.396767 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:58:56.396732    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f6d2856c-84b5-426d-bfcd-ef613ab44242-dshm\") pod \"distinct-2-w4-1fdaa7-kserve-59f4d6788b-b6gl4\" (UID: \"f6d2856c-84b5-426d-bfcd-ef613ab44242\") " pod="e2e-models-e2e-worker-w4-1fdaa7/distinct-2-w4-1fdaa7-kserve-59f4d6788b-b6gl4"
Oct 30 20:58:56.410094 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:58:56.397099    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f6d2856c-84b5-426d-bfcd-ef613ab44242-home\") pod \"distinct-2-w4-1fdaa7-kserve-59f4d6788b-b6gl4\" (UID: \"f6d2856c-84b5-426d-bfcd-ef613ab44242\") " pod="e2e-models-e2e-worker-w4-1fdaa7/distinct-2-w4-1fdaa7-kserve-59f4d6788b-b6gl4"
Oct 30 20:58:56.410412 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:58:56.410382    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hb929\" (UniqueName: \"kubernetes.io/projected/f6d2856c-84b5-426d-bfcd-ef613ab44242-kube-api-access-hb929\") pod \"distinct-2-w4-1fdaa7-kserve-59f4d6788b-b6gl4\" (UID: \"f6d2856c-84b5-426d-bfcd-ef613ab44242\") " pod="e2e-models-e2e-worker-w4-1fdaa7/distinct-2-w4-1fdaa7-kserve-59f4d6788b-b6gl4"
Oct 30 20:58:56.410829 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:58:56.410804    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f6d2856c-84b5-426d-bfcd-ef613ab44242-tmp-dir\") pod \"distinct-2-w4-1fdaa7-kserve-59f4d6788b-b6gl4\" (UID: \"f6d2856c-84b5-426d-bfcd-ef613ab44242\") " pod="e2e-models-e2e-worker-w4-1fdaa7/distinct-2-w4-1fdaa7-kserve-59f4d6788b-b6gl4"
Oct 30 20:58:56.411088 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:58:56.411068    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f6d2856c-84b5-426d-bfcd-ef613ab44242-tls-certs\") pod \"distinct-2-w4-1fdaa7-kserve-59f4d6788b-b6gl4\" (UID: \"f6d2856c-84b5-426d-bfcd-ef613ab44242\") " pod="e2e-models-e2e-worker-w4-1fdaa7/distinct-2-w4-1fdaa7-kserve-59f4d6788b-b6gl4"
Oct 30 20:58:56.411322 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:58:56.411303    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f6d2856c-84b5-426d-bfcd-ef613ab44242-model-cache\") pod \"distinct-2-w4-1fdaa7-kserve-59f4d6788b-b6gl4\" (UID: \"f6d2856c-84b5-426d-bfcd-ef613ab44242\") " pod="e2e-models-e2e-worker-w4-1fdaa7/distinct-2-w4-1fdaa7-kserve-59f4d6788b-b6gl4"
Oct 30 20:58:56.513458 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:58:56.513415    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f6d2856c-84b5-426d-bfcd-ef613ab44242-dshm\") pod \"distinct-2-w4-1fdaa7-kserve-59f4d6788b-b6gl4\" (UID: \"f6d2856c-84b5-426d-bfcd-ef613ab44242\") " pod="e2e-models-e2e-worker-w4-1fdaa7/distinct-2-w4-1fdaa7-kserve-59f4d6788b-b6gl4"
Oct 30 20:58:56.513776 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:58:56.513747    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f6d2856c-84b5-426d-bfcd-ef613ab44242-home\") pod \"distinct-2-w4-1fdaa7-kserve-59f4d6788b-b6gl4\" (UID: \"f6d2856c-84b5-426d-bfcd-ef613ab44242\") " pod="e2e-models-e2e-worker-w4-1fdaa7/distinct-2-w4-1fdaa7-kserve-59f4d6788b-b6gl4"
Oct 30 20:58:56.513922 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:58:56.513904    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hb929\" (UniqueName: \"kubernetes.io/projected/f6d2856c-84b5-426d-bfcd-ef613ab44242-kube-api-access-hb929\") pod \"distinct-2-w4-1fdaa7-kserve-59f4d6788b-b6gl4\" (UID: \"f6d2856c-84b5-426d-bfcd-ef613ab44242\") " pod="e2e-models-e2e-worker-w4-1fdaa7/distinct-2-w4-1fdaa7-kserve-59f4d6788b-b6gl4"
Oct 30 20:58:56.514126 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:58:56.514107    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f6d2856c-84b5-426d-bfcd-ef613ab44242-tmp-dir\") pod \"distinct-2-w4-1fdaa7-kserve-59f4d6788b-b6gl4\" (UID: \"f6d2856c-84b5-426d-bfcd-ef613ab44242\") " pod="e2e-models-e2e-worker-w4-1fdaa7/distinct-2-w4-1fdaa7-kserve-59f4d6788b-b6gl4"
Oct 30 20:58:56.514292 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:58:56.514273    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f6d2856c-84b5-426d-bfcd-ef613ab44242-tls-certs\") pod \"distinct-2-w4-1fdaa7-kserve-59f4d6788b-b6gl4\" (UID: \"f6d2856c-84b5-426d-bfcd-ef613ab44242\") " pod="e2e-models-e2e-worker-w4-1fdaa7/distinct-2-w4-1fdaa7-kserve-59f4d6788b-b6gl4"
Oct 30 20:58:56.514414 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:58:56.514399    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f6d2856c-84b5-426d-bfcd-ef613ab44242-model-cache\") pod \"distinct-2-w4-1fdaa7-kserve-59f4d6788b-b6gl4\" (UID: \"f6d2856c-84b5-426d-bfcd-ef613ab44242\") " pod="e2e-models-e2e-worker-w4-1fdaa7/distinct-2-w4-1fdaa7-kserve-59f4d6788b-b6gl4"
Oct 30 20:58:56.514854 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:58:56.514832    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f6d2856c-84b5-426d-bfcd-ef613ab44242-home\") pod \"distinct-2-w4-1fdaa7-kserve-59f4d6788b-b6gl4\" (UID: \"f6d2856c-84b5-426d-bfcd-ef613ab44242\") " pod="e2e-models-e2e-worker-w4-1fdaa7/distinct-2-w4-1fdaa7-kserve-59f4d6788b-b6gl4"
Oct 30 20:58:56.515356 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:58:56.515291    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f6d2856c-84b5-426d-bfcd-ef613ab44242-tmp-dir\") pod \"distinct-2-w4-1fdaa7-kserve-59f4d6788b-b6gl4\" (UID: \"f6d2856c-84b5-426d-bfcd-ef613ab44242\") " pod="e2e-models-e2e-worker-w4-1fdaa7/distinct-2-w4-1fdaa7-kserve-59f4d6788b-b6gl4"
Oct 30 20:58:56.515586 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:58:56.515566    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f6d2856c-84b5-426d-bfcd-ef613ab44242-model-cache\") pod \"distinct-2-w4-1fdaa7-kserve-59f4d6788b-b6gl4\" (UID: \"f6d2856c-84b5-426d-bfcd-ef613ab44242\") " pod="e2e-models-e2e-worker-w4-1fdaa7/distinct-2-w4-1fdaa7-kserve-59f4d6788b-b6gl4"
Oct 30 20:58:56.517209 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:58:56.517186    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f6d2856c-84b5-426d-bfcd-ef613ab44242-dshm\") pod \"distinct-2-w4-1fdaa7-kserve-59f4d6788b-b6gl4\" (UID: \"f6d2856c-84b5-426d-bfcd-ef613ab44242\") " pod="e2e-models-e2e-worker-w4-1fdaa7/distinct-2-w4-1fdaa7-kserve-59f4d6788b-b6gl4"
Oct 30 20:58:56.517814 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:58:56.517795    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f6d2856c-84b5-426d-bfcd-ef613ab44242-tls-certs\") pod \"distinct-2-w4-1fdaa7-kserve-59f4d6788b-b6gl4\" (UID: \"f6d2856c-84b5-426d-bfcd-ef613ab44242\") " pod="e2e-models-e2e-worker-w4-1fdaa7/distinct-2-w4-1fdaa7-kserve-59f4d6788b-b6gl4"
Oct 30 20:58:56.585238 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:58:56.585203    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hb929\" (UniqueName: \"kubernetes.io/projected/f6d2856c-84b5-426d-bfcd-ef613ab44242-kube-api-access-hb929\") pod \"distinct-2-w4-1fdaa7-kserve-59f4d6788b-b6gl4\" (UID: \"f6d2856c-84b5-426d-bfcd-ef613ab44242\") " pod="e2e-models-e2e-worker-w4-1fdaa7/distinct-2-w4-1fdaa7-kserve-59f4d6788b-b6gl4"
Oct 30 20:58:56.592545 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:58:56.592278    6004 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-1fdaa7/distinct-2-w4-1fdaa7-kserve-59f4d6788b-b6gl4"
Oct 30 20:58:57.098112 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:58:57.098078    6004 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w4-1fdaa7/distinct-2-w4-1fdaa7-kserve-59f4d6788b-b6gl4"]
Oct 30 20:58:57.099685 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:58:57.099658    6004 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf6d2856c_84b5_426d_bfcd_ef613ab44242.slice/crio-21d46dfdaabf30ef006d71cf49336e09675a19a96a75b9a071f123bcca64d502 WatchSource:0}: Error finding container 21d46dfdaabf30ef006d71cf49336e09675a19a96a75b9a071f123bcca64d502: Status 404 returned error can't find the container with id 21d46dfdaabf30ef006d71cf49336e09675a19a96a75b9a071f123bcca64d502
Oct 30 20:58:57.420568 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:58:57.420469    6004 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-1fdaa7/distinct-2-w4-1fdaa7-kserve-59f4d6788b-b6gl4" event={"ID":"f6d2856c-84b5-426d-bfcd-ef613ab44242","Type":"ContainerStarted","Data":"9d0b8bd753049f6166c7e90dc378024c771f47fc971b347e5c53cafee01c55a4"}
Oct 30 20:58:57.420568 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:58:57.420512    6004 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-1fdaa7/distinct-2-w4-1fdaa7-kserve-59f4d6788b-b6gl4" event={"ID":"f6d2856c-84b5-426d-bfcd-ef613ab44242","Type":"ContainerStarted","Data":"21d46dfdaabf30ef006d71cf49336e09675a19a96a75b9a071f123bcca64d502"}
Oct 30 20:58:57.537723 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:58:57.537668    6004 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-models-e2e-worker-w4-1fdaa7/distinct-2-w4-1fdaa7-kserve-59f4d6788b-b6gl4" podStartSLOduration=1.5376531930000001 podStartE2EDuration="1.537653193s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:58:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:58:57.535765356 +0000 UTC m=+1243.455551475" watchObservedRunningTime="2026-10-30 20:58:57.537653193 +0000 UTC m=+1243.457439310"
Oct 30 20:58:57.593942 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:58:57.593900    6004 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w4-1fdaa7/distinct-2-w4-1fdaa7-kserve-59f4d6788b-b6gl4"
Oct 30 20:59:00.917445 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:59:00.917412    6004 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w6-8fa2a7-openshift-default-69876bd499-pmvdv"]
Oct 30 20:59:00.921409 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:59:00.921388    6004 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w6-8fa2a7-openshift-default-69876bd499-pmvdv"
Oct 30 20:59:01.024408 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:59:01.024379    6004 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w6-8fa2a7-openshift-default-dockercfg-gf577\""
Oct 30 20:59:01.027103 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:59:01.027081    6004 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w6-8fa2a7-openshift-default-69876bd499-pmvdv"]
Oct 30 20:59:01.070230 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:59:01.070178    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/525254d6-96ad-4f59-becb-684cbf65e012-credential-socket\") pod \"e2e-worker-w6-8fa2a7-openshift-default-69876bd499-pmvdv\" (UID: \"525254d6-96ad-4f59-becb-684cbf65e012\") " pod="openshift-ingress/e2e-worker-w6-8fa2a7-openshift-default-69876bd499-pmvdv"
Oct 30 20:59:01.070230 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:59:01.070233    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/525254d6-96ad-4f59-becb-684cbf65e012-istio-envoy\") pod \"e2e-worker-w6-8fa2a7-openshift-default-69876bd499-pmvdv\" (UID: \"525254d6-96ad-4f59-becb-684cbf65e012\") " pod="openshift-ingress/e2e-worker-w6-8fa2a7-openshift-default-69876bd499-pmvdv"
Oct 30 20:59:01.070453 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:59:01.070380    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/525254d6-96ad-4f59-becb-684cbf65e012-istiod-ca-cert\") pod \"e2e-worker-w6-8fa2a7-openshift-default-69876bd499-pmvdv\" (UID: \"525254d6-96ad-4f59-becb-684cbf65e012\") " pod="openshift-ingress/e2e-worker-w6-8fa2a7-openshift-default-69876bd499-pmvdv"
Oct 30 20:59:01.070504 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:59:01.070449    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sl5x5\" (UniqueName: \"kubernetes.io/projected/525254d6-96ad-4f59-becb-684cbf65e012-kube-api-access-sl5x5\") pod \"e2e-worker-w6-8fa2a7-openshift-default-69876bd499-pmvdv\" (UID: \"525254d6-96ad-4f59-becb-684cbf65e012\") " pod="openshift-ingress/e2e-worker-w6-8fa2a7-openshift-default-69876bd499-pmvdv"
Oct 30 20:59:01.070540 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:59:01.070529    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/525254d6-96ad-4f59-becb-684cbf65e012-istio-token\") pod \"e2e-worker-w6-8fa2a7-openshift-default-69876bd499-pmvdv\" (UID: \"525254d6-96ad-4f59-becb-684cbf65e012\") " pod="openshift-ingress/e2e-worker-w6-8fa2a7-openshift-default-69876bd499-pmvdv"
Oct 30 20:59:01.070607 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:59:01.070589    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/525254d6-96ad-4f59-becb-684cbf65e012-istio-podinfo\") pod \"e2e-worker-w6-8fa2a7-openshift-default-69876bd499-pmvdv\" (UID: \"525254d6-96ad-4f59-becb-684cbf65e012\") " pod="openshift-ingress/e2e-worker-w6-8fa2a7-openshift-default-69876bd499-pmvdv"
Oct 30 20:59:01.070692 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:59:01.070672    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/525254d6-96ad-4f59-becb-684cbf65e012-workload-certs\") pod \"e2e-worker-w6-8fa2a7-openshift-default-69876bd499-pmvdv\" (UID: \"525254d6-96ad-4f59-becb-684cbf65e012\") " pod="openshift-ingress/e2e-worker-w6-8fa2a7-openshift-default-69876bd499-pmvdv"
Oct 30 20:59:01.070731 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:59:01.070707    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/525254d6-96ad-4f59-becb-684cbf65e012-workload-socket\") pod \"e2e-worker-w6-8fa2a7-openshift-default-69876bd499-pmvdv\" (UID: \"525254d6-96ad-4f59-becb-684cbf65e012\") " pod="openshift-ingress/e2e-worker-w6-8fa2a7-openshift-default-69876bd499-pmvdv"
Oct 30 20:59:01.070764 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:59:01.070729    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/525254d6-96ad-4f59-becb-684cbf65e012-istio-data\") pod \"e2e-worker-w6-8fa2a7-openshift-default-69876bd499-pmvdv\" (UID: \"525254d6-96ad-4f59-becb-684cbf65e012\") " pod="openshift-ingress/e2e-worker-w6-8fa2a7-openshift-default-69876bd499-pmvdv"
Oct 30 20:59:01.171814 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:59:01.171716    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/525254d6-96ad-4f59-becb-684cbf65e012-istio-token\") pod \"e2e-worker-w6-8fa2a7-openshift-default-69876bd499-pmvdv\" (UID: \"525254d6-96ad-4f59-becb-684cbf65e012\") " pod="openshift-ingress/e2e-worker-w6-8fa2a7-openshift-default-69876bd499-pmvdv"
Oct 30 20:59:01.171814 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:59:01.171770    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/525254d6-96ad-4f59-becb-684cbf65e012-istio-podinfo\") pod \"e2e-worker-w6-8fa2a7-openshift-default-69876bd499-pmvdv\" (UID: \"525254d6-96ad-4f59-becb-684cbf65e012\") " pod="openshift-ingress/e2e-worker-w6-8fa2a7-openshift-default-69876bd499-pmvdv"
Oct 30 20:59:01.171814 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:59:01.171815    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/525254d6-96ad-4f59-becb-684cbf65e012-workload-certs\") pod \"e2e-worker-w6-8fa2a7-openshift-default-69876bd499-pmvdv\" (UID: \"525254d6-96ad-4f59-becb-684cbf65e012\") " pod="openshift-ingress/e2e-worker-w6-8fa2a7-openshift-default-69876bd499-pmvdv"
Oct 30 20:59:01.172145 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:59:01.171837    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/525254d6-96ad-4f59-becb-684cbf65e012-workload-socket\") pod \"e2e-worker-w6-8fa2a7-openshift-default-69876bd499-pmvdv\" (UID: \"525254d6-96ad-4f59-becb-684cbf65e012\") " pod="openshift-ingress/e2e-worker-w6-8fa2a7-openshift-default-69876bd499-pmvdv"
Oct 30 20:59:01.172145 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:59:01.171859    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/525254d6-96ad-4f59-becb-684cbf65e012-istio-data\") pod \"e2e-worker-w6-8fa2a7-openshift-default-69876bd499-pmvdv\" (UID: \"525254d6-96ad-4f59-becb-684cbf65e012\") " pod="openshift-ingress/e2e-worker-w6-8fa2a7-openshift-default-69876bd499-pmvdv"
Oct 30 20:59:01.172145 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:59:01.171948    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/525254d6-96ad-4f59-becb-684cbf65e012-credential-socket\") pod \"e2e-worker-w6-8fa2a7-openshift-default-69876bd499-pmvdv\" (UID: \"525254d6-96ad-4f59-becb-684cbf65e012\") " pod="openshift-ingress/e2e-worker-w6-8fa2a7-openshift-default-69876bd499-pmvdv"
Oct 30 20:59:01.172145 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:59:01.171969    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/525254d6-96ad-4f59-becb-684cbf65e012-istio-envoy\") pod \"e2e-worker-w6-8fa2a7-openshift-default-69876bd499-pmvdv\" (UID: \"525254d6-96ad-4f59-becb-684cbf65e012\") " pod="openshift-ingress/e2e-worker-w6-8fa2a7-openshift-default-69876bd499-pmvdv"
Oct 30 20:59:01.172145 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:59:01.172033    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/525254d6-96ad-4f59-becb-684cbf65e012-istiod-ca-cert\") pod \"e2e-worker-w6-8fa2a7-openshift-default-69876bd499-pmvdv\" (UID: \"525254d6-96ad-4f59-becb-684cbf65e012\") " pod="openshift-ingress/e2e-worker-w6-8fa2a7-openshift-default-69876bd499-pmvdv"
Oct 30 20:59:01.172145 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:59:01.172111    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sl5x5\" (UniqueName: \"kubernetes.io/projected/525254d6-96ad-4f59-becb-684cbf65e012-kube-api-access-sl5x5\") pod \"e2e-worker-w6-8fa2a7-openshift-default-69876bd499-pmvdv\" (UID: \"525254d6-96ad-4f59-becb-684cbf65e012\") " pod="openshift-ingress/e2e-worker-w6-8fa2a7-openshift-default-69876bd499-pmvdv"
Oct 30 20:59:01.172454 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:59:01.172285    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/525254d6-96ad-4f59-becb-684cbf65e012-workload-certs\") pod \"e2e-worker-w6-8fa2a7-openshift-default-69876bd499-pmvdv\" (UID: \"525254d6-96ad-4f59-becb-684cbf65e012\") " pod="openshift-ingress/e2e-worker-w6-8fa2a7-openshift-default-69876bd499-pmvdv"
Oct 30 20:59:01.172508 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:59:01.172445    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/525254d6-96ad-4f59-becb-684cbf65e012-credential-socket\") pod \"e2e-worker-w6-8fa2a7-openshift-default-69876bd499-pmvdv\" (UID: \"525254d6-96ad-4f59-becb-684cbf65e012\") " pod="openshift-ingress/e2e-worker-w6-8fa2a7-openshift-default-69876bd499-pmvdv"
Oct 30 20:59:01.172583 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:59:01.172558    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/525254d6-96ad-4f59-becb-684cbf65e012-workload-socket\") pod \"e2e-worker-w6-8fa2a7-openshift-default-69876bd499-pmvdv\" (UID: \"525254d6-96ad-4f59-becb-684cbf65e012\") " pod="openshift-ingress/e2e-worker-w6-8fa2a7-openshift-default-69876bd499-pmvdv"
Oct 30 20:59:01.172638 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:59:01.172601    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/525254d6-96ad-4f59-becb-684cbf65e012-istio-data\") pod \"e2e-worker-w6-8fa2a7-openshift-default-69876bd499-pmvdv\" (UID: \"525254d6-96ad-4f59-becb-684cbf65e012\") " pod="openshift-ingress/e2e-worker-w6-8fa2a7-openshift-default-69876bd499-pmvdv"
Oct 30 20:59:01.173146 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:59:01.173111    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/525254d6-96ad-4f59-becb-684cbf65e012-istiod-ca-cert\") pod \"e2e-worker-w6-8fa2a7-openshift-default-69876bd499-pmvdv\" (UID: \"525254d6-96ad-4f59-becb-684cbf65e012\") " pod="openshift-ingress/e2e-worker-w6-8fa2a7-openshift-default-69876bd499-pmvdv"
Oct 30 20:59:01.174850 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:59:01.174823    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/525254d6-96ad-4f59-becb-684cbf65e012-istio-envoy\") pod \"e2e-worker-w6-8fa2a7-openshift-default-69876bd499-pmvdv\" (UID: \"525254d6-96ad-4f59-becb-684cbf65e012\") " pod="openshift-ingress/e2e-worker-w6-8fa2a7-openshift-default-69876bd499-pmvdv"
Oct 30 20:59:01.175540 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:59:01.175513    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/525254d6-96ad-4f59-becb-684cbf65e012-istio-podinfo\") pod \"e2e-worker-w6-8fa2a7-openshift-default-69876bd499-pmvdv\" (UID: \"525254d6-96ad-4f59-becb-684cbf65e012\") " pod="openshift-ingress/e2e-worker-w6-8fa2a7-openshift-default-69876bd499-pmvdv"
Oct 30 20:59:01.229392 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:59:01.229359    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/525254d6-96ad-4f59-becb-684cbf65e012-istio-token\") pod \"e2e-worker-w6-8fa2a7-openshift-default-69876bd499-pmvdv\" (UID: \"525254d6-96ad-4f59-becb-684cbf65e012\") " pod="openshift-ingress/e2e-worker-w6-8fa2a7-openshift-default-69876bd499-pmvdv"
Oct 30 20:59:01.229506 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:59:01.229475    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sl5x5\" (UniqueName: \"kubernetes.io/projected/525254d6-96ad-4f59-becb-684cbf65e012-kube-api-access-sl5x5\") pod \"e2e-worker-w6-8fa2a7-openshift-default-69876bd499-pmvdv\" (UID: \"525254d6-96ad-4f59-becb-684cbf65e012\") " pod="openshift-ingress/e2e-worker-w6-8fa2a7-openshift-default-69876bd499-pmvdv"
Oct 30 20:59:01.235223 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:59:01.235198    6004 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w6-8fa2a7-openshift-default-69876bd499-pmvdv"
Oct 30 20:59:01.675069 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:59:01.675005    6004 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w6-8fa2a7-openshift-default-69876bd499-pmvdv"]
Oct 30 20:59:01.709893 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:59:01.709855    6004 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod525254d6_96ad_4f59_becb_684cbf65e012.slice/crio-3a6b0cfc709704914c9ff36b0662f31db955ccc7668a87b2cdb29960c055a255 WatchSource:0}: Error finding container 3a6b0cfc709704914c9ff36b0662f31db955ccc7668a87b2cdb29960c055a255: Status 404 returned error can't find the container with id 3a6b0cfc709704914c9ff36b0662f31db955ccc7668a87b2cdb29960c055a255
Oct 30 20:59:01.712313 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:59:01.712281    6004 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 20:59:01.712393 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:59:01.712345    6004 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 20:59:01.712393 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:59:01.712373    6004 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 20:59:02.474629 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:59:02.474587    6004 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-8fa2a7-openshift-default-69876bd499-pmvdv" event={"ID":"525254d6-96ad-4f59-becb-684cbf65e012","Type":"ContainerStarted","Data":"eb824dbc51bfc651d7765f07b571c77b0cbe79bfe90bc32f1c9b94a9ffaf28e0"}
Oct 30 20:59:02.475146 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:59:02.474650    6004 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-8fa2a7-openshift-default-69876bd499-pmvdv" event={"ID":"525254d6-96ad-4f59-becb-684cbf65e012","Type":"ContainerStarted","Data":"3a6b0cfc709704914c9ff36b0662f31db955ccc7668a87b2cdb29960c055a255"}
Oct 30 20:59:02.593931 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:59:02.593880    6004 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w6-8fa2a7-openshift-default-69876bd499-pmvdv" podStartSLOduration=2.5938654899999998 podStartE2EDuration="2.59386549s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:59:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:59:02.591882355 +0000 UTC m=+1248.511668474" watchObservedRunningTime="2026-10-30 20:59:02.59386549 +0000 UTC m=+1248.513651608"
Oct 30 20:59:03.244075 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:59:03.240189    6004 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w6-8fa2a7-openshift-default-69876bd499-pmvdv"
Oct 30 20:59:03.244075 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:59:03.240328    6004 patch_prober.go:29] interesting pod/e2e-worker-w6-8fa2a7-openshift-default-69876bd499-pmvdv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.74:15021/healthz/ready\": dial tcp 10.132.0.74:15021: connect: connection refused" start-of-body=
Oct 30 20:59:03.244075 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:59:03.240387    6004 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-8fa2a7-openshift-default-69876bd499-pmvdv" podUID="525254d6-96ad-4f59-becb-684cbf65e012" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.74:15021/healthz/ready\": dial tcp 10.132.0.74:15021: connect: connection refused"
Oct 30 20:59:04.255073 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:59:04.238393    6004 patch_prober.go:29] interesting pod/e2e-worker-w6-8fa2a7-openshift-default-69876bd499-pmvdv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.74:15021/healthz/ready\": dial tcp 10.132.0.74:15021: connect: connection refused" start-of-body=
Oct 30 20:59:04.255073 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:59:04.238460    6004 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-8fa2a7-openshift-default-69876bd499-pmvdv" podUID="525254d6-96ad-4f59-becb-684cbf65e012" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.74:15021/healthz/ready\": dial tcp 10.132.0.74:15021: connect: connection refused"
Oct 30 20:59:05.252081 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:59:05.242637    6004 patch_prober.go:29] interesting pod/e2e-worker-w6-8fa2a7-openshift-default-69876bd499-pmvdv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.74:15021/healthz/ready\": dial tcp 10.132.0.74:15021: connect: connection refused" start-of-body=
Oct 30 20:59:05.252081 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:59:05.242698    6004 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-8fa2a7-openshift-default-69876bd499-pmvdv" podUID="525254d6-96ad-4f59-becb-684cbf65e012" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.74:15021/healthz/ready\": dial tcp 10.132.0.74:15021: connect: connection refused"
Oct 30 20:59:06.278076 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:59:06.273114    6004 patch_prober.go:29] interesting pod/e2e-worker-w6-8fa2a7-openshift-default-69876bd499-pmvdv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.74:15021/healthz/ready\": dial tcp 10.132.0.74:15021: connect: connection refused" start-of-body=
Oct 30 20:59:06.278076 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:59:06.273187    6004 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-8fa2a7-openshift-default-69876bd499-pmvdv" podUID="525254d6-96ad-4f59-becb-684cbf65e012" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.74:15021/healthz/ready\": dial tcp 10.132.0.74:15021: connect: connection refused"
Oct 30 20:59:06.593068 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:59:06.592963    6004 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w4-1fdaa7/distinct-2-w4-1fdaa7-kserve-59f4d6788b-b6gl4"
Oct 30 20:59:06.610365 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:59:06.610335    6004 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w4-1fdaa7/distinct-2-w4-1fdaa7-kserve-59f4d6788b-b6gl4"
Oct 30 20:59:07.240078 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:59:07.238407    6004 patch_prober.go:29] interesting pod/e2e-worker-w6-8fa2a7-openshift-default-69876bd499-pmvdv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.74:15021/healthz/ready\": dial tcp 10.132.0.74:15021: connect: connection refused" start-of-body=
Oct 30 20:59:07.240078 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:59:07.238468    6004 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-8fa2a7-openshift-default-69876bd499-pmvdv" podUID="525254d6-96ad-4f59-becb-684cbf65e012" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.74:15021/healthz/ready\": dial tcp 10.132.0.74:15021: connect: connection refused"
Oct 30 20:59:07.516814 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:59:07.516736    6004 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w4-1fdaa7/distinct-2-w4-1fdaa7-kserve-59f4d6788b-b6gl4"
Oct 30 20:59:08.236444 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:59:08.236410    6004 patch_prober.go:29] interesting pod/e2e-worker-w6-8fa2a7-openshift-default-69876bd499-pmvdv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.74:15021/healthz/ready\": dial tcp 10.132.0.74:15021: connect: connection refused" start-of-body=
Oct 30 20:59:08.236653 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:59:08.236472    6004 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-8fa2a7-openshift-default-69876bd499-pmvdv" podUID="525254d6-96ad-4f59-becb-684cbf65e012" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.74:15021/healthz/ready\": dial tcp 10.132.0.74:15021: connect: connection refused"
Oct 30 20:59:09.240630 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:59:09.240595    6004 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w6-8fa2a7-openshift-default-69876bd499-pmvdv"
Oct 30 20:59:09.241149 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:59:09.240919    6004 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w6-8fa2a7-openshift-default-69876bd499-pmvdv"
Oct 30 20:59:09.241783 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:59:09.241763    6004 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w6-8fa2a7-openshift-default-69876bd499-pmvdv"
Oct 30 20:59:14.286515 ip-10-0-138-85 kubenswrapper[6004]: E1030 20:59:14.286477    6004 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-zz4wr" containerName="extractor"
Oct 30 20:59:17.719365 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:59:17.719329    6004 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w0-781058-openshift-default-55fb495b7-4rkzd"]
Oct 30 20:59:17.724384 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:59:17.724365    6004 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-781058-openshift-default-55fb495b7-4rkzd"
Oct 30 20:59:17.769602 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:59:17.769575    6004 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w0-781058-openshift-default-55fb495b7-xgtg7"]
Oct 30 20:59:17.773440 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:59:17.773424    6004 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-781058-openshift-default-55fb495b7-xgtg7"
Oct 30 20:59:17.814066 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:59:17.814015    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pr4j8\" (UniqueName: \"kubernetes.io/projected/c9a46681-c4b7-48f6-b95a-60f12f98c54d-kube-api-access-pr4j8\") pod \"e2e-worker-w0-781058-openshift-default-55fb495b7-xgtg7\" (UID: \"c9a46681-c4b7-48f6-b95a-60f12f98c54d\") " pod="openshift-ingress/e2e-worker-w0-781058-openshift-default-55fb495b7-xgtg7"
Oct 30 20:59:17.814267 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:59:17.814085    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xs7sx\" (UniqueName: \"kubernetes.io/projected/9b820c81-5ae6-459a-9510-72c234e98679-kube-api-access-xs7sx\") pod \"e2e-worker-w0-781058-openshift-default-55fb495b7-4rkzd\" (UID: \"9b820c81-5ae6-459a-9510-72c234e98679\") " pod="openshift-ingress/e2e-worker-w0-781058-openshift-default-55fb495b7-4rkzd"
Oct 30 20:59:17.814267 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:59:17.814158    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c9a46681-c4b7-48f6-b95a-60f12f98c54d-istio-envoy\") pod \"e2e-worker-w0-781058-openshift-default-55fb495b7-xgtg7\" (UID: \"c9a46681-c4b7-48f6-b95a-60f12f98c54d\") " pod="openshift-ingress/e2e-worker-w0-781058-openshift-default-55fb495b7-xgtg7"
Oct 30 20:59:17.814267 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:59:17.814210    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c9a46681-c4b7-48f6-b95a-60f12f98c54d-workload-socket\") pod \"e2e-worker-w0-781058-openshift-default-55fb495b7-xgtg7\" (UID: \"c9a46681-c4b7-48f6-b95a-60f12f98c54d\") " pod="openshift-ingress/e2e-worker-w0-781058-openshift-default-55fb495b7-xgtg7"
Oct 30 20:59:17.814267 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:59:17.814255    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9b820c81-5ae6-459a-9510-72c234e98679-istiod-ca-cert\") pod \"e2e-worker-w0-781058-openshift-default-55fb495b7-4rkzd\" (UID: \"9b820c81-5ae6-459a-9510-72c234e98679\") " pod="openshift-ingress/e2e-worker-w0-781058-openshift-default-55fb495b7-4rkzd"
Oct 30 20:59:17.814482 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:59:17.814318    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9b820c81-5ae6-459a-9510-72c234e98679-credential-socket\") pod \"e2e-worker-w0-781058-openshift-default-55fb495b7-4rkzd\" (UID: \"9b820c81-5ae6-459a-9510-72c234e98679\") " pod="openshift-ingress/e2e-worker-w0-781058-openshift-default-55fb495b7-4rkzd"
Oct 30 20:59:17.814482 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:59:17.814345    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9b820c81-5ae6-459a-9510-72c234e98679-workload-socket\") pod \"e2e-worker-w0-781058-openshift-default-55fb495b7-4rkzd\" (UID: \"9b820c81-5ae6-459a-9510-72c234e98679\") " pod="openshift-ingress/e2e-worker-w0-781058-openshift-default-55fb495b7-4rkzd"
Oct 30 20:59:17.814482 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:59:17.814372    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9b820c81-5ae6-459a-9510-72c234e98679-istio-data\") pod \"e2e-worker-w0-781058-openshift-default-55fb495b7-4rkzd\" (UID: \"9b820c81-5ae6-459a-9510-72c234e98679\") " pod="openshift-ingress/e2e-worker-w0-781058-openshift-default-55fb495b7-4rkzd"
Oct 30 20:59:17.814482 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:59:17.814430    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c9a46681-c4b7-48f6-b95a-60f12f98c54d-istio-data\") pod \"e2e-worker-w0-781058-openshift-default-55fb495b7-xgtg7\" (UID: \"c9a46681-c4b7-48f6-b95a-60f12f98c54d\") " pod="openshift-ingress/e2e-worker-w0-781058-openshift-default-55fb495b7-xgtg7"
Oct 30 20:59:17.814482 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:59:17.814466    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c9a46681-c4b7-48f6-b95a-60f12f98c54d-workload-certs\") pod \"e2e-worker-w0-781058-openshift-default-55fb495b7-xgtg7\" (UID: \"c9a46681-c4b7-48f6-b95a-60f12f98c54d\") " pod="openshift-ingress/e2e-worker-w0-781058-openshift-default-55fb495b7-xgtg7"
Oct 30 20:59:17.814746 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:59:17.814508    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9b820c81-5ae6-459a-9510-72c234e98679-workload-certs\") pod \"e2e-worker-w0-781058-openshift-default-55fb495b7-4rkzd\" (UID: \"9b820c81-5ae6-459a-9510-72c234e98679\") " pod="openshift-ingress/e2e-worker-w0-781058-openshift-default-55fb495b7-4rkzd"
Oct 30 20:59:17.814746 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:59:17.814540    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c9a46681-c4b7-48f6-b95a-60f12f98c54d-istio-token\") pod \"e2e-worker-w0-781058-openshift-default-55fb495b7-xgtg7\" (UID: \"c9a46681-c4b7-48f6-b95a-60f12f98c54d\") " pod="openshift-ingress/e2e-worker-w0-781058-openshift-default-55fb495b7-xgtg7"
Oct 30 20:59:17.814746 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:59:17.814562    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c9a46681-c4b7-48f6-b95a-60f12f98c54d-istiod-ca-cert\") pod \"e2e-worker-w0-781058-openshift-default-55fb495b7-xgtg7\" (UID: \"c9a46681-c4b7-48f6-b95a-60f12f98c54d\") " pod="openshift-ingress/e2e-worker-w0-781058-openshift-default-55fb495b7-xgtg7"
Oct 30 20:59:17.814746 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:59:17.814600    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9b820c81-5ae6-459a-9510-72c234e98679-istio-podinfo\") pod \"e2e-worker-w0-781058-openshift-default-55fb495b7-4rkzd\" (UID: \"9b820c81-5ae6-459a-9510-72c234e98679\") " pod="openshift-ingress/e2e-worker-w0-781058-openshift-default-55fb495b7-4rkzd"
Oct 30 20:59:17.814746 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:59:17.814638    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9b820c81-5ae6-459a-9510-72c234e98679-istio-envoy\") pod \"e2e-worker-w0-781058-openshift-default-55fb495b7-4rkzd\" (UID: \"9b820c81-5ae6-459a-9510-72c234e98679\") " pod="openshift-ingress/e2e-worker-w0-781058-openshift-default-55fb495b7-4rkzd"
Oct 30 20:59:17.814746 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:59:17.814677    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c9a46681-c4b7-48f6-b95a-60f12f98c54d-istio-podinfo\") pod \"e2e-worker-w0-781058-openshift-default-55fb495b7-xgtg7\" (UID: \"c9a46681-c4b7-48f6-b95a-60f12f98c54d\") " pod="openshift-ingress/e2e-worker-w0-781058-openshift-default-55fb495b7-xgtg7"
Oct 30 20:59:17.814746 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:59:17.814709    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9b820c81-5ae6-459a-9510-72c234e98679-istio-token\") pod \"e2e-worker-w0-781058-openshift-default-55fb495b7-4rkzd\" (UID: \"9b820c81-5ae6-459a-9510-72c234e98679\") " pod="openshift-ingress/e2e-worker-w0-781058-openshift-default-55fb495b7-4rkzd"
Oct 30 20:59:17.814983 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:59:17.814785    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c9a46681-c4b7-48f6-b95a-60f12f98c54d-credential-socket\") pod \"e2e-worker-w0-781058-openshift-default-55fb495b7-xgtg7\" (UID: \"c9a46681-c4b7-48f6-b95a-60f12f98c54d\") " pod="openshift-ingress/e2e-worker-w0-781058-openshift-default-55fb495b7-xgtg7"
Oct 30 20:59:17.821104 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:59:17.821076    6004 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w0-781058-openshift-default-55fb495b7-4rkzd"]
Oct 30 20:59:17.825062 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:59:17.825026    6004 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w0-781058-openshift-default-55fb495b7-xgtg7"]
Oct 30 20:59:17.916175 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:59:17.916141    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c9a46681-c4b7-48f6-b95a-60f12f98c54d-istio-data\") pod \"e2e-worker-w0-781058-openshift-default-55fb495b7-xgtg7\" (UID: \"c9a46681-c4b7-48f6-b95a-60f12f98c54d\") " pod="openshift-ingress/e2e-worker-w0-781058-openshift-default-55fb495b7-xgtg7"
Oct 30 20:59:17.916348 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:59:17.916184    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c9a46681-c4b7-48f6-b95a-60f12f98c54d-workload-certs\") pod \"e2e-worker-w0-781058-openshift-default-55fb495b7-xgtg7\" (UID: \"c9a46681-c4b7-48f6-b95a-60f12f98c54d\") " pod="openshift-ingress/e2e-worker-w0-781058-openshift-default-55fb495b7-xgtg7"
Oct 30 20:59:17.916348 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:59:17.916223    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9b820c81-5ae6-459a-9510-72c234e98679-workload-certs\") pod \"e2e-worker-w0-781058-openshift-default-55fb495b7-4rkzd\" (UID: \"9b820c81-5ae6-459a-9510-72c234e98679\") " pod="openshift-ingress/e2e-worker-w0-781058-openshift-default-55fb495b7-4rkzd"
Oct 30 20:59:17.916348 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:59:17.916254    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c9a46681-c4b7-48f6-b95a-60f12f98c54d-istio-token\") pod \"e2e-worker-w0-781058-openshift-default-55fb495b7-xgtg7\" (UID: \"c9a46681-c4b7-48f6-b95a-60f12f98c54d\") " pod="openshift-ingress/e2e-worker-w0-781058-openshift-default-55fb495b7-xgtg7"
Oct 30 20:59:17.916348 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:59:17.916278    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c9a46681-c4b7-48f6-b95a-60f12f98c54d-istiod-ca-cert\") pod \"e2e-worker-w0-781058-openshift-default-55fb495b7-xgtg7\" (UID: \"c9a46681-c4b7-48f6-b95a-60f12f98c54d\") " pod="openshift-ingress/e2e-worker-w0-781058-openshift-default-55fb495b7-xgtg7"
Oct 30 20:59:17.916348 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:59:17.916311    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9b820c81-5ae6-459a-9510-72c234e98679-istio-podinfo\") pod \"e2e-worker-w0-781058-openshift-default-55fb495b7-4rkzd\" (UID: \"9b820c81-5ae6-459a-9510-72c234e98679\") " pod="openshift-ingress/e2e-worker-w0-781058-openshift-default-55fb495b7-4rkzd"
Oct 30 20:59:17.916618 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:59:17.916450    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9b820c81-5ae6-459a-9510-72c234e98679-istio-envoy\") pod \"e2e-worker-w0-781058-openshift-default-55fb495b7-4rkzd\" (UID: \"9b820c81-5ae6-459a-9510-72c234e98679\") " pod="openshift-ingress/e2e-worker-w0-781058-openshift-default-55fb495b7-4rkzd"
Oct 30 20:59:17.916618 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:59:17.916512    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c9a46681-c4b7-48f6-b95a-60f12f98c54d-istio-podinfo\") pod \"e2e-worker-w0-781058-openshift-default-55fb495b7-xgtg7\" (UID: \"c9a46681-c4b7-48f6-b95a-60f12f98c54d\") " pod="openshift-ingress/e2e-worker-w0-781058-openshift-default-55fb495b7-xgtg7"
Oct 30 20:59:17.916618 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:59:17.916550    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9b820c81-5ae6-459a-9510-72c234e98679-istio-token\") pod \"e2e-worker-w0-781058-openshift-default-55fb495b7-4rkzd\" (UID: \"9b820c81-5ae6-459a-9510-72c234e98679\") " pod="openshift-ingress/e2e-worker-w0-781058-openshift-default-55fb495b7-4rkzd"
Oct 30 20:59:17.916618 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:59:17.916610    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c9a46681-c4b7-48f6-b95a-60f12f98c54d-istio-data\") pod \"e2e-worker-w0-781058-openshift-default-55fb495b7-xgtg7\" (UID: \"c9a46681-c4b7-48f6-b95a-60f12f98c54d\") " pod="openshift-ingress/e2e-worker-w0-781058-openshift-default-55fb495b7-xgtg7"
Oct 30 20:59:17.916816 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:59:17.916620    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c9a46681-c4b7-48f6-b95a-60f12f98c54d-credential-socket\") pod \"e2e-worker-w0-781058-openshift-default-55fb495b7-xgtg7\" (UID: \"c9a46681-c4b7-48f6-b95a-60f12f98c54d\") " pod="openshift-ingress/e2e-worker-w0-781058-openshift-default-55fb495b7-xgtg7"
Oct 30 20:59:17.916816 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:59:17.916671    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9b820c81-5ae6-459a-9510-72c234e98679-workload-certs\") pod \"e2e-worker-w0-781058-openshift-default-55fb495b7-4rkzd\" (UID: \"9b820c81-5ae6-459a-9510-72c234e98679\") " pod="openshift-ingress/e2e-worker-w0-781058-openshift-default-55fb495b7-4rkzd"
Oct 30 20:59:17.916816 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:59:17.916671    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c9a46681-c4b7-48f6-b95a-60f12f98c54d-workload-certs\") pod \"e2e-worker-w0-781058-openshift-default-55fb495b7-xgtg7\" (UID: \"c9a46681-c4b7-48f6-b95a-60f12f98c54d\") " pod="openshift-ingress/e2e-worker-w0-781058-openshift-default-55fb495b7-xgtg7"
Oct 30 20:59:17.916816 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:59:17.916712    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pr4j8\" (UniqueName: \"kubernetes.io/projected/c9a46681-c4b7-48f6-b95a-60f12f98c54d-kube-api-access-pr4j8\") pod \"e2e-worker-w0-781058-openshift-default-55fb495b7-xgtg7\" (UID: \"c9a46681-c4b7-48f6-b95a-60f12f98c54d\") " pod="openshift-ingress/e2e-worker-w0-781058-openshift-default-55fb495b7-xgtg7"
Oct 30 20:59:17.916816 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:59:17.916757    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xs7sx\" (UniqueName: \"kubernetes.io/projected/9b820c81-5ae6-459a-9510-72c234e98679-kube-api-access-xs7sx\") pod \"e2e-worker-w0-781058-openshift-default-55fb495b7-4rkzd\" (UID: \"9b820c81-5ae6-459a-9510-72c234e98679\") " pod="openshift-ingress/e2e-worker-w0-781058-openshift-default-55fb495b7-4rkzd"
Oct 30 20:59:17.916816 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:59:17.916787    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c9a46681-c4b7-48f6-b95a-60f12f98c54d-istio-envoy\") pod \"e2e-worker-w0-781058-openshift-default-55fb495b7-xgtg7\" (UID: \"c9a46681-c4b7-48f6-b95a-60f12f98c54d\") " pod="openshift-ingress/e2e-worker-w0-781058-openshift-default-55fb495b7-xgtg7"
Oct 30 20:59:17.917181 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:59:17.916815    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c9a46681-c4b7-48f6-b95a-60f12f98c54d-workload-socket\") pod \"e2e-worker-w0-781058-openshift-default-55fb495b7-xgtg7\" (UID: \"c9a46681-c4b7-48f6-b95a-60f12f98c54d\") " pod="openshift-ingress/e2e-worker-w0-781058-openshift-default-55fb495b7-xgtg7"
Oct 30 20:59:17.917181 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:59:17.916857    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9b820c81-5ae6-459a-9510-72c234e98679-istiod-ca-cert\") pod \"e2e-worker-w0-781058-openshift-default-55fb495b7-4rkzd\" (UID: \"9b820c81-5ae6-459a-9510-72c234e98679\") " pod="openshift-ingress/e2e-worker-w0-781058-openshift-default-55fb495b7-4rkzd"
Oct 30 20:59:17.917181 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:59:17.916886    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c9a46681-c4b7-48f6-b95a-60f12f98c54d-credential-socket\") pod \"e2e-worker-w0-781058-openshift-default-55fb495b7-xgtg7\" (UID: \"c9a46681-c4b7-48f6-b95a-60f12f98c54d\") " pod="openshift-ingress/e2e-worker-w0-781058-openshift-default-55fb495b7-xgtg7"
Oct 30 20:59:17.917181 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:59:17.916941    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9b820c81-5ae6-459a-9510-72c234e98679-credential-socket\") pod \"e2e-worker-w0-781058-openshift-default-55fb495b7-4rkzd\" (UID: \"9b820c81-5ae6-459a-9510-72c234e98679\") " pod="openshift-ingress/e2e-worker-w0-781058-openshift-default-55fb495b7-4rkzd"
Oct 30 20:59:17.917181 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:59:17.916973    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9b820c81-5ae6-459a-9510-72c234e98679-workload-socket\") pod \"e2e-worker-w0-781058-openshift-default-55fb495b7-4rkzd\" (UID: \"9b820c81-5ae6-459a-9510-72c234e98679\") " pod="openshift-ingress/e2e-worker-w0-781058-openshift-default-55fb495b7-4rkzd"
Oct 30 20:59:17.917181 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:59:17.916997    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9b820c81-5ae6-459a-9510-72c234e98679-istio-data\") pod \"e2e-worker-w0-781058-openshift-default-55fb495b7-4rkzd\" (UID: \"9b820c81-5ae6-459a-9510-72c234e98679\") " pod="openshift-ingress/e2e-worker-w0-781058-openshift-default-55fb495b7-4rkzd"
Oct 30 20:59:17.917181 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:59:17.917092    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c9a46681-c4b7-48f6-b95a-60f12f98c54d-istiod-ca-cert\") pod \"e2e-worker-w0-781058-openshift-default-55fb495b7-xgtg7\" (UID: \"c9a46681-c4b7-48f6-b95a-60f12f98c54d\") " pod="openshift-ingress/e2e-worker-w0-781058-openshift-default-55fb495b7-xgtg7"
Oct 30 20:59:17.917542 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:59:17.917206    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c9a46681-c4b7-48f6-b95a-60f12f98c54d-workload-socket\") pod \"e2e-worker-w0-781058-openshift-default-55fb495b7-xgtg7\" (UID: \"c9a46681-c4b7-48f6-b95a-60f12f98c54d\") " pod="openshift-ingress/e2e-worker-w0-781058-openshift-default-55fb495b7-xgtg7"
Oct 30 20:59:17.917542 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:59:17.917392    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9b820c81-5ae6-459a-9510-72c234e98679-workload-socket\") pod \"e2e-worker-w0-781058-openshift-default-55fb495b7-4rkzd\" (UID: \"9b820c81-5ae6-459a-9510-72c234e98679\") " pod="openshift-ingress/e2e-worker-w0-781058-openshift-default-55fb495b7-4rkzd"
Oct 30 20:59:17.917542 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:59:17.917467    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9b820c81-5ae6-459a-9510-72c234e98679-istio-data\") pod \"e2e-worker-w0-781058-openshift-default-55fb495b7-4rkzd\" (UID: \"9b820c81-5ae6-459a-9510-72c234e98679\") " pod="openshift-ingress/e2e-worker-w0-781058-openshift-default-55fb495b7-4rkzd"
Oct 30 20:59:17.917711 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:59:17.917575    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9b820c81-5ae6-459a-9510-72c234e98679-credential-socket\") pod \"e2e-worker-w0-781058-openshift-default-55fb495b7-4rkzd\" (UID: \"9b820c81-5ae6-459a-9510-72c234e98679\") " pod="openshift-ingress/e2e-worker-w0-781058-openshift-default-55fb495b7-4rkzd"
Oct 30 20:59:17.917770 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:59:17.917708    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9b820c81-5ae6-459a-9510-72c234e98679-istiod-ca-cert\") pod \"e2e-worker-w0-781058-openshift-default-55fb495b7-4rkzd\" (UID: \"9b820c81-5ae6-459a-9510-72c234e98679\") " pod="openshift-ingress/e2e-worker-w0-781058-openshift-default-55fb495b7-4rkzd"
Oct 30 20:59:17.919011 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:59:17.918982    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9b820c81-5ae6-459a-9510-72c234e98679-istio-envoy\") pod \"e2e-worker-w0-781058-openshift-default-55fb495b7-4rkzd\" (UID: \"9b820c81-5ae6-459a-9510-72c234e98679\") " pod="openshift-ingress/e2e-worker-w0-781058-openshift-default-55fb495b7-4rkzd"
Oct 30 20:59:17.919173 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:59:17.919149    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c9a46681-c4b7-48f6-b95a-60f12f98c54d-istio-envoy\") pod \"e2e-worker-w0-781058-openshift-default-55fb495b7-xgtg7\" (UID: \"c9a46681-c4b7-48f6-b95a-60f12f98c54d\") " pod="openshift-ingress/e2e-worker-w0-781058-openshift-default-55fb495b7-xgtg7"
Oct 30 20:59:17.919230 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:59:17.919208    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c9a46681-c4b7-48f6-b95a-60f12f98c54d-istio-podinfo\") pod \"e2e-worker-w0-781058-openshift-default-55fb495b7-xgtg7\" (UID: \"c9a46681-c4b7-48f6-b95a-60f12f98c54d\") " pod="openshift-ingress/e2e-worker-w0-781058-openshift-default-55fb495b7-xgtg7"
Oct 30 20:59:17.919522 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:59:17.919499    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9b820c81-5ae6-459a-9510-72c234e98679-istio-podinfo\") pod \"e2e-worker-w0-781058-openshift-default-55fb495b7-4rkzd\" (UID: \"9b820c81-5ae6-459a-9510-72c234e98679\") " pod="openshift-ingress/e2e-worker-w0-781058-openshift-default-55fb495b7-4rkzd"
Oct 30 20:59:17.974701 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:59:17.974615    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pr4j8\" (UniqueName: \"kubernetes.io/projected/c9a46681-c4b7-48f6-b95a-60f12f98c54d-kube-api-access-pr4j8\") pod \"e2e-worker-w0-781058-openshift-default-55fb495b7-xgtg7\" (UID: \"c9a46681-c4b7-48f6-b95a-60f12f98c54d\") " pod="openshift-ingress/e2e-worker-w0-781058-openshift-default-55fb495b7-xgtg7"
Oct 30 20:59:17.974963 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:59:17.974942    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9b820c81-5ae6-459a-9510-72c234e98679-istio-token\") pod \"e2e-worker-w0-781058-openshift-default-55fb495b7-4rkzd\" (UID: \"9b820c81-5ae6-459a-9510-72c234e98679\") " pod="openshift-ingress/e2e-worker-w0-781058-openshift-default-55fb495b7-4rkzd"
Oct 30 20:59:17.975098 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:59:17.974944    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xs7sx\" (UniqueName: \"kubernetes.io/projected/9b820c81-5ae6-459a-9510-72c234e98679-kube-api-access-xs7sx\") pod \"e2e-worker-w0-781058-openshift-default-55fb495b7-4rkzd\" (UID: \"9b820c81-5ae6-459a-9510-72c234e98679\") " pod="openshift-ingress/e2e-worker-w0-781058-openshift-default-55fb495b7-4rkzd"
Oct 30 20:59:17.975360 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:59:17.975337    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c9a46681-c4b7-48f6-b95a-60f12f98c54d-istio-token\") pod \"e2e-worker-w0-781058-openshift-default-55fb495b7-xgtg7\" (UID: \"c9a46681-c4b7-48f6-b95a-60f12f98c54d\") " pod="openshift-ingress/e2e-worker-w0-781058-openshift-default-55fb495b7-xgtg7"
Oct 30 20:59:18.037547 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:59:18.037517    6004 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-781058-openshift-default-55fb495b7-4rkzd"
Oct 30 20:59:18.087551 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:59:18.087493    6004 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-781058-openshift-default-55fb495b7-xgtg7"
Oct 30 20:59:18.474115 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:59:18.474074    6004 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w0-781058-openshift-default-55fb495b7-4rkzd"]
Oct 30 20:59:18.507158 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:59:18.507130    6004 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9b820c81_5ae6_459a_9510_72c234e98679.slice/crio-87dacdf2af41696797001eb1740c8f56119368e19e7f6fdba64490feff32b4e7 WatchSource:0}: Error finding container 87dacdf2af41696797001eb1740c8f56119368e19e7f6fdba64490feff32b4e7: Status 404 returned error can't find the container with id 87dacdf2af41696797001eb1740c8f56119368e19e7f6fdba64490feff32b4e7
Oct 30 20:59:18.510067 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:59:18.510013    6004 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 20:59:18.510182 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:59:18.510123    6004 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 20:59:18.510182 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:59:18.510168    6004 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 20:59:18.521160 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:59:18.521135    6004 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w0-781058-openshift-default-55fb495b7-xgtg7"]
Oct 30 20:59:18.527761 ip-10-0-138-85 kubenswrapper[6004]: W1030 20:59:18.527733    6004 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc9a46681_c4b7_48f6_b95a_60f12f98c54d.slice/crio-4013deded1e29abc34f7b6416e2292fb74dc5dbfbb201f2feba2c1999634087e WatchSource:0}: Error finding container 4013deded1e29abc34f7b6416e2292fb74dc5dbfbb201f2feba2c1999634087e: Status 404 returned error can't find the container with id 4013deded1e29abc34f7b6416e2292fb74dc5dbfbb201f2feba2c1999634087e
Oct 30 20:59:18.530015 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:59:18.529979    6004 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 20:59:18.530155 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:59:18.530077    6004 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 20:59:18.530155 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:59:18.530115    6004 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 20:59:18.578698 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:59:18.578425    6004 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-781058-openshift-default-55fb495b7-xgtg7" event={"ID":"c9a46681-c4b7-48f6-b95a-60f12f98c54d","Type":"ContainerStarted","Data":"4013deded1e29abc34f7b6416e2292fb74dc5dbfbb201f2feba2c1999634087e"}
Oct 30 20:59:18.580442 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:59:18.580407    6004 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-781058-openshift-default-55fb495b7-4rkzd" event={"ID":"9b820c81-5ae6-459a-9510-72c234e98679","Type":"ContainerStarted","Data":"87dacdf2af41696797001eb1740c8f56119368e19e7f6fdba64490feff32b4e7"}
Oct 30 20:59:19.598188 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:59:19.598147    6004 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-781058-openshift-default-55fb495b7-xgtg7" event={"ID":"c9a46681-c4b7-48f6-b95a-60f12f98c54d","Type":"ContainerStarted","Data":"feb1f01de4c266fe1cfc3a730367316c4438c84478e5fc00d14a617d26cf1bd8"}
Oct 30 20:59:19.604089 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:59:19.603914    6004 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-781058-openshift-default-55fb495b7-4rkzd" event={"ID":"9b820c81-5ae6-459a-9510-72c234e98679","Type":"ContainerStarted","Data":"a19adf1687ca4090f6961a126e29f88f77d847c9cb4d358885128692cafd4c22"}
Oct 30 20:59:19.910462 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:59:19.910293    6004 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w0-781058-openshift-default-55fb495b7-xgtg7" podStartSLOduration=2.910272762 podStartE2EDuration="2.910272762s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:59:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:59:19.788436267 +0000 UTC m=+1265.708222389" watchObservedRunningTime="2026-10-30 20:59:19.910272762 +0000 UTC m=+1265.830058879"
Oct 30 20:59:19.910623 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:59:19.910561    6004 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w0-781058-openshift-default-55fb495b7-4rkzd" podStartSLOduration=2.910552372 podStartE2EDuration="2.910552372s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:59:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:59:19.909871319 +0000 UTC m=+1265.829657434" watchObservedRunningTime="2026-10-30 20:59:19.910552372 +0000 UTC m=+1265.830338504"
Oct 30 20:59:20.053079 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:59:20.041701    6004 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w0-781058-openshift-default-55fb495b7-4rkzd"
Oct 30 20:59:20.053079 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:59:20.041895    6004 patch_prober.go:29] interesting pod/e2e-worker-w0-781058-openshift-default-55fb495b7-4rkzd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.75:15021/healthz/ready\": dial tcp 10.132.0.75:15021: connect: connection refused" start-of-body=
Oct 30 20:59:20.053079 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:59:20.041955    6004 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-781058-openshift-default-55fb495b7-4rkzd" podUID="9b820c81-5ae6-459a-9510-72c234e98679" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.75:15021/healthz/ready\": dial tcp 10.132.0.75:15021: connect: connection refused"
Oct 30 20:59:20.095098 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:59:20.094975    6004 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w0-781058-openshift-default-55fb495b7-xgtg7"
Oct 30 20:59:20.095315 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:59:20.095142    6004 patch_prober.go:29] interesting pod/e2e-worker-w0-781058-openshift-default-55fb495b7-xgtg7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.76:15021/healthz/ready\": dial tcp 10.132.0.76:15021: connect: connection refused" start-of-body=
Oct 30 20:59:20.095315 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:59:20.095206    6004 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-781058-openshift-default-55fb495b7-xgtg7" podUID="c9a46681-c4b7-48f6-b95a-60f12f98c54d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.76:15021/healthz/ready\": dial tcp 10.132.0.76:15021: connect: connection refused"
Oct 30 20:59:21.054076 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:59:21.038431    6004 patch_prober.go:29] interesting pod/e2e-worker-w0-781058-openshift-default-55fb495b7-4rkzd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.75:15021/healthz/ready\": dial tcp 10.132.0.75:15021: connect: connection refused" start-of-body=
Oct 30 20:59:21.054076 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:59:21.038508    6004 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-781058-openshift-default-55fb495b7-4rkzd" podUID="9b820c81-5ae6-459a-9510-72c234e98679" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.75:15021/healthz/ready\": dial tcp 10.132.0.75:15021: connect: connection refused"
Oct 30 20:59:21.098073 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:59:21.090070    6004 patch_prober.go:29] interesting pod/e2e-worker-w0-781058-openshift-default-55fb495b7-xgtg7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.76:15021/healthz/ready\": dial tcp 10.132.0.76:15021: connect: connection refused" start-of-body=
Oct 30 20:59:21.098073 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:59:21.090164    6004 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-781058-openshift-default-55fb495b7-xgtg7" podUID="c9a46681-c4b7-48f6-b95a-60f12f98c54d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.76:15021/healthz/ready\": dial tcp 10.132.0.76:15021: connect: connection refused"
Oct 30 20:59:22.039073 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:59:22.038448    6004 patch_prober.go:29] interesting pod/e2e-worker-w0-781058-openshift-default-55fb495b7-4rkzd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.75:15021/healthz/ready\": dial tcp 10.132.0.75:15021: connect: connection refused" start-of-body=
Oct 30 20:59:22.039073 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:59:22.038522    6004 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-781058-openshift-default-55fb495b7-4rkzd" podUID="9b820c81-5ae6-459a-9510-72c234e98679" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.75:15021/healthz/ready\": dial tcp 10.132.0.75:15021: connect: connection refused"
Oct 30 20:59:22.092074 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:59:22.091478    6004 patch_prober.go:29] interesting pod/e2e-worker-w0-781058-openshift-default-55fb495b7-xgtg7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.76:15021/healthz/ready\": dial tcp 10.132.0.76:15021: connect: connection refused" start-of-body=
Oct 30 20:59:22.092074 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:59:22.091539    6004 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-781058-openshift-default-55fb495b7-xgtg7" podUID="c9a46681-c4b7-48f6-b95a-60f12f98c54d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.76:15021/healthz/ready\": dial tcp 10.132.0.76:15021: connect: connection refused"
Oct 30 20:59:23.056074 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:59:23.040414    6004 patch_prober.go:29] interesting pod/e2e-worker-w0-781058-openshift-default-55fb495b7-4rkzd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.75:15021/healthz/ready\": dial tcp 10.132.0.75:15021: connect: connection refused" start-of-body=
Oct 30 20:59:23.056074 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:59:23.040477    6004 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-781058-openshift-default-55fb495b7-4rkzd" podUID="9b820c81-5ae6-459a-9510-72c234e98679" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.75:15021/healthz/ready\": dial tcp 10.132.0.75:15021: connect: connection refused"
Oct 30 20:59:23.089074 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:59:23.088435    6004 patch_prober.go:29] interesting pod/e2e-worker-w0-781058-openshift-default-55fb495b7-xgtg7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.76:15021/healthz/ready\": dial tcp 10.132.0.76:15021: connect: connection refused" start-of-body=
Oct 30 20:59:23.089074 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:59:23.088495    6004 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-781058-openshift-default-55fb495b7-xgtg7" podUID="c9a46681-c4b7-48f6-b95a-60f12f98c54d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.76:15021/healthz/ready\": dial tcp 10.132.0.76:15021: connect: connection refused"
Oct 30 20:59:24.057074 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:59:24.052480    6004 patch_prober.go:29] interesting pod/e2e-worker-w0-781058-openshift-default-55fb495b7-4rkzd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.75:15021/healthz/ready\": dial tcp 10.132.0.75:15021: connect: connection refused" start-of-body=
Oct 30 20:59:24.057074 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:59:24.052544    6004 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-781058-openshift-default-55fb495b7-4rkzd" podUID="9b820c81-5ae6-459a-9510-72c234e98679" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.75:15021/healthz/ready\": dial tcp 10.132.0.75:15021: connect: connection refused"
Oct 30 20:59:24.096911 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:59:24.096639    6004 patch_prober.go:29] interesting pod/e2e-worker-w0-781058-openshift-default-55fb495b7-xgtg7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.76:15021/healthz/ready\": dial tcp 10.132.0.76:15021: connect: connection refused" start-of-body=
Oct 30 20:59:24.096911 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:59:24.096719    6004 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-781058-openshift-default-55fb495b7-xgtg7" podUID="c9a46681-c4b7-48f6-b95a-60f12f98c54d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.76:15021/healthz/ready\": dial tcp 10.132.0.76:15021: connect: connection refused"
Oct 30 20:59:25.039698 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:59:25.039599    6004 patch_prober.go:29] interesting pod/e2e-worker-w0-781058-openshift-default-55fb495b7-4rkzd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.75:15021/healthz/ready\": dial tcp 10.132.0.75:15021: connect: connection refused" start-of-body=
Oct 30 20:59:25.039698 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:59:25.039664    6004 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-781058-openshift-default-55fb495b7-4rkzd" podUID="9b820c81-5ae6-459a-9510-72c234e98679" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.75:15021/healthz/ready\": dial tcp 10.132.0.75:15021: connect: connection refused"
Oct 30 20:59:25.088006 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:59:25.087959    6004 patch_prober.go:29] interesting pod/e2e-worker-w0-781058-openshift-default-55fb495b7-xgtg7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.76:15021/healthz/ready\": dial tcp 10.132.0.76:15021: connect: connection refused" start-of-body=
Oct 30 20:59:25.088418 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:59:25.088036    6004 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-781058-openshift-default-55fb495b7-xgtg7" podUID="c9a46681-c4b7-48f6-b95a-60f12f98c54d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.76:15021/healthz/ready\": dial tcp 10.132.0.76:15021: connect: connection refused"
Oct 30 20:59:26.351910 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:59:26.351870    6004 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w0-781058-openshift-default-55fb495b7-xgtg7"
Oct 30 20:59:26.352579 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:59:26.352555    6004 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w0-781058-openshift-default-55fb495b7-xgtg7"
Oct 30 20:59:26.353375 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:59:26.353357    6004 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w0-781058-openshift-default-55fb495b7-xgtg7"
Oct 30 20:59:26.373128 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:59:26.373102    6004 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w0-781058-openshift-default-55fb495b7-4rkzd"
Oct 30 20:59:26.374328 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:59:26.374308    6004 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w0-781058-openshift-default-55fb495b7-4rkzd"
Oct 30 20:59:26.375142 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:59:26.375124    6004 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w0-781058-openshift-default-55fb495b7-4rkzd"
Oct 30 20:59:31.372190 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:59:31.372139    6004 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-2b425d/distinct-w5-2b425d-kserve-dd4dcf7f-b227k" podUID="802e5037-d6f5-4a37-a95f-b49dda7f8b1b" containerName="main" probeResult="failure" output="Get \"https://10.132.0.67:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:59:31.511081 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:59:31.511007    6004 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-1fdaa7/distinct-2-w4-1fdaa7-kserve-59f4d6788b-b6gl4" podUID="f6d2856c-84b5-426d-bfcd-ef613ab44242" containerName="main" probeResult="failure" output="Get \"https://10.132.0.73:8000/ready\": context deadline exceeded"
Oct 30 20:59:31.513880 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:59:31.513848    6004 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-f9f277/distinct-w1-f9f277-kserve-f947bc879-lzs6w" podUID="f4ab8826-a6f1-41e6-897f-b808635017c5" containerName="main" probeResult="failure" output="Get \"https://10.132.0.68:8000/ready\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:59:32.041074 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:59:32.040031    6004 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-d061d0/distinct-2-w2-d061d0-kserve-5c6bb99fbf-b4kqs" podUID="32264f6c-999b-4bad-bd2e-7664cadc0669" containerName="main" probeResult="failure" output="Get \"https://10.132.0.71:8000/ready\": context deadline exceeded"
Oct 30 20:59:32.534245 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:59:32.515162    6004 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-1fdaa7/distinct-2-w4-1fdaa7-kserve-59f4d6788b-b6gl4" podUID="f6d2856c-84b5-426d-bfcd-ef613ab44242" containerName="main" probeResult="failure" output="Get \"https://10.132.0.73:8000/ready\": context deadline exceeded"
Oct 30 20:59:32.534245 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:59:32.516004    6004 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w4-1fdaa7/distinct-2-w4-1fdaa7-kserve-59f4d6788b-b6gl4"
Oct 30 20:59:32.724415 ip-10-0-138-85 kubenswrapper[6004]: I1030 20:59:32.724317    6004 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w4-1fdaa7/distinct-2-w4-1fdaa7-kserve-59f4d6788b-b6gl4"
Oct 30 20:59:44.286603 ip-10-0-138-85 kubenswrapper[6004]: E1030 20:59:44.286566    6004 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-zz4wr" containerName="extractor"
Oct 30 21:00:01.073187 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:01.073147    6004 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w1-f9f277-openshift-default-869d58fb77-dllj5"]
Oct 30 21:00:01.078678 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:01.078650    6004 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-f9f277-openshift-default-869d58fb77-dllj5"
Oct 30 21:00:01.173798 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:01.173754    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c1a9de29-3987-4405-b4e0-c9c2586c4f96-istio-envoy\") pod \"e2e-worker-w1-f9f277-openshift-default-869d58fb77-dllj5\" (UID: \"c1a9de29-3987-4405-b4e0-c9c2586c4f96\") " pod="openshift-ingress/e2e-worker-w1-f9f277-openshift-default-869d58fb77-dllj5"
Oct 30 21:00:01.174016 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:01.173826    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f5zl9\" (UniqueName: \"kubernetes.io/projected/c1a9de29-3987-4405-b4e0-c9c2586c4f96-kube-api-access-f5zl9\") pod \"e2e-worker-w1-f9f277-openshift-default-869d58fb77-dllj5\" (UID: \"c1a9de29-3987-4405-b4e0-c9c2586c4f96\") " pod="openshift-ingress/e2e-worker-w1-f9f277-openshift-default-869d58fb77-dllj5"
Oct 30 21:00:01.174016 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:01.173957    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c1a9de29-3987-4405-b4e0-c9c2586c4f96-workload-socket\") pod \"e2e-worker-w1-f9f277-openshift-default-869d58fb77-dllj5\" (UID: \"c1a9de29-3987-4405-b4e0-c9c2586c4f96\") " pod="openshift-ingress/e2e-worker-w1-f9f277-openshift-default-869d58fb77-dllj5"
Oct 30 21:00:01.174016 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:01.174002    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c1a9de29-3987-4405-b4e0-c9c2586c4f96-istiod-ca-cert\") pod \"e2e-worker-w1-f9f277-openshift-default-869d58fb77-dllj5\" (UID: \"c1a9de29-3987-4405-b4e0-c9c2586c4f96\") " pod="openshift-ingress/e2e-worker-w1-f9f277-openshift-default-869d58fb77-dllj5"
Oct 30 21:00:01.174224 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:01.174040    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c1a9de29-3987-4405-b4e0-c9c2586c4f96-istio-token\") pod \"e2e-worker-w1-f9f277-openshift-default-869d58fb77-dllj5\" (UID: \"c1a9de29-3987-4405-b4e0-c9c2586c4f96\") " pod="openshift-ingress/e2e-worker-w1-f9f277-openshift-default-869d58fb77-dllj5"
Oct 30 21:00:01.174286 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:01.174225    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c1a9de29-3987-4405-b4e0-c9c2586c4f96-workload-certs\") pod \"e2e-worker-w1-f9f277-openshift-default-869d58fb77-dllj5\" (UID: \"c1a9de29-3987-4405-b4e0-c9c2586c4f96\") " pod="openshift-ingress/e2e-worker-w1-f9f277-openshift-default-869d58fb77-dllj5"
Oct 30 21:00:01.174286 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:01.174254    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c1a9de29-3987-4405-b4e0-c9c2586c4f96-istio-data\") pod \"e2e-worker-w1-f9f277-openshift-default-869d58fb77-dllj5\" (UID: \"c1a9de29-3987-4405-b4e0-c9c2586c4f96\") " pod="openshift-ingress/e2e-worker-w1-f9f277-openshift-default-869d58fb77-dllj5"
Oct 30 21:00:01.174389 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:01.174320    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c1a9de29-3987-4405-b4e0-c9c2586c4f96-istio-podinfo\") pod \"e2e-worker-w1-f9f277-openshift-default-869d58fb77-dllj5\" (UID: \"c1a9de29-3987-4405-b4e0-c9c2586c4f96\") " pod="openshift-ingress/e2e-worker-w1-f9f277-openshift-default-869d58fb77-dllj5"
Oct 30 21:00:01.174389 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:01.174366    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c1a9de29-3987-4405-b4e0-c9c2586c4f96-credential-socket\") pod \"e2e-worker-w1-f9f277-openshift-default-869d58fb77-dllj5\" (UID: \"c1a9de29-3987-4405-b4e0-c9c2586c4f96\") " pod="openshift-ingress/e2e-worker-w1-f9f277-openshift-default-869d58fb77-dllj5"
Oct 30 21:00:01.185353 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:01.185324    6004 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w1-f9f277-openshift-default-869d58fb77-dllj5"]
Oct 30 21:00:01.275856 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:01.275819    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c1a9de29-3987-4405-b4e0-c9c2586c4f96-workload-certs\") pod \"e2e-worker-w1-f9f277-openshift-default-869d58fb77-dllj5\" (UID: \"c1a9de29-3987-4405-b4e0-c9c2586c4f96\") " pod="openshift-ingress/e2e-worker-w1-f9f277-openshift-default-869d58fb77-dllj5"
Oct 30 21:00:01.275856 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:01.275860    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c1a9de29-3987-4405-b4e0-c9c2586c4f96-istio-data\") pod \"e2e-worker-w1-f9f277-openshift-default-869d58fb77-dllj5\" (UID: \"c1a9de29-3987-4405-b4e0-c9c2586c4f96\") " pod="openshift-ingress/e2e-worker-w1-f9f277-openshift-default-869d58fb77-dllj5"
Oct 30 21:00:01.276137 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:01.275895    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c1a9de29-3987-4405-b4e0-c9c2586c4f96-istio-podinfo\") pod \"e2e-worker-w1-f9f277-openshift-default-869d58fb77-dllj5\" (UID: \"c1a9de29-3987-4405-b4e0-c9c2586c4f96\") " pod="openshift-ingress/e2e-worker-w1-f9f277-openshift-default-869d58fb77-dllj5"
Oct 30 21:00:01.276137 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:01.275921    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c1a9de29-3987-4405-b4e0-c9c2586c4f96-credential-socket\") pod \"e2e-worker-w1-f9f277-openshift-default-869d58fb77-dllj5\" (UID: \"c1a9de29-3987-4405-b4e0-c9c2586c4f96\") " pod="openshift-ingress/e2e-worker-w1-f9f277-openshift-default-869d58fb77-dllj5"
Oct 30 21:00:01.276137 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:01.275966    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c1a9de29-3987-4405-b4e0-c9c2586c4f96-istio-envoy\") pod \"e2e-worker-w1-f9f277-openshift-default-869d58fb77-dllj5\" (UID: \"c1a9de29-3987-4405-b4e0-c9c2586c4f96\") " pod="openshift-ingress/e2e-worker-w1-f9f277-openshift-default-869d58fb77-dllj5"
Oct 30 21:00:01.276137 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:01.276005    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f5zl9\" (UniqueName: \"kubernetes.io/projected/c1a9de29-3987-4405-b4e0-c9c2586c4f96-kube-api-access-f5zl9\") pod \"e2e-worker-w1-f9f277-openshift-default-869d58fb77-dllj5\" (UID: \"c1a9de29-3987-4405-b4e0-c9c2586c4f96\") " pod="openshift-ingress/e2e-worker-w1-f9f277-openshift-default-869d58fb77-dllj5"
Oct 30 21:00:01.276137 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:01.276045    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c1a9de29-3987-4405-b4e0-c9c2586c4f96-workload-socket\") pod \"e2e-worker-w1-f9f277-openshift-default-869d58fb77-dllj5\" (UID: \"c1a9de29-3987-4405-b4e0-c9c2586c4f96\") " pod="openshift-ingress/e2e-worker-w1-f9f277-openshift-default-869d58fb77-dllj5"
Oct 30 21:00:01.276137 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:01.276097    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c1a9de29-3987-4405-b4e0-c9c2586c4f96-istiod-ca-cert\") pod \"e2e-worker-w1-f9f277-openshift-default-869d58fb77-dllj5\" (UID: \"c1a9de29-3987-4405-b4e0-c9c2586c4f96\") " pod="openshift-ingress/e2e-worker-w1-f9f277-openshift-default-869d58fb77-dllj5"
Oct 30 21:00:01.276137 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:01.276135    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c1a9de29-3987-4405-b4e0-c9c2586c4f96-istio-token\") pod \"e2e-worker-w1-f9f277-openshift-default-869d58fb77-dllj5\" (UID: \"c1a9de29-3987-4405-b4e0-c9c2586c4f96\") " pod="openshift-ingress/e2e-worker-w1-f9f277-openshift-default-869d58fb77-dllj5"
Oct 30 21:00:01.276511 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:01.276312    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c1a9de29-3987-4405-b4e0-c9c2586c4f96-workload-certs\") pod \"e2e-worker-w1-f9f277-openshift-default-869d58fb77-dllj5\" (UID: \"c1a9de29-3987-4405-b4e0-c9c2586c4f96\") " pod="openshift-ingress/e2e-worker-w1-f9f277-openshift-default-869d58fb77-dllj5"
Oct 30 21:00:01.276511 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:01.276362    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c1a9de29-3987-4405-b4e0-c9c2586c4f96-istio-data\") pod \"e2e-worker-w1-f9f277-openshift-default-869d58fb77-dllj5\" (UID: \"c1a9de29-3987-4405-b4e0-c9c2586c4f96\") " pod="openshift-ingress/e2e-worker-w1-f9f277-openshift-default-869d58fb77-dllj5"
Oct 30 21:00:01.276511 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:01.276377    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c1a9de29-3987-4405-b4e0-c9c2586c4f96-credential-socket\") pod \"e2e-worker-w1-f9f277-openshift-default-869d58fb77-dllj5\" (UID: \"c1a9de29-3987-4405-b4e0-c9c2586c4f96\") " pod="openshift-ingress/e2e-worker-w1-f9f277-openshift-default-869d58fb77-dllj5"
Oct 30 21:00:01.276676 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:01.276650    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c1a9de29-3987-4405-b4e0-c9c2586c4f96-workload-socket\") pod \"e2e-worker-w1-f9f277-openshift-default-869d58fb77-dllj5\" (UID: \"c1a9de29-3987-4405-b4e0-c9c2586c4f96\") " pod="openshift-ingress/e2e-worker-w1-f9f277-openshift-default-869d58fb77-dllj5"
Oct 30 21:00:01.276973 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:01.276949    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c1a9de29-3987-4405-b4e0-c9c2586c4f96-istiod-ca-cert\") pod \"e2e-worker-w1-f9f277-openshift-default-869d58fb77-dllj5\" (UID: \"c1a9de29-3987-4405-b4e0-c9c2586c4f96\") " pod="openshift-ingress/e2e-worker-w1-f9f277-openshift-default-869d58fb77-dllj5"
Oct 30 21:00:01.278634 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:01.278606    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c1a9de29-3987-4405-b4e0-c9c2586c4f96-istio-envoy\") pod \"e2e-worker-w1-f9f277-openshift-default-869d58fb77-dllj5\" (UID: \"c1a9de29-3987-4405-b4e0-c9c2586c4f96\") " pod="openshift-ingress/e2e-worker-w1-f9f277-openshift-default-869d58fb77-dllj5"
Oct 30 21:00:01.278745 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:01.278710    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c1a9de29-3987-4405-b4e0-c9c2586c4f96-istio-podinfo\") pod \"e2e-worker-w1-f9f277-openshift-default-869d58fb77-dllj5\" (UID: \"c1a9de29-3987-4405-b4e0-c9c2586c4f96\") " pod="openshift-ingress/e2e-worker-w1-f9f277-openshift-default-869d58fb77-dllj5"
Oct 30 21:00:01.333836 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:01.333776    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f5zl9\" (UniqueName: \"kubernetes.io/projected/c1a9de29-3987-4405-b4e0-c9c2586c4f96-kube-api-access-f5zl9\") pod \"e2e-worker-w1-f9f277-openshift-default-869d58fb77-dllj5\" (UID: \"c1a9de29-3987-4405-b4e0-c9c2586c4f96\") " pod="openshift-ingress/e2e-worker-w1-f9f277-openshift-default-869d58fb77-dllj5"
Oct 30 21:00:01.333836 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:01.333788    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c1a9de29-3987-4405-b4e0-c9c2586c4f96-istio-token\") pod \"e2e-worker-w1-f9f277-openshift-default-869d58fb77-dllj5\" (UID: \"c1a9de29-3987-4405-b4e0-c9c2586c4f96\") " pod="openshift-ingress/e2e-worker-w1-f9f277-openshift-default-869d58fb77-dllj5"
Oct 30 21:00:01.393282 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:01.393249    6004 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-f9f277-openshift-default-869d58fb77-dllj5"
Oct 30 21:00:01.829461 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:01.829431    6004 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w1-f9f277-openshift-default-869d58fb77-dllj5"]
Oct 30 21:00:01.829764 ip-10-0-138-85 kubenswrapper[6004]: W1030 21:00:01.829737    6004 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc1a9de29_3987_4405_b4e0_c9c2586c4f96.slice/crio-08b705ccd1b549327c9139e41149d89b7e47786d2bfee37b2890603663265ed7 WatchSource:0}: Error finding container 08b705ccd1b549327c9139e41149d89b7e47786d2bfee37b2890603663265ed7: Status 404 returned error can't find the container with id 08b705ccd1b549327c9139e41149d89b7e47786d2bfee37b2890603663265ed7
Oct 30 21:00:01.832257 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:01.832224    6004 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 21:00:01.832354 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:01.832288    6004 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 21:00:01.832354 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:01.832318    6004 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 21:00:02.044067 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:02.043257    6004 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-f9f277-openshift-default-869d58fb77-dllj5" event={"ID":"c1a9de29-3987-4405-b4e0-c9c2586c4f96","Type":"ContainerStarted","Data":"b0282cc6b7db97faa611b6c779a3c1bd9aba2d46b3615a9dbd007d1b5b643c71"}
Oct 30 21:00:02.044067 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:02.043355    6004 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-f9f277-openshift-default-869d58fb77-dllj5" event={"ID":"c1a9de29-3987-4405-b4e0-c9c2586c4f96","Type":"ContainerStarted","Data":"08b705ccd1b549327c9139e41149d89b7e47786d2bfee37b2890603663265ed7"}
Oct 30 21:00:02.181235 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:02.181170    6004 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w1-f9f277-openshift-default-869d58fb77-dllj5" podStartSLOduration=1.181150206 podStartE2EDuration="1.181150206s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:00:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:00:02.17862064 +0000 UTC m=+1308.098406832" watchObservedRunningTime="2026-10-30 21:00:02.181150206 +0000 UTC m=+1308.100936325"
Oct 30 21:00:02.394074 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:02.393931    6004 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w1-f9f277-openshift-default-869d58fb77-dllj5"
Oct 30 21:00:02.395021 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:02.394983    6004 patch_prober.go:29] interesting pod/e2e-worker-w1-f9f277-openshift-default-869d58fb77-dllj5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.77:15021/healthz/ready\": dial tcp 10.132.0.77:15021: connect: connection refused" start-of-body=
Oct 30 21:00:02.395187 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:02.395091    6004 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-f9f277-openshift-default-869d58fb77-dllj5" podUID="c1a9de29-3987-4405-b4e0-c9c2586c4f96" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.77:15021/healthz/ready\": dial tcp 10.132.0.77:15021: connect: connection refused"
Oct 30 21:00:02.495140 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:02.494362    6004 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w4-1fdaa7-openshift-default-84586db7d5-gt5hd"]
Oct 30 21:00:02.499314 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:02.499276    6004 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-1fdaa7-openshift-default-84586db7d5-gt5hd"
Oct 30 21:00:02.580097 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:02.575748    6004 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w4-1fdaa7-openshift-default-84586db7d5-gt5hd"]
Oct 30 21:00:02.599858 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:02.599812    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/21525b82-87c7-4c9e-91fc-6070f3973861-istio-token\") pod \"e2e-worker-w4-1fdaa7-openshift-default-84586db7d5-gt5hd\" (UID: \"21525b82-87c7-4c9e-91fc-6070f3973861\") " pod="openshift-ingress/e2e-worker-w4-1fdaa7-openshift-default-84586db7d5-gt5hd"
Oct 30 21:00:02.604214 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:02.604188    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/21525b82-87c7-4c9e-91fc-6070f3973861-istiod-ca-cert\") pod \"e2e-worker-w4-1fdaa7-openshift-default-84586db7d5-gt5hd\" (UID: \"21525b82-87c7-4c9e-91fc-6070f3973861\") " pod="openshift-ingress/e2e-worker-w4-1fdaa7-openshift-default-84586db7d5-gt5hd"
Oct 30 21:00:02.604478 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:02.604459    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/21525b82-87c7-4c9e-91fc-6070f3973861-istio-data\") pod \"e2e-worker-w4-1fdaa7-openshift-default-84586db7d5-gt5hd\" (UID: \"21525b82-87c7-4c9e-91fc-6070f3973861\") " pod="openshift-ingress/e2e-worker-w4-1fdaa7-openshift-default-84586db7d5-gt5hd"
Oct 30 21:00:02.604641 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:02.604624    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/21525b82-87c7-4c9e-91fc-6070f3973861-istio-envoy\") pod \"e2e-worker-w4-1fdaa7-openshift-default-84586db7d5-gt5hd\" (UID: \"21525b82-87c7-4c9e-91fc-6070f3973861\") " pod="openshift-ingress/e2e-worker-w4-1fdaa7-openshift-default-84586db7d5-gt5hd"
Oct 30 21:00:02.627073 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:02.604803    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/21525b82-87c7-4c9e-91fc-6070f3973861-credential-socket\") pod \"e2e-worker-w4-1fdaa7-openshift-default-84586db7d5-gt5hd\" (UID: \"21525b82-87c7-4c9e-91fc-6070f3973861\") " pod="openshift-ingress/e2e-worker-w4-1fdaa7-openshift-default-84586db7d5-gt5hd"
Oct 30 21:00:02.648409 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:02.648371    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/21525b82-87c7-4c9e-91fc-6070f3973861-workload-certs\") pod \"e2e-worker-w4-1fdaa7-openshift-default-84586db7d5-gt5hd\" (UID: \"21525b82-87c7-4c9e-91fc-6070f3973861\") " pod="openshift-ingress/e2e-worker-w4-1fdaa7-openshift-default-84586db7d5-gt5hd"
Oct 30 21:00:02.648711 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:02.648685    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4vpx9\" (UniqueName: \"kubernetes.io/projected/21525b82-87c7-4c9e-91fc-6070f3973861-kube-api-access-4vpx9\") pod \"e2e-worker-w4-1fdaa7-openshift-default-84586db7d5-gt5hd\" (UID: \"21525b82-87c7-4c9e-91fc-6070f3973861\") " pod="openshift-ingress/e2e-worker-w4-1fdaa7-openshift-default-84586db7d5-gt5hd"
Oct 30 21:00:02.648956 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:02.648935    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/21525b82-87c7-4c9e-91fc-6070f3973861-workload-socket\") pod \"e2e-worker-w4-1fdaa7-openshift-default-84586db7d5-gt5hd\" (UID: \"21525b82-87c7-4c9e-91fc-6070f3973861\") " pod="openshift-ingress/e2e-worker-w4-1fdaa7-openshift-default-84586db7d5-gt5hd"
Oct 30 21:00:02.668011 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:02.667981    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/21525b82-87c7-4c9e-91fc-6070f3973861-istio-podinfo\") pod \"e2e-worker-w4-1fdaa7-openshift-default-84586db7d5-gt5hd\" (UID: \"21525b82-87c7-4c9e-91fc-6070f3973861\") " pod="openshift-ingress/e2e-worker-w4-1fdaa7-openshift-default-84586db7d5-gt5hd"
Oct 30 21:00:02.814127 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:02.788862    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/21525b82-87c7-4c9e-91fc-6070f3973861-istio-token\") pod \"e2e-worker-w4-1fdaa7-openshift-default-84586db7d5-gt5hd\" (UID: \"21525b82-87c7-4c9e-91fc-6070f3973861\") " pod="openshift-ingress/e2e-worker-w4-1fdaa7-openshift-default-84586db7d5-gt5hd"
Oct 30 21:00:02.814409 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:02.814378    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/21525b82-87c7-4c9e-91fc-6070f3973861-istiod-ca-cert\") pod \"e2e-worker-w4-1fdaa7-openshift-default-84586db7d5-gt5hd\" (UID: \"21525b82-87c7-4c9e-91fc-6070f3973861\") " pod="openshift-ingress/e2e-worker-w4-1fdaa7-openshift-default-84586db7d5-gt5hd"
Oct 30 21:00:02.814559 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:02.814538    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/21525b82-87c7-4c9e-91fc-6070f3973861-istio-data\") pod \"e2e-worker-w4-1fdaa7-openshift-default-84586db7d5-gt5hd\" (UID: \"21525b82-87c7-4c9e-91fc-6070f3973861\") " pod="openshift-ingress/e2e-worker-w4-1fdaa7-openshift-default-84586db7d5-gt5hd"
Oct 30 21:00:02.856229 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:02.856184    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/21525b82-87c7-4c9e-91fc-6070f3973861-istio-envoy\") pod \"e2e-worker-w4-1fdaa7-openshift-default-84586db7d5-gt5hd\" (UID: \"21525b82-87c7-4c9e-91fc-6070f3973861\") " pod="openshift-ingress/e2e-worker-w4-1fdaa7-openshift-default-84586db7d5-gt5hd"
Oct 30 21:00:02.856628 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:02.856597    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/21525b82-87c7-4c9e-91fc-6070f3973861-credential-socket\") pod \"e2e-worker-w4-1fdaa7-openshift-default-84586db7d5-gt5hd\" (UID: \"21525b82-87c7-4c9e-91fc-6070f3973861\") " pod="openshift-ingress/e2e-worker-w4-1fdaa7-openshift-default-84586db7d5-gt5hd"
Oct 30 21:00:02.856805 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:02.856784    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/21525b82-87c7-4c9e-91fc-6070f3973861-workload-certs\") pod \"e2e-worker-w4-1fdaa7-openshift-default-84586db7d5-gt5hd\" (UID: \"21525b82-87c7-4c9e-91fc-6070f3973861\") " pod="openshift-ingress/e2e-worker-w4-1fdaa7-openshift-default-84586db7d5-gt5hd"
Oct 30 21:00:02.856942 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:02.856925    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4vpx9\" (UniqueName: \"kubernetes.io/projected/21525b82-87c7-4c9e-91fc-6070f3973861-kube-api-access-4vpx9\") pod \"e2e-worker-w4-1fdaa7-openshift-default-84586db7d5-gt5hd\" (UID: \"21525b82-87c7-4c9e-91fc-6070f3973861\") " pod="openshift-ingress/e2e-worker-w4-1fdaa7-openshift-default-84586db7d5-gt5hd"
Oct 30 21:00:02.857145 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:02.857127    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/21525b82-87c7-4c9e-91fc-6070f3973861-workload-socket\") pod \"e2e-worker-w4-1fdaa7-openshift-default-84586db7d5-gt5hd\" (UID: \"21525b82-87c7-4c9e-91fc-6070f3973861\") " pod="openshift-ingress/e2e-worker-w4-1fdaa7-openshift-default-84586db7d5-gt5hd"
Oct 30 21:00:02.888115 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:02.857901    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/21525b82-87c7-4c9e-91fc-6070f3973861-istio-podinfo\") pod \"e2e-worker-w4-1fdaa7-openshift-default-84586db7d5-gt5hd\" (UID: \"21525b82-87c7-4c9e-91fc-6070f3973861\") " pod="openshift-ingress/e2e-worker-w4-1fdaa7-openshift-default-84586db7d5-gt5hd"
Oct 30 21:00:02.929495 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:02.831487    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/21525b82-87c7-4c9e-91fc-6070f3973861-istiod-ca-cert\") pod \"e2e-worker-w4-1fdaa7-openshift-default-84586db7d5-gt5hd\" (UID: \"21525b82-87c7-4c9e-91fc-6070f3973861\") " pod="openshift-ingress/e2e-worker-w4-1fdaa7-openshift-default-84586db7d5-gt5hd"
Oct 30 21:00:02.936178 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:02.862358    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/21525b82-87c7-4c9e-91fc-6070f3973861-credential-socket\") pod \"e2e-worker-w4-1fdaa7-openshift-default-84586db7d5-gt5hd\" (UID: \"21525b82-87c7-4c9e-91fc-6070f3973861\") " pod="openshift-ingress/e2e-worker-w4-1fdaa7-openshift-default-84586db7d5-gt5hd"
Oct 30 21:00:02.936396 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:02.873370    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/21525b82-87c7-4c9e-91fc-6070f3973861-workload-certs\") pod \"e2e-worker-w4-1fdaa7-openshift-default-84586db7d5-gt5hd\" (UID: \"21525b82-87c7-4c9e-91fc-6070f3973861\") " pod="openshift-ingress/e2e-worker-w4-1fdaa7-openshift-default-84586db7d5-gt5hd"
Oct 30 21:00:02.936535 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:02.873768    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/21525b82-87c7-4c9e-91fc-6070f3973861-workload-socket\") pod \"e2e-worker-w4-1fdaa7-openshift-default-84586db7d5-gt5hd\" (UID: \"21525b82-87c7-4c9e-91fc-6070f3973861\") " pod="openshift-ingress/e2e-worker-w4-1fdaa7-openshift-default-84586db7d5-gt5hd"
Oct 30 21:00:02.936645 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:02.850585    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/21525b82-87c7-4c9e-91fc-6070f3973861-istio-data\") pod \"e2e-worker-w4-1fdaa7-openshift-default-84586db7d5-gt5hd\" (UID: \"21525b82-87c7-4c9e-91fc-6070f3973861\") " pod="openshift-ingress/e2e-worker-w4-1fdaa7-openshift-default-84586db7d5-gt5hd"
Oct 30 21:00:02.936752 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:02.928704    6004 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w2-d061d0-openshift-default-86b87f495-d8j6q"]
Oct 30 21:00:03.066619 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:03.066018    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/21525b82-87c7-4c9e-91fc-6070f3973861-istio-token\") pod \"e2e-worker-w4-1fdaa7-openshift-default-84586db7d5-gt5hd\" (UID: \"21525b82-87c7-4c9e-91fc-6070f3973861\") " pod="openshift-ingress/e2e-worker-w4-1fdaa7-openshift-default-84586db7d5-gt5hd"
Oct 30 21:00:03.068682 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:03.068653    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4vpx9\" (UniqueName: \"kubernetes.io/projected/21525b82-87c7-4c9e-91fc-6070f3973861-kube-api-access-4vpx9\") pod \"e2e-worker-w4-1fdaa7-openshift-default-84586db7d5-gt5hd\" (UID: \"21525b82-87c7-4c9e-91fc-6070f3973861\") " pod="openshift-ingress/e2e-worker-w4-1fdaa7-openshift-default-84586db7d5-gt5hd"
Oct 30 21:00:03.091074 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:03.083126    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/21525b82-87c7-4c9e-91fc-6070f3973861-istio-podinfo\") pod \"e2e-worker-w4-1fdaa7-openshift-default-84586db7d5-gt5hd\" (UID: \"21525b82-87c7-4c9e-91fc-6070f3973861\") " pod="openshift-ingress/e2e-worker-w4-1fdaa7-openshift-default-84586db7d5-gt5hd"
Oct 30 21:00:03.235072 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:03.222271    6004 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w2-d061d0-openshift-default-86b87f495-d8j6q"]
Oct 30 21:00:03.250088 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:03.244206    6004 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-d061d0-openshift-default-86b87f495-d8j6q"
Oct 30 21:00:03.452619 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:03.452570    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/54f45743-f6cf-4d8b-b3a5-e1064334eebc-workload-certs\") pod \"e2e-worker-w2-d061d0-openshift-default-86b87f495-d8j6q\" (UID: \"54f45743-f6cf-4d8b-b3a5-e1064334eebc\") " pod="openshift-ingress/e2e-worker-w2-d061d0-openshift-default-86b87f495-d8j6q"
Oct 30 21:00:03.453198 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:03.453169    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/54f45743-f6cf-4d8b-b3a5-e1064334eebc-istio-token\") pod \"e2e-worker-w2-d061d0-openshift-default-86b87f495-d8j6q\" (UID: \"54f45743-f6cf-4d8b-b3a5-e1064334eebc\") " pod="openshift-ingress/e2e-worker-w2-d061d0-openshift-default-86b87f495-d8j6q"
Oct 30 21:00:03.453402 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:03.453379    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/54f45743-f6cf-4d8b-b3a5-e1064334eebc-istio-data\") pod \"e2e-worker-w2-d061d0-openshift-default-86b87f495-d8j6q\" (UID: \"54f45743-f6cf-4d8b-b3a5-e1064334eebc\") " pod="openshift-ingress/e2e-worker-w2-d061d0-openshift-default-86b87f495-d8j6q"
Oct 30 21:00:03.453766 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:03.453556    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/54f45743-f6cf-4d8b-b3a5-e1064334eebc-istio-podinfo\") pod \"e2e-worker-w2-d061d0-openshift-default-86b87f495-d8j6q\" (UID: \"54f45743-f6cf-4d8b-b3a5-e1064334eebc\") " pod="openshift-ingress/e2e-worker-w2-d061d0-openshift-default-86b87f495-d8j6q"
Oct 30 21:00:03.477174 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:03.477132    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/54f45743-f6cf-4d8b-b3a5-e1064334eebc-istiod-ca-cert\") pod \"e2e-worker-w2-d061d0-openshift-default-86b87f495-d8j6q\" (UID: \"54f45743-f6cf-4d8b-b3a5-e1064334eebc\") " pod="openshift-ingress/e2e-worker-w2-d061d0-openshift-default-86b87f495-d8j6q"
Oct 30 21:00:03.477592 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:03.477565    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/54f45743-f6cf-4d8b-b3a5-e1064334eebc-credential-socket\") pod \"e2e-worker-w2-d061d0-openshift-default-86b87f495-d8j6q\" (UID: \"54f45743-f6cf-4d8b-b3a5-e1064334eebc\") " pod="openshift-ingress/e2e-worker-w2-d061d0-openshift-default-86b87f495-d8j6q"
Oct 30 21:00:03.501074 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:03.478554    6004 patch_prober.go:29] interesting pod/e2e-worker-w1-f9f277-openshift-default-869d58fb77-dllj5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.77:15021/healthz/ready\": dial tcp 10.132.0.77:15021: connect: connection refused" start-of-body=
Oct 30 21:00:03.527508 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:03.527442    6004 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-f9f277-openshift-default-869d58fb77-dllj5" podUID="c1a9de29-3987-4405-b4e0-c9c2586c4f96" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.77:15021/healthz/ready\": dial tcp 10.132.0.77:15021: connect: connection refused"
Oct 30 21:00:03.558088 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:03.505635    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/54f45743-f6cf-4d8b-b3a5-e1064334eebc-workload-socket\") pod \"e2e-worker-w2-d061d0-openshift-default-86b87f495-d8j6q\" (UID: \"54f45743-f6cf-4d8b-b3a5-e1064334eebc\") " pod="openshift-ingress/e2e-worker-w2-d061d0-openshift-default-86b87f495-d8j6q"
Oct 30 21:00:03.558088 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:03.544279    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/54f45743-f6cf-4d8b-b3a5-e1064334eebc-istio-envoy\") pod \"e2e-worker-w2-d061d0-openshift-default-86b87f495-d8j6q\" (UID: \"54f45743-f6cf-4d8b-b3a5-e1064334eebc\") " pod="openshift-ingress/e2e-worker-w2-d061d0-openshift-default-86b87f495-d8j6q"
Oct 30 21:00:03.558088 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:03.544369    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gbn7b\" (UniqueName: \"kubernetes.io/projected/54f45743-f6cf-4d8b-b3a5-e1064334eebc-kube-api-access-gbn7b\") pod \"e2e-worker-w2-d061d0-openshift-default-86b87f495-d8j6q\" (UID: \"54f45743-f6cf-4d8b-b3a5-e1064334eebc\") " pod="openshift-ingress/e2e-worker-w2-d061d0-openshift-default-86b87f495-d8j6q"
Oct 30 21:00:03.664571 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:03.664531    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/54f45743-f6cf-4d8b-b3a5-e1064334eebc-credential-socket\") pod \"e2e-worker-w2-d061d0-openshift-default-86b87f495-d8j6q\" (UID: \"54f45743-f6cf-4d8b-b3a5-e1064334eebc\") " pod="openshift-ingress/e2e-worker-w2-d061d0-openshift-default-86b87f495-d8j6q"
Oct 30 21:00:03.665823 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:03.665532    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/54f45743-f6cf-4d8b-b3a5-e1064334eebc-workload-socket\") pod \"e2e-worker-w2-d061d0-openshift-default-86b87f495-d8j6q\" (UID: \"54f45743-f6cf-4d8b-b3a5-e1064334eebc\") " pod="openshift-ingress/e2e-worker-w2-d061d0-openshift-default-86b87f495-d8j6q"
Oct 30 21:00:03.666086 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:03.665406    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/54f45743-f6cf-4d8b-b3a5-e1064334eebc-credential-socket\") pod \"e2e-worker-w2-d061d0-openshift-default-86b87f495-d8j6q\" (UID: \"54f45743-f6cf-4d8b-b3a5-e1064334eebc\") " pod="openshift-ingress/e2e-worker-w2-d061d0-openshift-default-86b87f495-d8j6q"
Oct 30 21:00:03.666364 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:03.666345    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/54f45743-f6cf-4d8b-b3a5-e1064334eebc-istio-envoy\") pod \"e2e-worker-w2-d061d0-openshift-default-86b87f495-d8j6q\" (UID: \"54f45743-f6cf-4d8b-b3a5-e1064334eebc\") " pod="openshift-ingress/e2e-worker-w2-d061d0-openshift-default-86b87f495-d8j6q"
Oct 30 21:00:03.667733 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:03.667713    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gbn7b\" (UniqueName: \"kubernetes.io/projected/54f45743-f6cf-4d8b-b3a5-e1064334eebc-kube-api-access-gbn7b\") pod \"e2e-worker-w2-d061d0-openshift-default-86b87f495-d8j6q\" (UID: \"54f45743-f6cf-4d8b-b3a5-e1064334eebc\") " pod="openshift-ingress/e2e-worker-w2-d061d0-openshift-default-86b87f495-d8j6q"
Oct 30 21:00:03.668356 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:03.668335    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/21525b82-87c7-4c9e-91fc-6070f3973861-istio-envoy\") pod \"e2e-worker-w4-1fdaa7-openshift-default-84586db7d5-gt5hd\" (UID: \"21525b82-87c7-4c9e-91fc-6070f3973861\") " pod="openshift-ingress/e2e-worker-w4-1fdaa7-openshift-default-84586db7d5-gt5hd"
Oct 30 21:00:03.672361 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:03.672341    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/54f45743-f6cf-4d8b-b3a5-e1064334eebc-workload-certs\") pod \"e2e-worker-w2-d061d0-openshift-default-86b87f495-d8j6q\" (UID: \"54f45743-f6cf-4d8b-b3a5-e1064334eebc\") " pod="openshift-ingress/e2e-worker-w2-d061d0-openshift-default-86b87f495-d8j6q"
Oct 30 21:00:03.677331 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:03.677293    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/54f45743-f6cf-4d8b-b3a5-e1064334eebc-workload-certs\") pod \"e2e-worker-w2-d061d0-openshift-default-86b87f495-d8j6q\" (UID: \"54f45743-f6cf-4d8b-b3a5-e1064334eebc\") " pod="openshift-ingress/e2e-worker-w2-d061d0-openshift-default-86b87f495-d8j6q"
Oct 30 21:00:03.688130 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:03.688101    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/54f45743-f6cf-4d8b-b3a5-e1064334eebc-istio-token\") pod \"e2e-worker-w2-d061d0-openshift-default-86b87f495-d8j6q\" (UID: \"54f45743-f6cf-4d8b-b3a5-e1064334eebc\") " pod="openshift-ingress/e2e-worker-w2-d061d0-openshift-default-86b87f495-d8j6q"
Oct 30 21:00:03.689081 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:03.689060    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/54f45743-f6cf-4d8b-b3a5-e1064334eebc-istio-data\") pod \"e2e-worker-w2-d061d0-openshift-default-86b87f495-d8j6q\" (UID: \"54f45743-f6cf-4d8b-b3a5-e1064334eebc\") " pod="openshift-ingress/e2e-worker-w2-d061d0-openshift-default-86b87f495-d8j6q"
Oct 30 21:00:03.689797 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:03.689778    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/54f45743-f6cf-4d8b-b3a5-e1064334eebc-istio-podinfo\") pod \"e2e-worker-w2-d061d0-openshift-default-86b87f495-d8j6q\" (UID: \"54f45743-f6cf-4d8b-b3a5-e1064334eebc\") " pod="openshift-ingress/e2e-worker-w2-d061d0-openshift-default-86b87f495-d8j6q"
Oct 30 21:00:03.704120 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:03.688949    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/54f45743-f6cf-4d8b-b3a5-e1064334eebc-workload-socket\") pod \"e2e-worker-w2-d061d0-openshift-default-86b87f495-d8j6q\" (UID: \"54f45743-f6cf-4d8b-b3a5-e1064334eebc\") " pod="openshift-ingress/e2e-worker-w2-d061d0-openshift-default-86b87f495-d8j6q"
Oct 30 21:00:03.704550 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:03.704529    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/54f45743-f6cf-4d8b-b3a5-e1064334eebc-istiod-ca-cert\") pod \"e2e-worker-w2-d061d0-openshift-default-86b87f495-d8j6q\" (UID: \"54f45743-f6cf-4d8b-b3a5-e1064334eebc\") " pod="openshift-ingress/e2e-worker-w2-d061d0-openshift-default-86b87f495-d8j6q"
Oct 30 21:00:03.712915 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:03.712890    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/54f45743-f6cf-4d8b-b3a5-e1064334eebc-istio-data\") pod \"e2e-worker-w2-d061d0-openshift-default-86b87f495-d8j6q\" (UID: \"54f45743-f6cf-4d8b-b3a5-e1064334eebc\") " pod="openshift-ingress/e2e-worker-w2-d061d0-openshift-default-86b87f495-d8j6q"
Oct 30 21:00:03.760070 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:03.732445    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/54f45743-f6cf-4d8b-b3a5-e1064334eebc-istio-podinfo\") pod \"e2e-worker-w2-d061d0-openshift-default-86b87f495-d8j6q\" (UID: \"54f45743-f6cf-4d8b-b3a5-e1064334eebc\") " pod="openshift-ingress/e2e-worker-w2-d061d0-openshift-default-86b87f495-d8j6q"
Oct 30 21:00:03.760880 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:03.735939    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/54f45743-f6cf-4d8b-b3a5-e1064334eebc-istio-envoy\") pod \"e2e-worker-w2-d061d0-openshift-default-86b87f495-d8j6q\" (UID: \"54f45743-f6cf-4d8b-b3a5-e1064334eebc\") " pod="openshift-ingress/e2e-worker-w2-d061d0-openshift-default-86b87f495-d8j6q"
Oct 30 21:00:03.761011 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:03.760797    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/54f45743-f6cf-4d8b-b3a5-e1064334eebc-istiod-ca-cert\") pod \"e2e-worker-w2-d061d0-openshift-default-86b87f495-d8j6q\" (UID: \"54f45743-f6cf-4d8b-b3a5-e1064334eebc\") " pod="openshift-ingress/e2e-worker-w2-d061d0-openshift-default-86b87f495-d8j6q"
Oct 30 21:00:03.789692 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:03.789406    6004 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-1fdaa7-openshift-default-84586db7d5-gt5hd"
Oct 30 21:00:03.790599 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:03.790552    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/54f45743-f6cf-4d8b-b3a5-e1064334eebc-istio-token\") pod \"e2e-worker-w2-d061d0-openshift-default-86b87f495-d8j6q\" (UID: \"54f45743-f6cf-4d8b-b3a5-e1064334eebc\") " pod="openshift-ingress/e2e-worker-w2-d061d0-openshift-default-86b87f495-d8j6q"
Oct 30 21:00:03.800072 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:03.791410    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gbn7b\" (UniqueName: \"kubernetes.io/projected/54f45743-f6cf-4d8b-b3a5-e1064334eebc-kube-api-access-gbn7b\") pod \"e2e-worker-w2-d061d0-openshift-default-86b87f495-d8j6q\" (UID: \"54f45743-f6cf-4d8b-b3a5-e1064334eebc\") " pod="openshift-ingress/e2e-worker-w2-d061d0-openshift-default-86b87f495-d8j6q"
Oct 30 21:00:04.035304 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:04.035251    6004 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-d061d0-openshift-default-86b87f495-d8j6q"
Oct 30 21:00:04.284725 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:04.284618    6004 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-d061d0/premium-w2-d061d0-kserve-5c589d8c9f-rt7v4" podUID="769fd172-1d4c-4cd3-8eda-e8d4850c0f67" containerName="main" probeResult="failure" output="Get \"https://10.132.0.62:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:00:04.415251 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:04.415213    6004 patch_prober.go:29] interesting pod/e2e-worker-w1-f9f277-openshift-default-869d58fb77-dllj5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.77:15021/healthz/ready\": dial tcp 10.132.0.77:15021: connect: connection refused" start-of-body=
Oct 30 21:00:04.415533 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:04.415502    6004 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-f9f277-openshift-default-869d58fb77-dllj5" podUID="c1a9de29-3987-4405-b4e0-c9c2586c4f96" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.77:15021/healthz/ready\": dial tcp 10.132.0.77:15021: connect: connection refused"
Oct 30 21:00:04.563347 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:04.563212    6004 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-f9f277/distinct-w1-f9f277-kserve-f947bc879-lzs6w" podUID="f4ab8826-a6f1-41e6-897f-b808635017c5" containerName="main" probeResult="failure" output="Get \"https://10.132.0.68:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:00:04.713162 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:04.713114    6004 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-2b425d/distinct-w5-2b425d-kserve-dd4dcf7f-b227k" podUID="802e5037-d6f5-4a37-a95f-b49dda7f8b1b" containerName="main" probeResult="failure" output="Get \"https://10.132.0.67:8000/ready\": context deadline exceeded"
Oct 30 21:00:04.737184 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:04.737137    6004 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-1fdaa7/distinct-2-w4-1fdaa7-kserve-59f4d6788b-b6gl4" podUID="f6d2856c-84b5-426d-bfcd-ef613ab44242" containerName="main" probeResult="failure" output="Get \"https://10.132.0.73:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:00:05.053096 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:05.045136    6004 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-d061d0/distinct-2-w2-d061d0-kserve-5c6bb99fbf-b4kqs" podUID="32264f6c-999b-4bad-bd2e-7664cadc0669" containerName="main" probeResult="failure" output="Get \"https://10.132.0.71:8000/ready\": context deadline exceeded"
Oct 30 21:00:05.326121 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:05.323350    6004 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w4-1fdaa7-openshift-default-84586db7d5-gt5hd"]
Oct 30 21:00:05.433076 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:05.428266    6004 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 21:00:05.433076 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:05.428369    6004 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 21:00:05.433076 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:05.428415    6004 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 21:00:05.433390 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:05.433178    6004 patch_prober.go:29] interesting pod/e2e-worker-w1-f9f277-openshift-default-869d58fb77-dllj5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.77:15021/healthz/ready\": dial tcp 10.132.0.77:15021: connect: connection refused" start-of-body=
Oct 30 21:00:05.433390 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:05.433230    6004 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-f9f277-openshift-default-869d58fb77-dllj5" podUID="c1a9de29-3987-4405-b4e0-c9c2586c4f96" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.77:15021/healthz/ready\": dial tcp 10.132.0.77:15021: connect: connection refused"
Oct 30 21:00:05.527073 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:05.508683    6004 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w2-d061d0-openshift-default-86b87f495-d8j6q"]
Oct 30 21:00:05.550324 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:05.550275    6004 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-1fdaa7-openshift-default-84586db7d5-gt5hd" event={"ID":"21525b82-87c7-4c9e-91fc-6070f3973861","Type":"ContainerStarted","Data":"70f346032d4c2fb286ad7553b1c12cb3b304582dea335aa85c107a02e91b0c81"}
Oct 30 21:00:05.702157 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:05.702118    6004 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 21:00:05.702793 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:05.702758    6004 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 21:00:05.703006 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:05.702972    6004 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 21:00:06.393727 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:06.393684    6004 patch_prober.go:29] interesting pod/e2e-worker-w1-f9f277-openshift-default-869d58fb77-dllj5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.77:15021/healthz/ready\": dial tcp 10.132.0.77:15021: connect: connection refused" start-of-body=
Oct 30 21:00:06.394220 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:06.393746    6004 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-f9f277-openshift-default-869d58fb77-dllj5" podUID="c1a9de29-3987-4405-b4e0-c9c2586c4f96" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.77:15021/healthz/ready\": dial tcp 10.132.0.77:15021: connect: connection refused"
Oct 30 21:00:06.610204 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:06.609387    6004 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-d061d0-openshift-default-86b87f495-d8j6q" event={"ID":"54f45743-f6cf-4d8b-b3a5-e1064334eebc","Type":"ContainerStarted","Data":"d14fecce2a74e1a19a298a9521a85723ec961a4c917fa4ca9a17a419eb39d653"}
Oct 30 21:00:06.610204 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:06.609453    6004 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-d061d0-openshift-default-86b87f495-d8j6q" event={"ID":"54f45743-f6cf-4d8b-b3a5-e1064334eebc","Type":"ContainerStarted","Data":"75e0fd4daf1e8022e48b969bd3d94462070ccd31b888a78d986bd5ed204bd1f6"}
Oct 30 21:00:06.611423 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:06.611392    6004 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-1fdaa7-openshift-default-84586db7d5-gt5hd" event={"ID":"21525b82-87c7-4c9e-91fc-6070f3973861","Type":"ContainerStarted","Data":"0d48ae75b253bef0001280b4808a7399171e1a43a3ac0e09c725ac34fffdb652"}
Oct 30 21:00:06.756073 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:06.755836    6004 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w2-d061d0-openshift-default-86b87f495-d8j6q" podStartSLOduration=4.755814383 podStartE2EDuration="4.755814383s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:00:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:00:06.752592467 +0000 UTC m=+1312.672378586" watchObservedRunningTime="2026-10-30 21:00:06.755814383 +0000 UTC m=+1312.675600502"
Oct 30 21:00:06.804737 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:06.803094    6004 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w4-1fdaa7-openshift-default-84586db7d5-gt5hd"
Oct 30 21:00:06.810079 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:06.805181    6004 patch_prober.go:29] interesting pod/e2e-worker-w4-1fdaa7-openshift-default-84586db7d5-gt5hd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.78:15021/healthz/ready\": dial tcp 10.132.0.78:15021: connect: connection refused" start-of-body=
Oct 30 21:00:06.810079 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:06.805237    6004 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-1fdaa7-openshift-default-84586db7d5-gt5hd" podUID="21525b82-87c7-4c9e-91fc-6070f3973861" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.78:15021/healthz/ready\": dial tcp 10.132.0.78:15021: connect: connection refused"
Oct 30 21:00:07.089231 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:07.040184    6004 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w2-d061d0-openshift-default-86b87f495-d8j6q"
Oct 30 21:00:07.089231 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:07.046247    6004 patch_prober.go:29] interesting pod/e2e-worker-w2-d061d0-openshift-default-86b87f495-d8j6q container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.79:15021/healthz/ready\": dial tcp 10.132.0.79:15021: connect: connection refused" start-of-body=
Oct 30 21:00:07.089231 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:07.046301    6004 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-d061d0-openshift-default-86b87f495-d8j6q" podUID="54f45743-f6cf-4d8b-b3a5-e1064334eebc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.79:15021/healthz/ready\": dial tcp 10.132.0.79:15021: connect: connection refused"
Oct 30 21:00:07.504073 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:07.491791    6004 patch_prober.go:29] interesting pod/e2e-worker-w1-f9f277-openshift-default-869d58fb77-dllj5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.77:15021/healthz/ready\": dial tcp 10.132.0.77:15021: connect: connection refused" start-of-body=
Oct 30 21:00:07.504073 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:07.491851    6004 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-f9f277-openshift-default-869d58fb77-dllj5" podUID="c1a9de29-3987-4405-b4e0-c9c2586c4f96" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.77:15021/healthz/ready\": dial tcp 10.132.0.77:15021: connect: connection refused"
Oct 30 21:00:07.841131 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:07.817068    6004 patch_prober.go:29] interesting pod/e2e-worker-w4-1fdaa7-openshift-default-84586db7d5-gt5hd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.78:15021/healthz/ready\": dial tcp 10.132.0.78:15021: connect: connection refused" start-of-body=
Oct 30 21:00:07.841131 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:07.817128    6004 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-1fdaa7-openshift-default-84586db7d5-gt5hd" podUID="21525b82-87c7-4c9e-91fc-6070f3973861" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.78:15021/healthz/ready\": dial tcp 10.132.0.78:15021: connect: connection refused"
Oct 30 21:00:08.069077 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:08.050928    6004 patch_prober.go:29] interesting pod/e2e-worker-w2-d061d0-openshift-default-86b87f495-d8j6q container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.79:15021/healthz/ready\": dial tcp 10.132.0.79:15021: connect: connection refused" start-of-body=
Oct 30 21:00:08.069077 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:08.050985    6004 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-d061d0-openshift-default-86b87f495-d8j6q" podUID="54f45743-f6cf-4d8b-b3a5-e1064334eebc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.79:15021/healthz/ready\": dial tcp 10.132.0.79:15021: connect: connection refused"
Oct 30 21:00:08.406076 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:08.405712    6004 patch_prober.go:29] interesting pod/e2e-worker-w1-f9f277-openshift-default-869d58fb77-dllj5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.77:15021/healthz/ready\": dial tcp 10.132.0.77:15021: connect: connection refused" start-of-body=
Oct 30 21:00:08.406076 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:08.405795    6004 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-f9f277-openshift-default-869d58fb77-dllj5" podUID="c1a9de29-3987-4405-b4e0-c9c2586c4f96" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.77:15021/healthz/ready\": dial tcp 10.132.0.77:15021: connect: connection refused"
Oct 30 21:00:08.796076 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:08.791643    6004 patch_prober.go:29] interesting pod/e2e-worker-w4-1fdaa7-openshift-default-84586db7d5-gt5hd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.78:15021/healthz/ready\": dial tcp 10.132.0.78:15021: connect: connection refused" start-of-body=
Oct 30 21:00:08.796076 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:08.791723    6004 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-1fdaa7-openshift-default-84586db7d5-gt5hd" podUID="21525b82-87c7-4c9e-91fc-6070f3973861" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.78:15021/healthz/ready\": dial tcp 10.132.0.78:15021: connect: connection refused"
Oct 30 21:00:09.059267 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:09.059159    6004 patch_prober.go:29] interesting pod/e2e-worker-w2-d061d0-openshift-default-86b87f495-d8j6q container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.79:15021/healthz/ready\": dial tcp 10.132.0.79:15021: connect: connection refused" start-of-body=
Oct 30 21:00:09.059687 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:09.059546    6004 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-d061d0-openshift-default-86b87f495-d8j6q" podUID="54f45743-f6cf-4d8b-b3a5-e1064334eebc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.79:15021/healthz/ready\": dial tcp 10.132.0.79:15021: connect: connection refused"
Oct 30 21:00:09.402132 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:09.396398    6004 patch_prober.go:29] interesting pod/e2e-worker-w1-f9f277-openshift-default-869d58fb77-dllj5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.77:15021/healthz/ready\": dial tcp 10.132.0.77:15021: connect: connection refused" start-of-body=
Oct 30 21:00:09.402132 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:09.396487    6004 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-f9f277-openshift-default-869d58fb77-dllj5" podUID="c1a9de29-3987-4405-b4e0-c9c2586c4f96" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.77:15021/healthz/ready\": dial tcp 10.132.0.77:15021: connect: connection refused"
Oct 30 21:00:09.793073 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:09.792189    6004 patch_prober.go:29] interesting pod/e2e-worker-w4-1fdaa7-openshift-default-84586db7d5-gt5hd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.78:15021/healthz/ready\": dial tcp 10.132.0.78:15021: connect: connection refused" start-of-body=
Oct 30 21:00:09.793073 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:09.792251    6004 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-1fdaa7-openshift-default-84586db7d5-gt5hd" podUID="21525b82-87c7-4c9e-91fc-6070f3973861" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.78:15021/healthz/ready\": dial tcp 10.132.0.78:15021: connect: connection refused"
Oct 30 21:00:10.072133 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:10.058174    6004 patch_prober.go:29] interesting pod/e2e-worker-w2-d061d0-openshift-default-86b87f495-d8j6q container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.79:15021/healthz/ready\": dial tcp 10.132.0.79:15021: connect: connection refused" start-of-body=
Oct 30 21:00:10.072133 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:10.058242    6004 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-d061d0-openshift-default-86b87f495-d8j6q" podUID="54f45743-f6cf-4d8b-b3a5-e1064334eebc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.79:15021/healthz/ready\": dial tcp 10.132.0.79:15021: connect: connection refused"
Oct 30 21:00:10.399124 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:10.398930    6004 patch_prober.go:29] interesting pod/e2e-worker-w1-f9f277-openshift-default-869d58fb77-dllj5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.77:15021/healthz/ready\": dial tcp 10.132.0.77:15021: connect: connection refused" start-of-body=
Oct 30 21:00:10.399124 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:10.399022    6004 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-f9f277-openshift-default-869d58fb77-dllj5" podUID="c1a9de29-3987-4405-b4e0-c9c2586c4f96" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.77:15021/healthz/ready\": dial tcp 10.132.0.77:15021: connect: connection refused"
Oct 30 21:00:10.811834 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:10.811780    6004 patch_prober.go:29] interesting pod/e2e-worker-w4-1fdaa7-openshift-default-84586db7d5-gt5hd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.78:15021/healthz/ready\": dial tcp 10.132.0.78:15021: connect: connection refused" start-of-body=
Oct 30 21:00:10.811834 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:10.811835    6004 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-1fdaa7-openshift-default-84586db7d5-gt5hd" podUID="21525b82-87c7-4c9e-91fc-6070f3973861" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.78:15021/healthz/ready\": dial tcp 10.132.0.78:15021: connect: connection refused"
Oct 30 21:00:11.041077 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:11.038362    6004 patch_prober.go:29] interesting pod/e2e-worker-w2-d061d0-openshift-default-86b87f495-d8j6q container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.79:15021/healthz/ready\": dial tcp 10.132.0.79:15021: connect: connection refused" start-of-body=
Oct 30 21:00:11.041077 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:11.038435    6004 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-d061d0-openshift-default-86b87f495-d8j6q" podUID="54f45743-f6cf-4d8b-b3a5-e1064334eebc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.79:15021/healthz/ready\": dial tcp 10.132.0.79:15021: connect: connection refused"
Oct 30 21:00:11.408422 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:11.408382    6004 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w1-f9f277-openshift-default-869d58fb77-dllj5"
Oct 30 21:00:11.409383 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:11.409359    6004 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w1-f9f277-openshift-default-869d58fb77-dllj5"
Oct 30 21:00:11.410405 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:11.410377    6004 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w1-f9f277-openshift-default-869d58fb77-dllj5"
Oct 30 21:00:11.685071 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:11.681338    6004 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w4-1fdaa7-openshift-default-84586db7d5-gt5hd" podStartSLOduration=9.681313273 podStartE2EDuration="9.681313273s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:00:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:00:06.900117753 +0000 UTC m=+1312.819903874" watchObservedRunningTime="2026-10-30 21:00:11.681313273 +0000 UTC m=+1317.601099392"
Oct 30 21:00:11.813704 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:11.813659    6004 patch_prober.go:29] interesting pod/e2e-worker-w4-1fdaa7-openshift-default-84586db7d5-gt5hd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.78:15021/healthz/ready\": dial tcp 10.132.0.78:15021: connect: connection refused" start-of-body=
Oct 30 21:00:11.813899 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:11.813812    6004 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-1fdaa7-openshift-default-84586db7d5-gt5hd" podUID="21525b82-87c7-4c9e-91fc-6070f3973861" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.78:15021/healthz/ready\": dial tcp 10.132.0.78:15021: connect: connection refused"
Oct 30 21:00:12.047136 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:12.046516    6004 patch_prober.go:29] interesting pod/e2e-worker-w2-d061d0-openshift-default-86b87f495-d8j6q container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.79:15021/healthz/ready\": dial tcp 10.132.0.79:15021: connect: connection refused" start-of-body=
Oct 30 21:00:12.047136 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:12.046595    6004 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-d061d0-openshift-default-86b87f495-d8j6q" podUID="54f45743-f6cf-4d8b-b3a5-e1064334eebc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.79:15021/healthz/ready\": dial tcp 10.132.0.79:15021: connect: connection refused"
Oct 30 21:00:12.790478 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:12.790440    6004 patch_prober.go:29] interesting pod/e2e-worker-w4-1fdaa7-openshift-default-84586db7d5-gt5hd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.78:15021/healthz/ready\": dial tcp 10.132.0.78:15021: connect: connection refused" start-of-body=
Oct 30 21:00:12.791026 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:12.790501    6004 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-1fdaa7-openshift-default-84586db7d5-gt5hd" podUID="21525b82-87c7-4c9e-91fc-6070f3973861" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.78:15021/healthz/ready\": dial tcp 10.132.0.78:15021: connect: connection refused"
Oct 30 21:00:13.037073 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:13.037018    6004 patch_prober.go:29] interesting pod/e2e-worker-w2-d061d0-openshift-default-86b87f495-d8j6q container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.79:15021/healthz/ready\": dial tcp 10.132.0.79:15021: connect: connection refused" start-of-body=
Oct 30 21:00:13.037271 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:13.037113    6004 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-d061d0-openshift-default-86b87f495-d8j6q" podUID="54f45743-f6cf-4d8b-b3a5-e1064334eebc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.79:15021/healthz/ready\": dial tcp 10.132.0.79:15021: connect: connection refused"
Oct 30 21:00:13.796483 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:13.796446    6004 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w4-1fdaa7-openshift-default-84586db7d5-gt5hd"
Oct 30 21:00:13.797309 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:13.797283    6004 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w4-1fdaa7-openshift-default-84586db7d5-gt5hd"
Oct 30 21:00:13.798190 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:13.798162    6004 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w4-1fdaa7-openshift-default-84586db7d5-gt5hd"
Oct 30 21:00:14.045249 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:14.045215    6004 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w2-d061d0-openshift-default-86b87f495-d8j6q"
Oct 30 21:00:14.046558 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:14.046491    6004 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w2-d061d0-openshift-default-86b87f495-d8j6q"
Oct 30 21:00:14.047393 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:14.047366    6004 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w2-d061d0-openshift-default-86b87f495-d8j6q"
Oct 30 21:00:14.289757 ip-10-0-138-85 kubenswrapper[6004]: E1030 21:00:14.289724    6004 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-zz4wr" containerName="extractor"
Oct 30 21:00:17.859186 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:17.859147    6004 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w2-d061d0-openshift-default-86b87f495-w45rb"]
Oct 30 21:00:17.865385 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:17.865360    6004 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-d061d0-openshift-default-86b87f495-w45rb"
Oct 30 21:00:17.929264 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:17.929231    6004 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w2-d061d0-openshift-default-86b87f495-w45rb"]
Oct 30 21:00:18.015251 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:18.015218    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9ad52be5-bae9-4663-a915-2d4374812459-istio-envoy\") pod \"e2e-worker-w2-d061d0-openshift-default-86b87f495-w45rb\" (UID: \"9ad52be5-bae9-4663-a915-2d4374812459\") " pod="openshift-ingress/e2e-worker-w2-d061d0-openshift-default-86b87f495-w45rb"
Oct 30 21:00:18.015424 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:18.015256    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9ad52be5-bae9-4663-a915-2d4374812459-istiod-ca-cert\") pod \"e2e-worker-w2-d061d0-openshift-default-86b87f495-w45rb\" (UID: \"9ad52be5-bae9-4663-a915-2d4374812459\") " pod="openshift-ingress/e2e-worker-w2-d061d0-openshift-default-86b87f495-w45rb"
Oct 30 21:00:18.015424 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:18.015347    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9ad52be5-bae9-4663-a915-2d4374812459-istio-podinfo\") pod \"e2e-worker-w2-d061d0-openshift-default-86b87f495-w45rb\" (UID: \"9ad52be5-bae9-4663-a915-2d4374812459\") " pod="openshift-ingress/e2e-worker-w2-d061d0-openshift-default-86b87f495-w45rb"
Oct 30 21:00:18.015525 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:18.015509    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9ad52be5-bae9-4663-a915-2d4374812459-workload-certs\") pod \"e2e-worker-w2-d061d0-openshift-default-86b87f495-w45rb\" (UID: \"9ad52be5-bae9-4663-a915-2d4374812459\") " pod="openshift-ingress/e2e-worker-w2-d061d0-openshift-default-86b87f495-w45rb"
Oct 30 21:00:18.015565 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:18.015532    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9ad52be5-bae9-4663-a915-2d4374812459-istio-data\") pod \"e2e-worker-w2-d061d0-openshift-default-86b87f495-w45rb\" (UID: \"9ad52be5-bae9-4663-a915-2d4374812459\") " pod="openshift-ingress/e2e-worker-w2-d061d0-openshift-default-86b87f495-w45rb"
Oct 30 21:00:18.015659 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:18.015631    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rds2n\" (UniqueName: \"kubernetes.io/projected/9ad52be5-bae9-4663-a915-2d4374812459-kube-api-access-rds2n\") pod \"e2e-worker-w2-d061d0-openshift-default-86b87f495-w45rb\" (UID: \"9ad52be5-bae9-4663-a915-2d4374812459\") " pod="openshift-ingress/e2e-worker-w2-d061d0-openshift-default-86b87f495-w45rb"
Oct 30 21:00:18.015779 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:18.015675    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9ad52be5-bae9-4663-a915-2d4374812459-istio-token\") pod \"e2e-worker-w2-d061d0-openshift-default-86b87f495-w45rb\" (UID: \"9ad52be5-bae9-4663-a915-2d4374812459\") " pod="openshift-ingress/e2e-worker-w2-d061d0-openshift-default-86b87f495-w45rb"
Oct 30 21:00:18.015779 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:18.015696    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9ad52be5-bae9-4663-a915-2d4374812459-credential-socket\") pod \"e2e-worker-w2-d061d0-openshift-default-86b87f495-w45rb\" (UID: \"9ad52be5-bae9-4663-a915-2d4374812459\") " pod="openshift-ingress/e2e-worker-w2-d061d0-openshift-default-86b87f495-w45rb"
Oct 30 21:00:18.015779 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:18.015731    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9ad52be5-bae9-4663-a915-2d4374812459-workload-socket\") pod \"e2e-worker-w2-d061d0-openshift-default-86b87f495-w45rb\" (UID: \"9ad52be5-bae9-4663-a915-2d4374812459\") " pod="openshift-ingress/e2e-worker-w2-d061d0-openshift-default-86b87f495-w45rb"
Oct 30 21:00:18.116861 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:18.116764    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9ad52be5-bae9-4663-a915-2d4374812459-workload-certs\") pod \"e2e-worker-w2-d061d0-openshift-default-86b87f495-w45rb\" (UID: \"9ad52be5-bae9-4663-a915-2d4374812459\") " pod="openshift-ingress/e2e-worker-w2-d061d0-openshift-default-86b87f495-w45rb"
Oct 30 21:00:18.116861 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:18.116808    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9ad52be5-bae9-4663-a915-2d4374812459-istio-data\") pod \"e2e-worker-w2-d061d0-openshift-default-86b87f495-w45rb\" (UID: \"9ad52be5-bae9-4663-a915-2d4374812459\") " pod="openshift-ingress/e2e-worker-w2-d061d0-openshift-default-86b87f495-w45rb"
Oct 30 21:00:18.117131 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:18.116895    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rds2n\" (UniqueName: \"kubernetes.io/projected/9ad52be5-bae9-4663-a915-2d4374812459-kube-api-access-rds2n\") pod \"e2e-worker-w2-d061d0-openshift-default-86b87f495-w45rb\" (UID: \"9ad52be5-bae9-4663-a915-2d4374812459\") " pod="openshift-ingress/e2e-worker-w2-d061d0-openshift-default-86b87f495-w45rb"
Oct 30 21:00:18.117131 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:18.116922    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9ad52be5-bae9-4663-a915-2d4374812459-istio-token\") pod \"e2e-worker-w2-d061d0-openshift-default-86b87f495-w45rb\" (UID: \"9ad52be5-bae9-4663-a915-2d4374812459\") " pod="openshift-ingress/e2e-worker-w2-d061d0-openshift-default-86b87f495-w45rb"
Oct 30 21:00:18.117131 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:18.116948    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9ad52be5-bae9-4663-a915-2d4374812459-credential-socket\") pod \"e2e-worker-w2-d061d0-openshift-default-86b87f495-w45rb\" (UID: \"9ad52be5-bae9-4663-a915-2d4374812459\") " pod="openshift-ingress/e2e-worker-w2-d061d0-openshift-default-86b87f495-w45rb"
Oct 30 21:00:18.117131 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:18.116996    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9ad52be5-bae9-4663-a915-2d4374812459-workload-socket\") pod \"e2e-worker-w2-d061d0-openshift-default-86b87f495-w45rb\" (UID: \"9ad52be5-bae9-4663-a915-2d4374812459\") " pod="openshift-ingress/e2e-worker-w2-d061d0-openshift-default-86b87f495-w45rb"
Oct 30 21:00:18.117131 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:18.117091    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9ad52be5-bae9-4663-a915-2d4374812459-istio-envoy\") pod \"e2e-worker-w2-d061d0-openshift-default-86b87f495-w45rb\" (UID: \"9ad52be5-bae9-4663-a915-2d4374812459\") " pod="openshift-ingress/e2e-worker-w2-d061d0-openshift-default-86b87f495-w45rb"
Oct 30 21:00:18.117131 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:18.117122    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9ad52be5-bae9-4663-a915-2d4374812459-istiod-ca-cert\") pod \"e2e-worker-w2-d061d0-openshift-default-86b87f495-w45rb\" (UID: \"9ad52be5-bae9-4663-a915-2d4374812459\") " pod="openshift-ingress/e2e-worker-w2-d061d0-openshift-default-86b87f495-w45rb"
Oct 30 21:00:18.117475 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:18.117166    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9ad52be5-bae9-4663-a915-2d4374812459-istio-podinfo\") pod \"e2e-worker-w2-d061d0-openshift-default-86b87f495-w45rb\" (UID: \"9ad52be5-bae9-4663-a915-2d4374812459\") " pod="openshift-ingress/e2e-worker-w2-d061d0-openshift-default-86b87f495-w45rb"
Oct 30 21:00:18.117475 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:18.117274    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9ad52be5-bae9-4663-a915-2d4374812459-workload-certs\") pod \"e2e-worker-w2-d061d0-openshift-default-86b87f495-w45rb\" (UID: \"9ad52be5-bae9-4663-a915-2d4374812459\") " pod="openshift-ingress/e2e-worker-w2-d061d0-openshift-default-86b87f495-w45rb"
Oct 30 21:00:18.117475 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:18.117289    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9ad52be5-bae9-4663-a915-2d4374812459-istio-data\") pod \"e2e-worker-w2-d061d0-openshift-default-86b87f495-w45rb\" (UID: \"9ad52be5-bae9-4663-a915-2d4374812459\") " pod="openshift-ingress/e2e-worker-w2-d061d0-openshift-default-86b87f495-w45rb"
Oct 30 21:00:18.117475 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:18.117390    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9ad52be5-bae9-4663-a915-2d4374812459-credential-socket\") pod \"e2e-worker-w2-d061d0-openshift-default-86b87f495-w45rb\" (UID: \"9ad52be5-bae9-4663-a915-2d4374812459\") " pod="openshift-ingress/e2e-worker-w2-d061d0-openshift-default-86b87f495-w45rb"
Oct 30 21:00:18.117741 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:18.117645    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9ad52be5-bae9-4663-a915-2d4374812459-workload-socket\") pod \"e2e-worker-w2-d061d0-openshift-default-86b87f495-w45rb\" (UID: \"9ad52be5-bae9-4663-a915-2d4374812459\") " pod="openshift-ingress/e2e-worker-w2-d061d0-openshift-default-86b87f495-w45rb"
Oct 30 21:00:18.117923 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:18.117891    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9ad52be5-bae9-4663-a915-2d4374812459-istiod-ca-cert\") pod \"e2e-worker-w2-d061d0-openshift-default-86b87f495-w45rb\" (UID: \"9ad52be5-bae9-4663-a915-2d4374812459\") " pod="openshift-ingress/e2e-worker-w2-d061d0-openshift-default-86b87f495-w45rb"
Oct 30 21:00:18.119738 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:18.119709    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9ad52be5-bae9-4663-a915-2d4374812459-istio-envoy\") pod \"e2e-worker-w2-d061d0-openshift-default-86b87f495-w45rb\" (UID: \"9ad52be5-bae9-4663-a915-2d4374812459\") " pod="openshift-ingress/e2e-worker-w2-d061d0-openshift-default-86b87f495-w45rb"
Oct 30 21:00:18.119942 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:18.119926    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9ad52be5-bae9-4663-a915-2d4374812459-istio-podinfo\") pod \"e2e-worker-w2-d061d0-openshift-default-86b87f495-w45rb\" (UID: \"9ad52be5-bae9-4663-a915-2d4374812459\") " pod="openshift-ingress/e2e-worker-w2-d061d0-openshift-default-86b87f495-w45rb"
Oct 30 21:00:18.179288 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:18.179257    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9ad52be5-bae9-4663-a915-2d4374812459-istio-token\") pod \"e2e-worker-w2-d061d0-openshift-default-86b87f495-w45rb\" (UID: \"9ad52be5-bae9-4663-a915-2d4374812459\") " pod="openshift-ingress/e2e-worker-w2-d061d0-openshift-default-86b87f495-w45rb"
Oct 30 21:00:18.180226 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:18.180205    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rds2n\" (UniqueName: \"kubernetes.io/projected/9ad52be5-bae9-4663-a915-2d4374812459-kube-api-access-rds2n\") pod \"e2e-worker-w2-d061d0-openshift-default-86b87f495-w45rb\" (UID: \"9ad52be5-bae9-4663-a915-2d4374812459\") " pod="openshift-ingress/e2e-worker-w2-d061d0-openshift-default-86b87f495-w45rb"
Oct 30 21:00:18.479139 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:18.479104    6004 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-d061d0-openshift-default-86b87f495-w45rb"
Oct 30 21:00:18.916567 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:18.916538    6004 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w2-d061d0-openshift-default-86b87f495-w45rb"]
Oct 30 21:00:18.917585 ip-10-0-138-85 kubenswrapper[6004]: W1030 21:00:18.917555    6004 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9ad52be5_bae9_4663_a915_2d4374812459.slice/crio-3b2e9f22548d5f70e86314f5ff152924c97ec75969de1d1b76e8d97b2d4eb9a0 WatchSource:0}: Error finding container 3b2e9f22548d5f70e86314f5ff152924c97ec75969de1d1b76e8d97b2d4eb9a0: Status 404 returned error can't find the container with id 3b2e9f22548d5f70e86314f5ff152924c97ec75969de1d1b76e8d97b2d4eb9a0
Oct 30 21:00:18.920175 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:18.920139    6004 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 21:00:18.920270 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:18.920210    6004 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 21:00:18.920270 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:18.920246    6004 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 21:00:19.880789 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:19.880748    6004 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-d061d0-openshift-default-86b87f495-w45rb" event={"ID":"9ad52be5-bae9-4663-a915-2d4374812459","Type":"ContainerStarted","Data":"0eb22303d9ff4545629ae98cec5e23bc7622a9c12d6b79abd21d2b7a25d1ca9f"}
Oct 30 21:00:19.880998 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:19.880810    6004 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-d061d0-openshift-default-86b87f495-w45rb" event={"ID":"9ad52be5-bae9-4663-a915-2d4374812459","Type":"ContainerStarted","Data":"3b2e9f22548d5f70e86314f5ff152924c97ec75969de1d1b76e8d97b2d4eb9a0"}
Oct 30 21:00:20.054073 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:20.053518    6004 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w2-d061d0-openshift-default-86b87f495-w45rb" podStartSLOduration=3.053497391 podStartE2EDuration="3.053497391s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:00:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:00:20.048529366 +0000 UTC m=+1325.968315486" watchObservedRunningTime="2026-10-30 21:00:20.053497391 +0000 UTC m=+1325.973283511"
Oct 30 21:00:20.479796 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:20.479757    6004 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w2-d061d0-openshift-default-86b87f495-w45rb"
Oct 30 21:00:20.481316 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:20.481283    6004 patch_prober.go:29] interesting pod/e2e-worker-w2-d061d0-openshift-default-86b87f495-w45rb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.80:15021/healthz/ready\": dial tcp 10.132.0.80:15021: connect: connection refused" start-of-body=
Oct 30 21:00:20.481463 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:20.481341    6004 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-d061d0-openshift-default-86b87f495-w45rb" podUID="9ad52be5-bae9-4663-a915-2d4374812459" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.80:15021/healthz/ready\": dial tcp 10.132.0.80:15021: connect: connection refused"
Oct 30 21:00:21.479488 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:21.479439    6004 patch_prober.go:29] interesting pod/e2e-worker-w2-d061d0-openshift-default-86b87f495-w45rb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.80:15021/healthz/ready\": dial tcp 10.132.0.80:15021: connect: connection refused" start-of-body=
Oct 30 21:00:21.479924 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:21.479507    6004 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-d061d0-openshift-default-86b87f495-w45rb" podUID="9ad52be5-bae9-4663-a915-2d4374812459" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.80:15021/healthz/ready\": dial tcp 10.132.0.80:15021: connect: connection refused"
Oct 30 21:00:22.480377 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:22.480343    6004 patch_prober.go:29] interesting pod/e2e-worker-w2-d061d0-openshift-default-86b87f495-w45rb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.80:15021/healthz/ready\": dial tcp 10.132.0.80:15021: connect: connection refused" start-of-body=
Oct 30 21:00:22.480835 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:22.480805    6004 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-d061d0-openshift-default-86b87f495-w45rb" podUID="9ad52be5-bae9-4663-a915-2d4374812459" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.80:15021/healthz/ready\": dial tcp 10.132.0.80:15021: connect: connection refused"
Oct 30 21:00:23.479600 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:23.479566    6004 patch_prober.go:29] interesting pod/e2e-worker-w2-d061d0-openshift-default-86b87f495-w45rb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.80:15021/healthz/ready\": dial tcp 10.132.0.80:15021: connect: connection refused" start-of-body=
Oct 30 21:00:23.479790 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:23.479653    6004 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-d061d0-openshift-default-86b87f495-w45rb" podUID="9ad52be5-bae9-4663-a915-2d4374812459" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.80:15021/healthz/ready\": dial tcp 10.132.0.80:15021: connect: connection refused"
Oct 30 21:00:24.479472 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:24.479424    6004 patch_prober.go:29] interesting pod/e2e-worker-w2-d061d0-openshift-default-86b87f495-w45rb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.80:15021/healthz/ready\": dial tcp 10.132.0.80:15021: connect: connection refused" start-of-body=
Oct 30 21:00:24.479983 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:24.479490    6004 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-d061d0-openshift-default-86b87f495-w45rb" podUID="9ad52be5-bae9-4663-a915-2d4374812459" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.80:15021/healthz/ready\": dial tcp 10.132.0.80:15021: connect: connection refused"
Oct 30 21:00:25.479551 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:25.479514    6004 patch_prober.go:29] interesting pod/e2e-worker-w2-d061d0-openshift-default-86b87f495-w45rb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.80:15021/healthz/ready\": dial tcp 10.132.0.80:15021: connect: connection refused" start-of-body=
Oct 30 21:00:25.479928 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:25.479564    6004 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-d061d0-openshift-default-86b87f495-w45rb" podUID="9ad52be5-bae9-4663-a915-2d4374812459" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.80:15021/healthz/ready\": dial tcp 10.132.0.80:15021: connect: connection refused"
Oct 30 21:00:26.485602 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:26.485567    6004 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w2-d061d0-openshift-default-86b87f495-w45rb"
Oct 30 21:00:26.486315 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:26.486287    6004 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w2-d061d0-openshift-default-86b87f495-w45rb"
Oct 30 21:00:26.487095 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:26.487061    6004 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w2-d061d0-openshift-default-86b87f495-w45rb"
Oct 30 21:00:32.480147 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:32.480107    6004 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w5-2b425d-openshift-default-f547dbcbf-v9wp8"]
Oct 30 21:00:32.484191 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:32.484168    6004 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-2b425d-openshift-default-f547dbcbf-v9wp8"
Oct 30 21:00:32.528701 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:32.528669    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2f468858-dc38-49e9-a978-cd859ba366dd-istio-token\") pod \"e2e-worker-w5-2b425d-openshift-default-f547dbcbf-v9wp8\" (UID: \"2f468858-dc38-49e9-a978-cd859ba366dd\") " pod="openshift-ingress/e2e-worker-w5-2b425d-openshift-default-f547dbcbf-v9wp8"
Oct 30 21:00:32.528889 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:32.528722    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2f468858-dc38-49e9-a978-cd859ba366dd-istio-envoy\") pod \"e2e-worker-w5-2b425d-openshift-default-f547dbcbf-v9wp8\" (UID: \"2f468858-dc38-49e9-a978-cd859ba366dd\") " pod="openshift-ingress/e2e-worker-w5-2b425d-openshift-default-f547dbcbf-v9wp8"
Oct 30 21:00:32.528889 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:32.528843    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2f468858-dc38-49e9-a978-cd859ba366dd-istio-podinfo\") pod \"e2e-worker-w5-2b425d-openshift-default-f547dbcbf-v9wp8\" (UID: \"2f468858-dc38-49e9-a978-cd859ba366dd\") " pod="openshift-ingress/e2e-worker-w5-2b425d-openshift-default-f547dbcbf-v9wp8"
Oct 30 21:00:32.528985 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:32.528897    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2f468858-dc38-49e9-a978-cd859ba366dd-credential-socket\") pod \"e2e-worker-w5-2b425d-openshift-default-f547dbcbf-v9wp8\" (UID: \"2f468858-dc38-49e9-a978-cd859ba366dd\") " pod="openshift-ingress/e2e-worker-w5-2b425d-openshift-default-f547dbcbf-v9wp8"
Oct 30 21:00:32.529023 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:32.529005    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2f468858-dc38-49e9-a978-cd859ba366dd-workload-socket\") pod \"e2e-worker-w5-2b425d-openshift-default-f547dbcbf-v9wp8\" (UID: \"2f468858-dc38-49e9-a978-cd859ba366dd\") " pod="openshift-ingress/e2e-worker-w5-2b425d-openshift-default-f547dbcbf-v9wp8"
Oct 30 21:00:32.529158 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:32.529142    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4dw94\" (UniqueName: \"kubernetes.io/projected/2f468858-dc38-49e9-a978-cd859ba366dd-kube-api-access-4dw94\") pod \"e2e-worker-w5-2b425d-openshift-default-f547dbcbf-v9wp8\" (UID: \"2f468858-dc38-49e9-a978-cd859ba366dd\") " pod="openshift-ingress/e2e-worker-w5-2b425d-openshift-default-f547dbcbf-v9wp8"
Oct 30 21:00:32.529205 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:32.529169    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2f468858-dc38-49e9-a978-cd859ba366dd-istiod-ca-cert\") pod \"e2e-worker-w5-2b425d-openshift-default-f547dbcbf-v9wp8\" (UID: \"2f468858-dc38-49e9-a978-cd859ba366dd\") " pod="openshift-ingress/e2e-worker-w5-2b425d-openshift-default-f547dbcbf-v9wp8"
Oct 30 21:00:32.529250 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:32.529213    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2f468858-dc38-49e9-a978-cd859ba366dd-istio-data\") pod \"e2e-worker-w5-2b425d-openshift-default-f547dbcbf-v9wp8\" (UID: \"2f468858-dc38-49e9-a978-cd859ba366dd\") " pod="openshift-ingress/e2e-worker-w5-2b425d-openshift-default-f547dbcbf-v9wp8"
Oct 30 21:00:32.529382 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:32.529359    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2f468858-dc38-49e9-a978-cd859ba366dd-workload-certs\") pod \"e2e-worker-w5-2b425d-openshift-default-f547dbcbf-v9wp8\" (UID: \"2f468858-dc38-49e9-a978-cd859ba366dd\") " pod="openshift-ingress/e2e-worker-w5-2b425d-openshift-default-f547dbcbf-v9wp8"
Oct 30 21:00:32.530850 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:32.530830    6004 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w5-2b425d-openshift-default-f547dbcbf-mjdrq"]
Oct 30 21:00:32.534956 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:32.534935    6004 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-2b425d-openshift-default-f547dbcbf-mjdrq"
Oct 30 21:00:32.584705 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:32.584666    6004 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w5-2b425d-openshift-default-f547dbcbf-v9wp8"]
Oct 30 21:00:32.630508 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:32.630469    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2f468858-dc38-49e9-a978-cd859ba366dd-istio-podinfo\") pod \"e2e-worker-w5-2b425d-openshift-default-f547dbcbf-v9wp8\" (UID: \"2f468858-dc38-49e9-a978-cd859ba366dd\") " pod="openshift-ingress/e2e-worker-w5-2b425d-openshift-default-f547dbcbf-v9wp8"
Oct 30 21:00:32.630792 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:32.630759    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2f468858-dc38-49e9-a978-cd859ba366dd-credential-socket\") pod \"e2e-worker-w5-2b425d-openshift-default-f547dbcbf-v9wp8\" (UID: \"2f468858-dc38-49e9-a978-cd859ba366dd\") " pod="openshift-ingress/e2e-worker-w5-2b425d-openshift-default-f547dbcbf-v9wp8"
Oct 30 21:00:32.630977 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:32.630864    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2f468858-dc38-49e9-a978-cd859ba366dd-workload-socket\") pod \"e2e-worker-w5-2b425d-openshift-default-f547dbcbf-v9wp8\" (UID: \"2f468858-dc38-49e9-a978-cd859ba366dd\") " pod="openshift-ingress/e2e-worker-w5-2b425d-openshift-default-f547dbcbf-v9wp8"
Oct 30 21:00:32.630977 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:32.630909    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ebe091c6-036b-416b-9e66-a9f0cb3171a0-istio-podinfo\") pod \"e2e-worker-w5-2b425d-openshift-default-f547dbcbf-mjdrq\" (UID: \"ebe091c6-036b-416b-9e66-a9f0cb3171a0\") " pod="openshift-ingress/e2e-worker-w5-2b425d-openshift-default-f547dbcbf-mjdrq"
Oct 30 21:00:32.630977 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:32.630938    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ebe091c6-036b-416b-9e66-a9f0cb3171a0-istiod-ca-cert\") pod \"e2e-worker-w5-2b425d-openshift-default-f547dbcbf-mjdrq\" (UID: \"ebe091c6-036b-416b-9e66-a9f0cb3171a0\") " pod="openshift-ingress/e2e-worker-w5-2b425d-openshift-default-f547dbcbf-mjdrq"
Oct 30 21:00:32.631271 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:32.630989    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ebe091c6-036b-416b-9e66-a9f0cb3171a0-credential-socket\") pod \"e2e-worker-w5-2b425d-openshift-default-f547dbcbf-mjdrq\" (UID: \"ebe091c6-036b-416b-9e66-a9f0cb3171a0\") " pod="openshift-ingress/e2e-worker-w5-2b425d-openshift-default-f547dbcbf-mjdrq"
Oct 30 21:00:32.631271 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:32.631076    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ebe091c6-036b-416b-9e66-a9f0cb3171a0-istio-envoy\") pod \"e2e-worker-w5-2b425d-openshift-default-f547dbcbf-mjdrq\" (UID: \"ebe091c6-036b-416b-9e66-a9f0cb3171a0\") " pod="openshift-ingress/e2e-worker-w5-2b425d-openshift-default-f547dbcbf-mjdrq"
Oct 30 21:00:32.631271 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:32.631104    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ebe091c6-036b-416b-9e66-a9f0cb3171a0-istio-token\") pod \"e2e-worker-w5-2b425d-openshift-default-f547dbcbf-mjdrq\" (UID: \"ebe091c6-036b-416b-9e66-a9f0cb3171a0\") " pod="openshift-ingress/e2e-worker-w5-2b425d-openshift-default-f547dbcbf-mjdrq"
Oct 30 21:00:32.631271 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:32.631139    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4dw94\" (UniqueName: \"kubernetes.io/projected/2f468858-dc38-49e9-a978-cd859ba366dd-kube-api-access-4dw94\") pod \"e2e-worker-w5-2b425d-openshift-default-f547dbcbf-v9wp8\" (UID: \"2f468858-dc38-49e9-a978-cd859ba366dd\") " pod="openshift-ingress/e2e-worker-w5-2b425d-openshift-default-f547dbcbf-v9wp8"
Oct 30 21:00:32.631271 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:32.631169    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2f468858-dc38-49e9-a978-cd859ba366dd-istiod-ca-cert\") pod \"e2e-worker-w5-2b425d-openshift-default-f547dbcbf-v9wp8\" (UID: \"2f468858-dc38-49e9-a978-cd859ba366dd\") " pod="openshift-ingress/e2e-worker-w5-2b425d-openshift-default-f547dbcbf-v9wp8"
Oct 30 21:00:32.631271 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:32.631245    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2f468858-dc38-49e9-a978-cd859ba366dd-istio-data\") pod \"e2e-worker-w5-2b425d-openshift-default-f547dbcbf-v9wp8\" (UID: \"2f468858-dc38-49e9-a978-cd859ba366dd\") " pod="openshift-ingress/e2e-worker-w5-2b425d-openshift-default-f547dbcbf-v9wp8"
Oct 30 21:00:32.631671 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:32.631295    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ebe091c6-036b-416b-9e66-a9f0cb3171a0-workload-certs\") pod \"e2e-worker-w5-2b425d-openshift-default-f547dbcbf-mjdrq\" (UID: \"ebe091c6-036b-416b-9e66-a9f0cb3171a0\") " pod="openshift-ingress/e2e-worker-w5-2b425d-openshift-default-f547dbcbf-mjdrq"
Oct 30 21:00:32.631671 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:32.631334    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2f468858-dc38-49e9-a978-cd859ba366dd-workload-certs\") pod \"e2e-worker-w5-2b425d-openshift-default-f547dbcbf-v9wp8\" (UID: \"2f468858-dc38-49e9-a978-cd859ba366dd\") " pod="openshift-ingress/e2e-worker-w5-2b425d-openshift-default-f547dbcbf-v9wp8"
Oct 30 21:00:32.631671 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:32.631403    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2f468858-dc38-49e9-a978-cd859ba366dd-istio-token\") pod \"e2e-worker-w5-2b425d-openshift-default-f547dbcbf-v9wp8\" (UID: \"2f468858-dc38-49e9-a978-cd859ba366dd\") " pod="openshift-ingress/e2e-worker-w5-2b425d-openshift-default-f547dbcbf-v9wp8"
Oct 30 21:00:32.631671 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:32.631429    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ebe091c6-036b-416b-9e66-a9f0cb3171a0-workload-socket\") pod \"e2e-worker-w5-2b425d-openshift-default-f547dbcbf-mjdrq\" (UID: \"ebe091c6-036b-416b-9e66-a9f0cb3171a0\") " pod="openshift-ingress/e2e-worker-w5-2b425d-openshift-default-f547dbcbf-mjdrq"
Oct 30 21:00:32.632440 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:32.632411    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2f468858-dc38-49e9-a978-cd859ba366dd-istiod-ca-cert\") pod \"e2e-worker-w5-2b425d-openshift-default-f547dbcbf-v9wp8\" (UID: \"2f468858-dc38-49e9-a978-cd859ba366dd\") " pod="openshift-ingress/e2e-worker-w5-2b425d-openshift-default-f547dbcbf-v9wp8"
Oct 30 21:00:32.632440 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:32.632426    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2f468858-dc38-49e9-a978-cd859ba366dd-credential-socket\") pod \"e2e-worker-w5-2b425d-openshift-default-f547dbcbf-v9wp8\" (UID: \"2f468858-dc38-49e9-a978-cd859ba366dd\") " pod="openshift-ingress/e2e-worker-w5-2b425d-openshift-default-f547dbcbf-v9wp8"
Oct 30 21:00:32.632759 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:32.632737    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2f468858-dc38-49e9-a978-cd859ba366dd-istio-data\") pod \"e2e-worker-w5-2b425d-openshift-default-f547dbcbf-v9wp8\" (UID: \"2f468858-dc38-49e9-a978-cd859ba366dd\") " pod="openshift-ingress/e2e-worker-w5-2b425d-openshift-default-f547dbcbf-v9wp8"
Oct 30 21:00:32.632872 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:32.632816    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2f468858-dc38-49e9-a978-cd859ba366dd-workload-socket\") pod \"e2e-worker-w5-2b425d-openshift-default-f547dbcbf-v9wp8\" (UID: \"2f468858-dc38-49e9-a978-cd859ba366dd\") " pod="openshift-ingress/e2e-worker-w5-2b425d-openshift-default-f547dbcbf-v9wp8"
Oct 30 21:00:32.633544 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:32.632873    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dl56l\" (UniqueName: \"kubernetes.io/projected/ebe091c6-036b-416b-9e66-a9f0cb3171a0-kube-api-access-dl56l\") pod \"e2e-worker-w5-2b425d-openshift-default-f547dbcbf-mjdrq\" (UID: \"ebe091c6-036b-416b-9e66-a9f0cb3171a0\") " pod="openshift-ingress/e2e-worker-w5-2b425d-openshift-default-f547dbcbf-mjdrq"
Oct 30 21:00:32.633544 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:32.633041    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2f468858-dc38-49e9-a978-cd859ba366dd-workload-certs\") pod \"e2e-worker-w5-2b425d-openshift-default-f547dbcbf-v9wp8\" (UID: \"2f468858-dc38-49e9-a978-cd859ba366dd\") " pod="openshift-ingress/e2e-worker-w5-2b425d-openshift-default-f547dbcbf-v9wp8"
Oct 30 21:00:32.633544 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:32.633081    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2f468858-dc38-49e9-a978-cd859ba366dd-istio-envoy\") pod \"e2e-worker-w5-2b425d-openshift-default-f547dbcbf-v9wp8\" (UID: \"2f468858-dc38-49e9-a978-cd859ba366dd\") " pod="openshift-ingress/e2e-worker-w5-2b425d-openshift-default-f547dbcbf-v9wp8"
Oct 30 21:00:32.639107 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:32.635890    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2f468858-dc38-49e9-a978-cd859ba366dd-istio-envoy\") pod \"e2e-worker-w5-2b425d-openshift-default-f547dbcbf-v9wp8\" (UID: \"2f468858-dc38-49e9-a978-cd859ba366dd\") " pod="openshift-ingress/e2e-worker-w5-2b425d-openshift-default-f547dbcbf-v9wp8"
Oct 30 21:00:32.639107 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:32.635943    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ebe091c6-036b-416b-9e66-a9f0cb3171a0-istio-data\") pod \"e2e-worker-w5-2b425d-openshift-default-f547dbcbf-mjdrq\" (UID: \"ebe091c6-036b-416b-9e66-a9f0cb3171a0\") " pod="openshift-ingress/e2e-worker-w5-2b425d-openshift-default-f547dbcbf-mjdrq"
Oct 30 21:00:32.639107 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:32.636343    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2f468858-dc38-49e9-a978-cd859ba366dd-istio-podinfo\") pod \"e2e-worker-w5-2b425d-openshift-default-f547dbcbf-v9wp8\" (UID: \"2f468858-dc38-49e9-a978-cd859ba366dd\") " pod="openshift-ingress/e2e-worker-w5-2b425d-openshift-default-f547dbcbf-v9wp8"
Oct 30 21:00:32.642556 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:32.642415    6004 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w5-2b425d-openshift-default-f547dbcbf-mjdrq"]
Oct 30 21:00:32.689270 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:32.689242    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4dw94\" (UniqueName: \"kubernetes.io/projected/2f468858-dc38-49e9-a978-cd859ba366dd-kube-api-access-4dw94\") pod \"e2e-worker-w5-2b425d-openshift-default-f547dbcbf-v9wp8\" (UID: \"2f468858-dc38-49e9-a978-cd859ba366dd\") " pod="openshift-ingress/e2e-worker-w5-2b425d-openshift-default-f547dbcbf-v9wp8"
Oct 30 21:00:32.689714 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:32.689690    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2f468858-dc38-49e9-a978-cd859ba366dd-istio-token\") pod \"e2e-worker-w5-2b425d-openshift-default-f547dbcbf-v9wp8\" (UID: \"2f468858-dc38-49e9-a978-cd859ba366dd\") " pod="openshift-ingress/e2e-worker-w5-2b425d-openshift-default-f547dbcbf-v9wp8"
Oct 30 21:00:32.737187 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:32.737087    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ebe091c6-036b-416b-9e66-a9f0cb3171a0-istio-podinfo\") pod \"e2e-worker-w5-2b425d-openshift-default-f547dbcbf-mjdrq\" (UID: \"ebe091c6-036b-416b-9e66-a9f0cb3171a0\") " pod="openshift-ingress/e2e-worker-w5-2b425d-openshift-default-f547dbcbf-mjdrq"
Oct 30 21:00:32.737187 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:32.737143    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ebe091c6-036b-416b-9e66-a9f0cb3171a0-istiod-ca-cert\") pod \"e2e-worker-w5-2b425d-openshift-default-f547dbcbf-mjdrq\" (UID: \"ebe091c6-036b-416b-9e66-a9f0cb3171a0\") " pod="openshift-ingress/e2e-worker-w5-2b425d-openshift-default-f547dbcbf-mjdrq"
Oct 30 21:00:32.737490 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:32.737195    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ebe091c6-036b-416b-9e66-a9f0cb3171a0-credential-socket\") pod \"e2e-worker-w5-2b425d-openshift-default-f547dbcbf-mjdrq\" (UID: \"ebe091c6-036b-416b-9e66-a9f0cb3171a0\") " pod="openshift-ingress/e2e-worker-w5-2b425d-openshift-default-f547dbcbf-mjdrq"
Oct 30 21:00:32.737490 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:32.737251    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ebe091c6-036b-416b-9e66-a9f0cb3171a0-istio-envoy\") pod \"e2e-worker-w5-2b425d-openshift-default-f547dbcbf-mjdrq\" (UID: \"ebe091c6-036b-416b-9e66-a9f0cb3171a0\") " pod="openshift-ingress/e2e-worker-w5-2b425d-openshift-default-f547dbcbf-mjdrq"
Oct 30 21:00:32.737490 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:32.737274    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ebe091c6-036b-416b-9e66-a9f0cb3171a0-istio-token\") pod \"e2e-worker-w5-2b425d-openshift-default-f547dbcbf-mjdrq\" (UID: \"ebe091c6-036b-416b-9e66-a9f0cb3171a0\") " pod="openshift-ingress/e2e-worker-w5-2b425d-openshift-default-f547dbcbf-mjdrq"
Oct 30 21:00:32.737490 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:32.737378    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ebe091c6-036b-416b-9e66-a9f0cb3171a0-workload-certs\") pod \"e2e-worker-w5-2b425d-openshift-default-f547dbcbf-mjdrq\" (UID: \"ebe091c6-036b-416b-9e66-a9f0cb3171a0\") " pod="openshift-ingress/e2e-worker-w5-2b425d-openshift-default-f547dbcbf-mjdrq"
Oct 30 21:00:32.737490 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:32.737449    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ebe091c6-036b-416b-9e66-a9f0cb3171a0-workload-socket\") pod \"e2e-worker-w5-2b425d-openshift-default-f547dbcbf-mjdrq\" (UID: \"ebe091c6-036b-416b-9e66-a9f0cb3171a0\") " pod="openshift-ingress/e2e-worker-w5-2b425d-openshift-default-f547dbcbf-mjdrq"
Oct 30 21:00:32.737490 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:32.737488    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dl56l\" (UniqueName: \"kubernetes.io/projected/ebe091c6-036b-416b-9e66-a9f0cb3171a0-kube-api-access-dl56l\") pod \"e2e-worker-w5-2b425d-openshift-default-f547dbcbf-mjdrq\" (UID: \"ebe091c6-036b-416b-9e66-a9f0cb3171a0\") " pod="openshift-ingress/e2e-worker-w5-2b425d-openshift-default-f547dbcbf-mjdrq"
Oct 30 21:00:32.737895 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:32.737544    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ebe091c6-036b-416b-9e66-a9f0cb3171a0-istio-data\") pod \"e2e-worker-w5-2b425d-openshift-default-f547dbcbf-mjdrq\" (UID: \"ebe091c6-036b-416b-9e66-a9f0cb3171a0\") " pod="openshift-ingress/e2e-worker-w5-2b425d-openshift-default-f547dbcbf-mjdrq"
Oct 30 21:00:32.737959 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:32.737922    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ebe091c6-036b-416b-9e66-a9f0cb3171a0-istio-data\") pod \"e2e-worker-w5-2b425d-openshift-default-f547dbcbf-mjdrq\" (UID: \"ebe091c6-036b-416b-9e66-a9f0cb3171a0\") " pod="openshift-ingress/e2e-worker-w5-2b425d-openshift-default-f547dbcbf-mjdrq"
Oct 30 21:00:32.738019 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:32.737976    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ebe091c6-036b-416b-9e66-a9f0cb3171a0-workload-certs\") pod \"e2e-worker-w5-2b425d-openshift-default-f547dbcbf-mjdrq\" (UID: \"ebe091c6-036b-416b-9e66-a9f0cb3171a0\") " pod="openshift-ingress/e2e-worker-w5-2b425d-openshift-default-f547dbcbf-mjdrq"
Oct 30 21:00:32.738155 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:32.738134    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ebe091c6-036b-416b-9e66-a9f0cb3171a0-credential-socket\") pod \"e2e-worker-w5-2b425d-openshift-default-f547dbcbf-mjdrq\" (UID: \"ebe091c6-036b-416b-9e66-a9f0cb3171a0\") " pod="openshift-ingress/e2e-worker-w5-2b425d-openshift-default-f547dbcbf-mjdrq"
Oct 30 21:00:32.738340 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:32.738312    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ebe091c6-036b-416b-9e66-a9f0cb3171a0-workload-socket\") pod \"e2e-worker-w5-2b425d-openshift-default-f547dbcbf-mjdrq\" (UID: \"ebe091c6-036b-416b-9e66-a9f0cb3171a0\") " pod="openshift-ingress/e2e-worker-w5-2b425d-openshift-default-f547dbcbf-mjdrq"
Oct 30 21:00:32.738792 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:32.738766    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ebe091c6-036b-416b-9e66-a9f0cb3171a0-istiod-ca-cert\") pod \"e2e-worker-w5-2b425d-openshift-default-f547dbcbf-mjdrq\" (UID: \"ebe091c6-036b-416b-9e66-a9f0cb3171a0\") " pod="openshift-ingress/e2e-worker-w5-2b425d-openshift-default-f547dbcbf-mjdrq"
Oct 30 21:00:32.740574 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:32.740547    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ebe091c6-036b-416b-9e66-a9f0cb3171a0-istio-envoy\") pod \"e2e-worker-w5-2b425d-openshift-default-f547dbcbf-mjdrq\" (UID: \"ebe091c6-036b-416b-9e66-a9f0cb3171a0\") " pod="openshift-ingress/e2e-worker-w5-2b425d-openshift-default-f547dbcbf-mjdrq"
Oct 30 21:00:32.741532 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:32.741474    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ebe091c6-036b-416b-9e66-a9f0cb3171a0-istio-podinfo\") pod \"e2e-worker-w5-2b425d-openshift-default-f547dbcbf-mjdrq\" (UID: \"ebe091c6-036b-416b-9e66-a9f0cb3171a0\") " pod="openshift-ingress/e2e-worker-w5-2b425d-openshift-default-f547dbcbf-mjdrq"
Oct 30 21:00:32.795494 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:32.795462    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dl56l\" (UniqueName: \"kubernetes.io/projected/ebe091c6-036b-416b-9e66-a9f0cb3171a0-kube-api-access-dl56l\") pod \"e2e-worker-w5-2b425d-openshift-default-f547dbcbf-mjdrq\" (UID: \"ebe091c6-036b-416b-9e66-a9f0cb3171a0\") " pod="openshift-ingress/e2e-worker-w5-2b425d-openshift-default-f547dbcbf-mjdrq"
Oct 30 21:00:32.795638 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:32.795513    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ebe091c6-036b-416b-9e66-a9f0cb3171a0-istio-token\") pod \"e2e-worker-w5-2b425d-openshift-default-f547dbcbf-mjdrq\" (UID: \"ebe091c6-036b-416b-9e66-a9f0cb3171a0\") " pod="openshift-ingress/e2e-worker-w5-2b425d-openshift-default-f547dbcbf-mjdrq"
Oct 30 21:00:32.798509 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:32.798487    6004 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-2b425d-openshift-default-f547dbcbf-v9wp8"
Oct 30 21:00:32.851073 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:32.849357    6004 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-2b425d-openshift-default-f547dbcbf-mjdrq"
Oct 30 21:00:33.162381 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:33.161637    6004 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7254-44513d"]
Oct 30 21:00:33.167737 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:33.167708    6004 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7254-44513d"
Oct 30 21:00:33.219178 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:33.219141    6004 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7254-44513d"]
Oct 30 21:00:33.220658 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:33.220629    6004 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-p9bch\""
Oct 30 21:00:33.260356 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:33.260322    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w4cml\" (UniqueName: \"kubernetes.io/projected/516edf5f-bab6-4973-be31-fd0d124c5be4-kube-api-access-w4cml\") pod \"test-curl-7254-44513d\" (UID: \"516edf5f-bab6-4973-be31-fd0d124c5be4\") " pod="opendatahub/test-curl-7254-44513d"
Oct 30 21:00:33.271357 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:33.271321    6004 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w5-2b425d-openshift-default-f547dbcbf-v9wp8"]
Oct 30 21:00:33.278242 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:33.278206    6004 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 21:00:33.278364 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:33.278276    6004 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 21:00:33.278364 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:33.278311    6004 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 21:00:33.320878 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:33.320847    6004 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w5-2b425d-openshift-default-f547dbcbf-mjdrq"]
Oct 30 21:00:33.321417 ip-10-0-138-85 kubenswrapper[6004]: W1030 21:00:33.321386    6004 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podebe091c6_036b_416b_9e66_a9f0cb3171a0.slice/crio-ff75d46863a3f9fb952e8cf2bea46dc3fc30f9b739752876b70679793db01f78 WatchSource:0}: Error finding container ff75d46863a3f9fb952e8cf2bea46dc3fc30f9b739752876b70679793db01f78: Status 404 returned error can't find the container with id ff75d46863a3f9fb952e8cf2bea46dc3fc30f9b739752876b70679793db01f78
Oct 30 21:00:33.323966 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:33.323934    6004 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 21:00:33.324092 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:33.323995    6004 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 21:00:33.324092 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:33.324023    6004 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 21:00:33.361740 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:33.361714    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w4cml\" (UniqueName: \"kubernetes.io/projected/516edf5f-bab6-4973-be31-fd0d124c5be4-kube-api-access-w4cml\") pod \"test-curl-7254-44513d\" (UID: \"516edf5f-bab6-4973-be31-fd0d124c5be4\") " pod="opendatahub/test-curl-7254-44513d"
Oct 30 21:00:33.419842 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:33.419764    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w4cml\" (UniqueName: \"kubernetes.io/projected/516edf5f-bab6-4973-be31-fd0d124c5be4-kube-api-access-w4cml\") pod \"test-curl-7254-44513d\" (UID: \"516edf5f-bab6-4973-be31-fd0d124c5be4\") " pod="opendatahub/test-curl-7254-44513d"
Oct 30 21:00:33.484158 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:33.484084    6004 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7254-44513d"
Oct 30 21:00:33.868102 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:33.868069    6004 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7254-44513d"]
Oct 30 21:00:33.869637 ip-10-0-138-85 kubenswrapper[6004]: W1030 21:00:33.869606    6004 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod516edf5f_bab6_4973_be31_fd0d124c5be4.slice/crio-f01a911e8c0483a128f9df4541ecd877b1d5776d72d464b56b7b6c65a34d5e6c WatchSource:0}: Error finding container f01a911e8c0483a128f9df4541ecd877b1d5776d72d464b56b7b6c65a34d5e6c: Status 404 returned error can't find the container with id f01a911e8c0483a128f9df4541ecd877b1d5776d72d464b56b7b6c65a34d5e6c
Oct 30 21:00:33.872555 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:33.872534    6004 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Oct 30 21:00:33.995621 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:33.995585    6004 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7254-44513d" event={"ID":"516edf5f-bab6-4973-be31-fd0d124c5be4","Type":"ContainerStarted","Data":"f01a911e8c0483a128f9df4541ecd877b1d5776d72d464b56b7b6c65a34d5e6c"}
Oct 30 21:00:33.997314 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:33.997286    6004 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-2b425d-openshift-default-f547dbcbf-mjdrq" event={"ID":"ebe091c6-036b-416b-9e66-a9f0cb3171a0","Type":"ContainerStarted","Data":"72d489b8ffaf76e28814caffac28b5964edf7054bc0021193df523600cdde783"}
Oct 30 21:00:33.997458 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:33.997336    6004 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-2b425d-openshift-default-f547dbcbf-mjdrq" event={"ID":"ebe091c6-036b-416b-9e66-a9f0cb3171a0","Type":"ContainerStarted","Data":"ff75d46863a3f9fb952e8cf2bea46dc3fc30f9b739752876b70679793db01f78"}
Oct 30 21:00:33.998988 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:33.998963    6004 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-2b425d-openshift-default-f547dbcbf-v9wp8" event={"ID":"2f468858-dc38-49e9-a978-cd859ba366dd","Type":"ContainerStarted","Data":"d83a9565bfda0cd65c6ae623ee68f023412382ba19377922dc23d0c968e85c95"}
Oct 30 21:00:33.999122 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:33.999006    6004 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-2b425d-openshift-default-f547dbcbf-v9wp8" event={"ID":"2f468858-dc38-49e9-a978-cd859ba366dd","Type":"ContainerStarted","Data":"a579e93801c8f274a660f7df69efe6e4b8e69317ca082d78a98cd5a02b170da5"}
Oct 30 21:00:34.118111 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:34.118003    6004 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w5-2b425d-openshift-default-f547dbcbf-mjdrq" podStartSLOduration=2.11798946 podStartE2EDuration="2.11798946s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:00:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:00:34.115343747 +0000 UTC m=+1340.035129866" watchObservedRunningTime="2026-10-30 21:00:34.11798946 +0000 UTC m=+1340.037775631"
Oct 30 21:00:34.260088 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:34.258265    6004 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w5-2b425d-openshift-default-f547dbcbf-v9wp8" podStartSLOduration=2.258243807 podStartE2EDuration="2.258243807s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:00:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:00:34.232979921 +0000 UTC m=+1340.152766040" watchObservedRunningTime="2026-10-30 21:00:34.258243807 +0000 UTC m=+1340.178029926"
Oct 30 21:00:34.802388 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:34.802140    6004 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w5-2b425d-openshift-default-f547dbcbf-v9wp8"
Oct 30 21:00:34.803144 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:34.802883    6004 patch_prober.go:29] interesting pod/e2e-worker-w5-2b425d-openshift-default-f547dbcbf-v9wp8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.81:15021/healthz/ready\": dial tcp 10.132.0.81:15021: connect: connection refused" start-of-body=
Oct 30 21:00:34.803144 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:34.802930    6004 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-2b425d-openshift-default-f547dbcbf-v9wp8" podUID="2f468858-dc38-49e9-a978-cd859ba366dd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.81:15021/healthz/ready\": dial tcp 10.132.0.81:15021: connect: connection refused"
Oct 30 21:00:34.851167 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:34.851118    6004 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w5-2b425d-openshift-default-f547dbcbf-mjdrq"
Oct 30 21:00:34.857585 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:34.857550    6004 patch_prober.go:29] interesting pod/e2e-worker-w5-2b425d-openshift-default-f547dbcbf-mjdrq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.82:15021/healthz/ready\": dial tcp 10.132.0.82:15021: connect: connection refused" start-of-body=
Oct 30 21:00:34.857842 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:34.857801    6004 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-2b425d-openshift-default-f547dbcbf-mjdrq" podUID="ebe091c6-036b-416b-9e66-a9f0cb3171a0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.82:15021/healthz/ready\": dial tcp 10.132.0.82:15021: connect: connection refused"
Oct 30 21:00:35.798979 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:35.798942    6004 patch_prober.go:29] interesting pod/e2e-worker-w5-2b425d-openshift-default-f547dbcbf-v9wp8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.81:15021/healthz/ready\": dial tcp 10.132.0.81:15021: connect: connection refused" start-of-body=
Oct 30 21:00:35.799343 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:35.799287    6004 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-2b425d-openshift-default-f547dbcbf-v9wp8" podUID="2f468858-dc38-49e9-a978-cd859ba366dd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.81:15021/healthz/ready\": dial tcp 10.132.0.81:15021: connect: connection refused"
Oct 30 21:00:35.855499 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:35.855465    6004 patch_prober.go:29] interesting pod/e2e-worker-w5-2b425d-openshift-default-f547dbcbf-mjdrq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.82:15021/healthz/ready\": dial tcp 10.132.0.82:15021: connect: connection refused" start-of-body=
Oct 30 21:00:35.856097 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:35.856064    6004 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-2b425d-openshift-default-f547dbcbf-mjdrq" podUID="ebe091c6-036b-416b-9e66-a9f0cb3171a0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.82:15021/healthz/ready\": dial tcp 10.132.0.82:15021: connect: connection refused"
Oct 30 21:00:36.799555 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:36.799522    6004 patch_prober.go:29] interesting pod/e2e-worker-w5-2b425d-openshift-default-f547dbcbf-v9wp8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.81:15021/healthz/ready\": dial tcp 10.132.0.81:15021: connect: connection refused" start-of-body=
Oct 30 21:00:36.799753 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:36.799601    6004 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-2b425d-openshift-default-f547dbcbf-v9wp8" podUID="2f468858-dc38-49e9-a978-cd859ba366dd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.81:15021/healthz/ready\": dial tcp 10.132.0.81:15021: connect: connection refused"
Oct 30 21:00:36.851073 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:36.850461    6004 patch_prober.go:29] interesting pod/e2e-worker-w5-2b425d-openshift-default-f547dbcbf-mjdrq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.82:15021/healthz/ready\": dial tcp 10.132.0.82:15021: connect: connection refused" start-of-body=
Oct 30 21:00:36.851073 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:36.850522    6004 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-2b425d-openshift-default-f547dbcbf-mjdrq" podUID="ebe091c6-036b-416b-9e66-a9f0cb3171a0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.82:15021/healthz/ready\": dial tcp 10.132.0.82:15021: connect: connection refused"
Oct 30 21:00:37.801497 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:37.801458    6004 patch_prober.go:29] interesting pod/e2e-worker-w5-2b425d-openshift-default-f547dbcbf-v9wp8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.81:15021/healthz/ready\": dial tcp 10.132.0.81:15021: connect: connection refused" start-of-body=
Oct 30 21:00:37.802365 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:37.802324    6004 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-2b425d-openshift-default-f547dbcbf-v9wp8" podUID="2f468858-dc38-49e9-a978-cd859ba366dd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.81:15021/healthz/ready\": dial tcp 10.132.0.81:15021: connect: connection refused"
Oct 30 21:00:37.871136 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:37.870540    6004 patch_prober.go:29] interesting pod/e2e-worker-w5-2b425d-openshift-default-f547dbcbf-mjdrq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.82:15021/healthz/ready\": dial tcp 10.132.0.82:15021: connect: connection refused" start-of-body=
Oct 30 21:00:37.871136 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:37.870599    6004 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-2b425d-openshift-default-f547dbcbf-mjdrq" podUID="ebe091c6-036b-416b-9e66-a9f0cb3171a0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.82:15021/healthz/ready\": dial tcp 10.132.0.82:15021: connect: connection refused"
Oct 30 21:00:38.799768 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:38.799732    6004 patch_prober.go:29] interesting pod/e2e-worker-w5-2b425d-openshift-default-f547dbcbf-v9wp8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.81:15021/healthz/ready\": dial tcp 10.132.0.81:15021: connect: connection refused" start-of-body=
Oct 30 21:00:38.799924 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:38.799786    6004 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-2b425d-openshift-default-f547dbcbf-v9wp8" podUID="2f468858-dc38-49e9-a978-cd859ba366dd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.81:15021/healthz/ready\": dial tcp 10.132.0.81:15021: connect: connection refused"
Oct 30 21:00:38.858075 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:38.852496    6004 patch_prober.go:29] interesting pod/e2e-worker-w5-2b425d-openshift-default-f547dbcbf-mjdrq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.82:15021/healthz/ready\": dial tcp 10.132.0.82:15021: connect: connection refused" start-of-body=
Oct 30 21:00:38.858075 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:38.852564    6004 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-2b425d-openshift-default-f547dbcbf-mjdrq" podUID="ebe091c6-036b-416b-9e66-a9f0cb3171a0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.82:15021/healthz/ready\": dial tcp 10.132.0.82:15021: connect: connection refused"
Oct 30 21:00:39.803077 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:39.802345    6004 patch_prober.go:29] interesting pod/e2e-worker-w5-2b425d-openshift-default-f547dbcbf-v9wp8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.81:15021/healthz/ready\": dial tcp 10.132.0.81:15021: connect: connection refused" start-of-body=
Oct 30 21:00:39.803077 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:39.802406    6004 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-2b425d-openshift-default-f547dbcbf-v9wp8" podUID="2f468858-dc38-49e9-a978-cd859ba366dd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.81:15021/healthz/ready\": dial tcp 10.132.0.81:15021: connect: connection refused"
Oct 30 21:00:39.854075 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:39.852842    6004 patch_prober.go:29] interesting pod/e2e-worker-w5-2b425d-openshift-default-f547dbcbf-mjdrq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.82:15021/healthz/ready\": dial tcp 10.132.0.82:15021: connect: connection refused" start-of-body=
Oct 30 21:00:39.854075 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:39.852920    6004 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-2b425d-openshift-default-f547dbcbf-mjdrq" podUID="ebe091c6-036b-416b-9e66-a9f0cb3171a0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.82:15021/healthz/ready\": dial tcp 10.132.0.82:15021: connect: connection refused"
Oct 30 21:00:40.810079 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:40.809816    6004 patch_prober.go:29] interesting pod/e2e-worker-w5-2b425d-openshift-default-f547dbcbf-v9wp8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.81:15021/healthz/ready\": dial tcp 10.132.0.81:15021: connect: connection refused" start-of-body=
Oct 30 21:00:40.810079 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:40.809880    6004 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-2b425d-openshift-default-f547dbcbf-v9wp8" podUID="2f468858-dc38-49e9-a978-cd859ba366dd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.81:15021/healthz/ready\": dial tcp 10.132.0.81:15021: connect: connection refused"
Oct 30 21:00:40.860075 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:40.859712    6004 patch_prober.go:29] interesting pod/e2e-worker-w5-2b425d-openshift-default-f547dbcbf-mjdrq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.82:15021/healthz/ready\": dial tcp 10.132.0.82:15021: connect: connection refused" start-of-body=
Oct 30 21:00:40.860075 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:40.859781    6004 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-2b425d-openshift-default-f547dbcbf-mjdrq" podUID="ebe091c6-036b-416b-9e66-a9f0cb3171a0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.82:15021/healthz/ready\": dial tcp 10.132.0.82:15021: connect: connection refused"
Oct 30 21:00:41.822074 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:41.815833    6004 patch_prober.go:29] interesting pod/e2e-worker-w5-2b425d-openshift-default-f547dbcbf-v9wp8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.81:15021/healthz/ready\": dial tcp 10.132.0.81:15021: connect: connection refused" start-of-body=
Oct 30 21:00:41.822074 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:41.815897    6004 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-2b425d-openshift-default-f547dbcbf-v9wp8" podUID="2f468858-dc38-49e9-a978-cd859ba366dd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.81:15021/healthz/ready\": dial tcp 10.132.0.81:15021: connect: connection refused"
Oct 30 21:00:41.863279 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:41.855482    6004 patch_prober.go:29] interesting pod/e2e-worker-w5-2b425d-openshift-default-f547dbcbf-mjdrq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.82:15021/healthz/ready\": dial tcp 10.132.0.82:15021: connect: connection refused" start-of-body=
Oct 30 21:00:41.863279 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:41.855544    6004 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-2b425d-openshift-default-f547dbcbf-mjdrq" podUID="ebe091c6-036b-416b-9e66-a9f0cb3171a0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.82:15021/healthz/ready\": dial tcp 10.132.0.82:15021: connect: connection refused"
Oct 30 21:00:42.416076 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:42.372547    6004 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-d061d0/premium-w2-d061d0-kserve-5c589d8c9f-rt7v4" podUID="769fd172-1d4c-4cd3-8eda-e8d4850c0f67" containerName="main" probeResult="failure" output="Get \"https://10.132.0.62:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:00:43.152075 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:43.124974    6004 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-d061d0/distinct-2-w2-d061d0-kserve-5c6bb99fbf-b4kqs" podUID="32264f6c-999b-4bad-bd2e-7664cadc0669" containerName="main" probeResult="failure" output="Get \"https://10.132.0.71:8000/ready\": context deadline exceeded"
Oct 30 21:00:43.381210 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:43.381154    6004 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-d061d0/premium-w2-d061d0-kserve-5c589d8c9f-rt7v4" podUID="769fd172-1d4c-4cd3-8eda-e8d4850c0f67" containerName="main" probeResult="failure" output="Get \"https://10.132.0.62:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:00:43.404347 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:43.404228    6004 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w2-d061d0/premium-w2-d061d0-kserve-5c589d8c9f-rt7v4"
Oct 30 21:00:43.473105 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:43.468112    6004 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-f9f277/distinct-w1-f9f277-kserve-f947bc879-lzs6w" podUID="f4ab8826-a6f1-41e6-897f-b808635017c5" containerName="main" probeResult="failure" output="Get \"https://10.132.0.68:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:00:43.651222 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:43.651192    6004 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w2-d061d0/premium-w2-d061d0-kserve-5c589d8c9f-rt7v4"
Oct 30 21:00:43.727332 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:43.727277    6004 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-1fdaa7/distinct-2-w4-1fdaa7-kserve-59f4d6788b-b6gl4" podUID="f6d2856c-84b5-426d-bfcd-ef613ab44242" containerName="main" probeResult="failure" output="Get \"https://10.132.0.73:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:00:44.119332 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:44.096412    6004 patch_prober.go:29] interesting pod/e2e-worker-w5-2b425d-openshift-default-f547dbcbf-mjdrq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.82:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 30 21:00:44.119332 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:44.096479    6004 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-2b425d-openshift-default-f547dbcbf-mjdrq" podUID="ebe091c6-036b-416b-9e66-a9f0cb3171a0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.82:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:00:44.153079 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:44.140297    6004 patch_prober.go:29] interesting pod/e2e-worker-w5-2b425d-openshift-default-f547dbcbf-v9wp8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.81:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 30 21:00:44.203552 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:44.203492    6004 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-2b425d-openshift-default-f547dbcbf-v9wp8" podUID="2f468858-dc38-49e9-a978-cd859ba366dd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.81:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:00:44.204101 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:44.158239    6004 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-d061d0/distinct-2-w2-d061d0-kserve-5c6bb99fbf-b4kqs" podUID="32264f6c-999b-4bad-bd2e-7664cadc0669" containerName="main" probeResult="failure" output="Get \"https://10.132.0.71:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:00:44.208125 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:44.204740    6004 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w2-d061d0/distinct-2-w2-d061d0-kserve-5c6bb99fbf-b4kqs"
Oct 30 21:00:44.405582 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:44.405477    6004 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-2b425d/distinct-w5-2b425d-kserve-dd4dcf7f-b227k" podUID="802e5037-d6f5-4a37-a95f-b49dda7f8b1b" containerName="main" probeResult="failure" output="Get \"https://10.132.0.67:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:00:44.542088 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:44.533160    6004 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-f9f277/distinct-w1-f9f277-kserve-f947bc879-lzs6w" podUID="f4ab8826-a6f1-41e6-897f-b808635017c5" containerName="main" probeResult="failure" output="Get \"https://10.132.0.68:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:00:44.572931 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:44.572886    6004 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w1-f9f277/distinct-w1-f9f277-kserve-f947bc879-lzs6w"
Oct 30 21:00:44.811143 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:44.728401    6004 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w2-d061d0/distinct-2-w2-d061d0-kserve-5c6bb99fbf-b4kqs"
Oct 30 21:00:44.811143 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:44.732013    6004 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-1fdaa7/distinct-2-w4-1fdaa7-kserve-59f4d6788b-b6gl4" podUID="f6d2856c-84b5-426d-bfcd-ef613ab44242" containerName="main" probeResult="failure" output="Get \"https://10.132.0.73:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:00:44.811143 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:44.794845    6004 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w4-1fdaa7/distinct-2-w4-1fdaa7-kserve-59f4d6788b-b6gl4"
Oct 30 21:00:44.855333 ip-10-0-138-85 kubenswrapper[6004]: E1030 21:00:44.855029    6004 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-zz4wr" containerName="extractor"
Oct 30 21:00:45.098544 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:45.098455    6004 patch_prober.go:29] interesting pod/e2e-worker-w5-2b425d-openshift-default-f547dbcbf-mjdrq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.82:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 30 21:00:45.098786 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:45.098757    6004 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-2b425d-openshift-default-f547dbcbf-mjdrq" podUID="ebe091c6-036b-416b-9e66-a9f0cb3171a0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.82:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:00:45.230217 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:45.229432    6004 patch_prober.go:29] interesting pod/e2e-worker-w2-d061d0-openshift-default-86b87f495-d8j6q container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.79:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 30 21:00:45.230217 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:45.229503    6004 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w2-d061d0-openshift-default-86b87f495-d8j6q" podUID="54f45743-f6cf-4d8b-b3a5-e1064334eebc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.79:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:00:45.255082 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:45.255020    6004 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w4-1fdaa7/distinct-2-w4-1fdaa7-kserve-59f4d6788b-b6gl4"
Oct 30 21:00:45.294452 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:45.294326    6004 patch_prober.go:29] interesting pod/e2e-worker-w5-2b425d-openshift-default-f547dbcbf-v9wp8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.81:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 30 21:00:45.294452 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:45.294401    6004 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-2b425d-openshift-default-f547dbcbf-v9wp8" podUID="2f468858-dc38-49e9-a978-cd859ba366dd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.81:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:00:45.510895 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:45.510865    6004 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w1-f9f277/distinct-w1-f9f277-kserve-f947bc879-lzs6w"
Oct 30 21:00:46.150326 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:46.150182    6004 patch_prober.go:29] interesting pod/e2e-worker-w5-2b425d-openshift-default-f547dbcbf-mjdrq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.82:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 30 21:00:46.150326 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:46.150254    6004 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-2b425d-openshift-default-f547dbcbf-mjdrq" podUID="ebe091c6-036b-416b-9e66-a9f0cb3171a0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.82:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:00:46.389845 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:46.389218    6004 patch_prober.go:29] interesting pod/e2e-worker-w5-2b425d-openshift-default-f547dbcbf-v9wp8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.81:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 30 21:00:46.390503 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:46.390457    6004 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-2b425d-openshift-default-f547dbcbf-v9wp8" podUID="2f468858-dc38-49e9-a978-cd859ba366dd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.81:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:00:46.696525 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:46.694867    6004 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w5-2b425d-openshift-default-f547dbcbf-v9wp8"
Oct 30 21:00:46.697384 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:46.697095    6004 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w5-2b425d-openshift-default-f547dbcbf-v9wp8"
Oct 30 21:00:46.699477 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:46.697992    6004 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w5-2b425d-openshift-default-f547dbcbf-v9wp8"
Oct 30 21:00:46.781557 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:46.781525    6004 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w5-2b425d-openshift-default-f547dbcbf-mjdrq"
Oct 30 21:00:46.782963 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:46.782873    6004 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w5-2b425d-openshift-default-f547dbcbf-mjdrq"
Oct 30 21:00:46.783831 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:46.783783    6004 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w5-2b425d-openshift-default-f547dbcbf-mjdrq"
Oct 30 21:00:47.620621 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:47.620537    6004 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7254-44513d" event={"ID":"516edf5f-bab6-4973-be31-fd0d124c5be4","Type":"ContainerStarted","Data":"f3c80b48edc64e881fee26077da4159d905d0a88ca7422b046144dd5c6c01895"}
Oct 30 21:00:47.742084 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:47.741980    6004 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="opendatahub/test-curl-7254-44513d" podStartSLOduration=1.271049211 podStartE2EDuration="14.741962305s" totalImagesPullingTime="13.470913094s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:00:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:00:47.740302543 +0000 UTC m=+1353.660088666" watchObservedRunningTime="2026-10-30 21:00:47.741962305 +0000 UTC m=+1353.661748424"
Oct 30 21:00:49.216237 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:49.216198    6004 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7254-44513d"]
Oct 30 21:00:49.220942 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:49.220906    6004 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7254-44513d"]
Oct 30 21:00:49.362686 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:49.362653    6004 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7254-139762"]
Oct 30 21:00:49.363251 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:49.363238    6004 cpu_manager.go:414] "containerMap: removing container" podUID="516edf5f-bab6-4973-be31-fd0d124c5be4" containerName="test-curl-7254-44513d"
Oct 30 21:00:49.363313 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:49.363253    6004 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="516edf5f-bab6-4973-be31-fd0d124c5be4" containerName="test-curl-7254-44513d"
Oct 30 21:00:49.363433 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:49.363420    6004 memory_manager.go:365] "RemoveStaleState removing state" podUID="516edf5f-bab6-4973-be31-fd0d124c5be4" containerName="test-curl-7254-44513d"
Oct 30 21:00:49.367057 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:49.367029    6004 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7254-139762"
Oct 30 21:00:49.422622 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:49.422588    6004 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7254-139762"]
Oct 30 21:00:49.475847 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:49.475746    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lzh24\" (UniqueName: \"kubernetes.io/projected/576959a4-3f32-4ca9-b414-e57d28591daa-kube-api-access-lzh24\") pod \"test-curl-7254-139762\" (UID: \"576959a4-3f32-4ca9-b414-e57d28591daa\") " pod="opendatahub/test-curl-7254-139762"
Oct 30 21:00:49.576985 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:49.576949    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lzh24\" (UniqueName: \"kubernetes.io/projected/576959a4-3f32-4ca9-b414-e57d28591daa-kube-api-access-lzh24\") pod \"test-curl-7254-139762\" (UID: \"576959a4-3f32-4ca9-b414-e57d28591daa\") " pod="opendatahub/test-curl-7254-139762"
Oct 30 21:00:49.635411 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:49.635378    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lzh24\" (UniqueName: \"kubernetes.io/projected/576959a4-3f32-4ca9-b414-e57d28591daa-kube-api-access-lzh24\") pod \"test-curl-7254-139762\" (UID: \"576959a4-3f32-4ca9-b414-e57d28591daa\") " pod="opendatahub/test-curl-7254-139762"
Oct 30 21:00:49.639349 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:49.639313    6004 kuberuntime_container.go:898] "Killing container with a grace period" pod="opendatahub/test-curl-7254-44513d" podUID="516edf5f-bab6-4973-be31-fd0d124c5be4" containerName="test-curl-7254-44513d" containerID="cri-o://f3c80b48edc64e881fee26077da4159d905d0a88ca7422b046144dd5c6c01895" gracePeriod=2
Oct 30 21:00:49.680414 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:49.680379    6004 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7254-139762"
Oct 30 21:00:49.691187 ip-10-0-138-85 kubenswrapper[6004]: E1030 21:00:49.691149    6004 status_manager.go:1045] "Failed to get status for pod" err="pods \"test-curl-7254-44513d\" is forbidden: User \"system:node:ip-10-0-138-85.us-west-1.compute.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-138-85.us-west-1.compute.internal' and this object" podUID="516edf5f-bab6-4973-be31-fd0d124c5be4" pod="opendatahub/test-curl-7254-44513d"
Oct 30 21:00:50.065266 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:50.065234    6004 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7254-139762"]
Oct 30 21:00:50.649725 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:50.649684    6004 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7254-139762" event={"ID":"576959a4-3f32-4ca9-b414-e57d28591daa","Type":"ContainerStarted","Data":"3e1991e8711480a36477475c04fd3bcafa58c21a28812a59056689a3010b5649"}
Oct 30 21:00:50.650222 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:50.649742    6004 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7254-139762" event={"ID":"576959a4-3f32-4ca9-b414-e57d28591daa","Type":"ContainerStarted","Data":"da9aa7c6d867e73d667e6abe3333c3ef5dc4a2f0fb012f89752258dd8f35107a"}
Oct 30 21:00:50.764834 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:50.764781    6004 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="opendatahub/test-curl-7254-139762" podStartSLOduration=1.764767114 podStartE2EDuration="1.764767114s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:00:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:00:50.762412757 +0000 UTC m=+1356.682198880" watchObservedRunningTime="2026-10-30 21:00:50.764767114 +0000 UTC m=+1356.684553231"
Oct 30 21:00:51.909534 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:51.909473    6004 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7254-44513d"
Oct 30 21:00:52.016513 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:52.016477    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/516edf5f-bab6-4973-be31-fd0d124c5be4-kube-api-access-w4cml\" (UniqueName: \"kubernetes.io/projected/516edf5f-bab6-4973-be31-fd0d124c5be4-kube-api-access-w4cml\") pod \"516edf5f-bab6-4973-be31-fd0d124c5be4\" (UID: \"516edf5f-bab6-4973-be31-fd0d124c5be4\") "
Oct 30 21:00:52.018570 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:52.018537    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/516edf5f-bab6-4973-be31-fd0d124c5be4-kube-api-access-w4cml" pod "516edf5f-bab6-4973-be31-fd0d124c5be4" (UID: "516edf5f-bab6-4973-be31-fd0d124c5be4"). InnerVolumeSpecName "kube-api-access-w4cml". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:00:52.118687 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:52.118652    6004 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w4cml\" (UniqueName: \"kubernetes.io/projected/516edf5f-bab6-4973-be31-fd0d124c5be4-kube-api-access-w4cml\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:00:52.233235 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:52.233201    6004 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="516edf5f-bab6-4973-be31-fd0d124c5be4" path="/var/lib/kubelet/pods/516edf5f-bab6-4973-be31-fd0d124c5be4/volumes"
Oct 30 21:00:52.311064 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:52.311014    6004 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7254-139762"]
Oct 30 21:00:52.317217 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:52.317186    6004 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7254-139762"]
Oct 30 21:00:52.666654 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:52.666556    6004 generic.go:356] "Generic (PLEG): container finished" podID="516edf5f-bab6-4973-be31-fd0d124c5be4" containerID="f3c80b48edc64e881fee26077da4159d905d0a88ca7422b046144dd5c6c01895" exitCode=137
Oct 30 21:00:52.666654 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:52.666605    6004 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7254-44513d"
Oct 30 21:00:52.666879 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:52.666656    6004 scope.go:122] "RemoveContainer" containerID="f3c80b48edc64e881fee26077da4159d905d0a88ca7422b046144dd5c6c01895"
Oct 30 21:00:52.666879 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:52.666832    6004 kuberuntime_container.go:898] "Killing container with a grace period" pod="opendatahub/test-curl-7254-139762" podUID="576959a4-3f32-4ca9-b414-e57d28591daa" containerName="test-curl-7254-139762" containerID="cri-o://3e1991e8711480a36477475c04fd3bcafa58c21a28812a59056689a3010b5649" gracePeriod=2
Oct 30 21:00:52.676226 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:52.676201    6004 scope.go:122] "RemoveContainer" containerID="f3c80b48edc64e881fee26077da4159d905d0a88ca7422b046144dd5c6c01895"
Oct 30 21:00:52.676560 ip-10-0-138-85 kubenswrapper[6004]: E1030 21:00:52.676536    6004 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f3c80b48edc64e881fee26077da4159d905d0a88ca7422b046144dd5c6c01895\": container with ID starting with f3c80b48edc64e881fee26077da4159d905d0a88ca7422b046144dd5c6c01895 not found: ID does not exist" containerID="f3c80b48edc64e881fee26077da4159d905d0a88ca7422b046144dd5c6c01895"
Oct 30 21:00:52.676614 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:52.676569    6004 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f3c80b48edc64e881fee26077da4159d905d0a88ca7422b046144dd5c6c01895"} err="failed to get container status \"f3c80b48edc64e881fee26077da4159d905d0a88ca7422b046144dd5c6c01895\": rpc error: code = NotFound desc = could not find container \"f3c80b48edc64e881fee26077da4159d905d0a88ca7422b046144dd5c6c01895\": container with ID starting with f3c80b48edc64e881fee26077da4159d905d0a88ca7422b046144dd5c6c01895 not found: ID does not exist"
Oct 30 21:00:52.718648 ip-10-0-138-85 kubenswrapper[6004]: E1030 21:00:52.718616    6004 status_manager.go:1045] "Failed to get status for pod" err="pods \"test-curl-7254-139762\" is forbidden: User \"system:node:ip-10-0-138-85.us-west-1.compute.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-138-85.us-west-1.compute.internal' and this object" podUID="576959a4-3f32-4ca9-b414-e57d28591daa" pod="opendatahub/test-curl-7254-139762"
Oct 30 21:00:52.769924 ip-10-0-138-85 kubenswrapper[6004]: E1030 21:00:52.769881    6004 status_manager.go:1045] "Failed to get status for pod" err="pods \"test-curl-7254-139762\" is forbidden: User \"system:node:ip-10-0-138-85.us-west-1.compute.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-138-85.us-west-1.compute.internal' and this object" podUID="576959a4-3f32-4ca9-b414-e57d28591daa" pod="opendatahub/test-curl-7254-139762"
Oct 30 21:00:54.332446 ip-10-0-138-85 kubenswrapper[6004]: E1030 21:00:54.332394    6004 status_manager.go:1045] "Failed to get status for pod" err="pods \"test-curl-7254-139762\" is forbidden: User \"system:node:ip-10-0-138-85.us-west-1.compute.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-138-85.us-west-1.compute.internal' and this object" podUID="576959a4-3f32-4ca9-b414-e57d28591daa" pod="opendatahub/test-curl-7254-139762"
Oct 30 21:00:54.958397 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:54.958370    6004 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7254-139762"
Oct 30 21:00:55.085933 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:55.085851    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/576959a4-3f32-4ca9-b414-e57d28591daa-kube-api-access-lzh24\" (UniqueName: \"kubernetes.io/projected/576959a4-3f32-4ca9-b414-e57d28591daa-kube-api-access-lzh24\") pod \"576959a4-3f32-4ca9-b414-e57d28591daa\" (UID: \"576959a4-3f32-4ca9-b414-e57d28591daa\") "
Oct 30 21:00:55.087980 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:55.087953    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/576959a4-3f32-4ca9-b414-e57d28591daa-kube-api-access-lzh24" pod "576959a4-3f32-4ca9-b414-e57d28591daa" (UID: "576959a4-3f32-4ca9-b414-e57d28591daa"). InnerVolumeSpecName "kube-api-access-lzh24". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:00:55.187758 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:55.187729    6004 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lzh24\" (UniqueName: \"kubernetes.io/projected/576959a4-3f32-4ca9-b414-e57d28591daa-kube-api-access-lzh24\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:00:55.696731 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:55.696674    6004 generic.go:356] "Generic (PLEG): container finished" podID="576959a4-3f32-4ca9-b414-e57d28591daa" containerID="3e1991e8711480a36477475c04fd3bcafa58c21a28812a59056689a3010b5649" exitCode=137
Oct 30 21:00:55.697236 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:55.696733    6004 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7254-139762"
Oct 30 21:00:55.697236 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:55.696767    6004 scope.go:122] "RemoveContainer" containerID="3e1991e8711480a36477475c04fd3bcafa58c21a28812a59056689a3010b5649"
Oct 30 21:00:55.708982 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:55.708963    6004 scope.go:122] "RemoveContainer" containerID="3e1991e8711480a36477475c04fd3bcafa58c21a28812a59056689a3010b5649"
Oct 30 21:00:55.709326 ip-10-0-138-85 kubenswrapper[6004]: E1030 21:00:55.709305    6004 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3e1991e8711480a36477475c04fd3bcafa58c21a28812a59056689a3010b5649\": container with ID starting with 3e1991e8711480a36477475c04fd3bcafa58c21a28812a59056689a3010b5649 not found: ID does not exist" containerID="3e1991e8711480a36477475c04fd3bcafa58c21a28812a59056689a3010b5649"
Oct 30 21:00:55.709408 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:55.709336    6004 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3e1991e8711480a36477475c04fd3bcafa58c21a28812a59056689a3010b5649"} err="failed to get container status \"3e1991e8711480a36477475c04fd3bcafa58c21a28812a59056689a3010b5649\": rpc error: code = NotFound desc = could not find container \"3e1991e8711480a36477475c04fd3bcafa58c21a28812a59056689a3010b5649\": container with ID starting with 3e1991e8711480a36477475c04fd3bcafa58c21a28812a59056689a3010b5649 not found: ID does not exist"
Oct 30 21:00:55.757818 ip-10-0-138-85 kubenswrapper[6004]: E1030 21:00:55.757782    6004 status_manager.go:1045] "Failed to get status for pod" err="pods \"test-curl-7254-139762\" is forbidden: User \"system:node:ip-10-0-138-85.us-west-1.compute.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-138-85.us-west-1.compute.internal' and this object" podUID="576959a4-3f32-4ca9-b414-e57d28591daa" pod="opendatahub/test-curl-7254-139762"
Oct 30 21:00:56.233504 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:56.233468    6004 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="576959a4-3f32-4ca9-b414-e57d28591daa" path="/var/lib/kubelet/pods/576959a4-3f32-4ca9-b414-e57d28591daa/volumes"
Oct 30 21:00:56.311966 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:56.311906    6004 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-83851760-openshift-default-5d466c5bd5-jj89h"]
Oct 30 21:00:56.313284 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:56.313240    6004 cpu_manager.go:414] "containerMap: removing container" podUID="576959a4-3f32-4ca9-b414-e57d28591daa" containerName="test-curl-7254-139762"
Oct 30 21:00:56.313284 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:56.313270    6004 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="576959a4-3f32-4ca9-b414-e57d28591daa" containerName="test-curl-7254-139762"
Oct 30 21:00:56.313544 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:56.313432    6004 memory_manager.go:365] "RemoveStaleState removing state" podUID="576959a4-3f32-4ca9-b414-e57d28591daa" containerName="test-curl-7254-139762"
Oct 30 21:00:56.318463 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:56.318438    6004 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-83851760-openshift-default-5d466c5bd5-jj89h"
Oct 30 21:00:56.452073 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:56.447569    6004 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-83851760-openshift-default-dockercfg-x4zjp\""
Oct 30 21:00:56.478255 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:56.478218    6004 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-83851760-openshift-default-5d466c5bd5-jj89h"]
Oct 30 21:00:56.551350 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:56.551247    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4348ddc3-36e1-4f59-be98-2bac043474e7-istiod-ca-cert\") pod \"e2e-ait-83851760-openshift-default-5d466c5bd5-jj89h\" (UID: \"4348ddc3-36e1-4f59-be98-2bac043474e7\") " pod="openshift-ingress/e2e-ait-83851760-openshift-default-5d466c5bd5-jj89h"
Oct 30 21:00:56.551713 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:56.551686    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4348ddc3-36e1-4f59-be98-2bac043474e7-istio-data\") pod \"e2e-ait-83851760-openshift-default-5d466c5bd5-jj89h\" (UID: \"4348ddc3-36e1-4f59-be98-2bac043474e7\") " pod="openshift-ingress/e2e-ait-83851760-openshift-default-5d466c5bd5-jj89h"
Oct 30 21:00:56.551917 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:56.551898    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d2zvw\" (UniqueName: \"kubernetes.io/projected/4348ddc3-36e1-4f59-be98-2bac043474e7-kube-api-access-d2zvw\") pod \"e2e-ait-83851760-openshift-default-5d466c5bd5-jj89h\" (UID: \"4348ddc3-36e1-4f59-be98-2bac043474e7\") " pod="openshift-ingress/e2e-ait-83851760-openshift-default-5d466c5bd5-jj89h"
Oct 30 21:00:56.552065 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:56.552028    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4348ddc3-36e1-4f59-be98-2bac043474e7-workload-certs\") pod \"e2e-ait-83851760-openshift-default-5d466c5bd5-jj89h\" (UID: \"4348ddc3-36e1-4f59-be98-2bac043474e7\") " pod="openshift-ingress/e2e-ait-83851760-openshift-default-5d466c5bd5-jj89h"
Oct 30 21:00:56.552317 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:56.552267    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4348ddc3-36e1-4f59-be98-2bac043474e7-credential-socket\") pod \"e2e-ait-83851760-openshift-default-5d466c5bd5-jj89h\" (UID: \"4348ddc3-36e1-4f59-be98-2bac043474e7\") " pod="openshift-ingress/e2e-ait-83851760-openshift-default-5d466c5bd5-jj89h"
Oct 30 21:00:56.552433 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:56.552420    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4348ddc3-36e1-4f59-be98-2bac043474e7-istio-podinfo\") pod \"e2e-ait-83851760-openshift-default-5d466c5bd5-jj89h\" (UID: \"4348ddc3-36e1-4f59-be98-2bac043474e7\") " pod="openshift-ingress/e2e-ait-83851760-openshift-default-5d466c5bd5-jj89h"
Oct 30 21:00:56.552547 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:56.552536    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4348ddc3-36e1-4f59-be98-2bac043474e7-workload-socket\") pod \"e2e-ait-83851760-openshift-default-5d466c5bd5-jj89h\" (UID: \"4348ddc3-36e1-4f59-be98-2bac043474e7\") " pod="openshift-ingress/e2e-ait-83851760-openshift-default-5d466c5bd5-jj89h"
Oct 30 21:00:56.552636 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:56.552625    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4348ddc3-36e1-4f59-be98-2bac043474e7-istio-token\") pod \"e2e-ait-83851760-openshift-default-5d466c5bd5-jj89h\" (UID: \"4348ddc3-36e1-4f59-be98-2bac043474e7\") " pod="openshift-ingress/e2e-ait-83851760-openshift-default-5d466c5bd5-jj89h"
Oct 30 21:00:56.552713 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:56.552705    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4348ddc3-36e1-4f59-be98-2bac043474e7-istio-envoy\") pod \"e2e-ait-83851760-openshift-default-5d466c5bd5-jj89h\" (UID: \"4348ddc3-36e1-4f59-be98-2bac043474e7\") " pod="openshift-ingress/e2e-ait-83851760-openshift-default-5d466c5bd5-jj89h"
Oct 30 21:00:56.658070 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:56.654459    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4348ddc3-36e1-4f59-be98-2bac043474e7-istiod-ca-cert\") pod \"e2e-ait-83851760-openshift-default-5d466c5bd5-jj89h\" (UID: \"4348ddc3-36e1-4f59-be98-2bac043474e7\") " pod="openshift-ingress/e2e-ait-83851760-openshift-default-5d466c5bd5-jj89h"
Oct 30 21:00:56.658070 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:56.655294    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4348ddc3-36e1-4f59-be98-2bac043474e7-istiod-ca-cert\") pod \"e2e-ait-83851760-openshift-default-5d466c5bd5-jj89h\" (UID: \"4348ddc3-36e1-4f59-be98-2bac043474e7\") " pod="openshift-ingress/e2e-ait-83851760-openshift-default-5d466c5bd5-jj89h"
Oct 30 21:00:56.658070 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:56.655405    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4348ddc3-36e1-4f59-be98-2bac043474e7-istio-data\") pod \"e2e-ait-83851760-openshift-default-5d466c5bd5-jj89h\" (UID: \"4348ddc3-36e1-4f59-be98-2bac043474e7\") " pod="openshift-ingress/e2e-ait-83851760-openshift-default-5d466c5bd5-jj89h"
Oct 30 21:00:56.658070 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:56.655500    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d2zvw\" (UniqueName: \"kubernetes.io/projected/4348ddc3-36e1-4f59-be98-2bac043474e7-kube-api-access-d2zvw\") pod \"e2e-ait-83851760-openshift-default-5d466c5bd5-jj89h\" (UID: \"4348ddc3-36e1-4f59-be98-2bac043474e7\") " pod="openshift-ingress/e2e-ait-83851760-openshift-default-5d466c5bd5-jj89h"
Oct 30 21:00:56.658070 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:56.655553    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4348ddc3-36e1-4f59-be98-2bac043474e7-workload-certs\") pod \"e2e-ait-83851760-openshift-default-5d466c5bd5-jj89h\" (UID: \"4348ddc3-36e1-4f59-be98-2bac043474e7\") " pod="openshift-ingress/e2e-ait-83851760-openshift-default-5d466c5bd5-jj89h"
Oct 30 21:00:56.658070 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:56.655849    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4348ddc3-36e1-4f59-be98-2bac043474e7-istio-data\") pod \"e2e-ait-83851760-openshift-default-5d466c5bd5-jj89h\" (UID: \"4348ddc3-36e1-4f59-be98-2bac043474e7\") " pod="openshift-ingress/e2e-ait-83851760-openshift-default-5d466c5bd5-jj89h"
Oct 30 21:00:56.658070 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:56.655981    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4348ddc3-36e1-4f59-be98-2bac043474e7-credential-socket\") pod \"e2e-ait-83851760-openshift-default-5d466c5bd5-jj89h\" (UID: \"4348ddc3-36e1-4f59-be98-2bac043474e7\") " pod="openshift-ingress/e2e-ait-83851760-openshift-default-5d466c5bd5-jj89h"
Oct 30 21:00:56.658070 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:56.656011    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4348ddc3-36e1-4f59-be98-2bac043474e7-istio-podinfo\") pod \"e2e-ait-83851760-openshift-default-5d466c5bd5-jj89h\" (UID: \"4348ddc3-36e1-4f59-be98-2bac043474e7\") " pod="openshift-ingress/e2e-ait-83851760-openshift-default-5d466c5bd5-jj89h"
Oct 30 21:00:56.658070 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:56.656108    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4348ddc3-36e1-4f59-be98-2bac043474e7-workload-socket\") pod \"e2e-ait-83851760-openshift-default-5d466c5bd5-jj89h\" (UID: \"4348ddc3-36e1-4f59-be98-2bac043474e7\") " pod="openshift-ingress/e2e-ait-83851760-openshift-default-5d466c5bd5-jj89h"
Oct 30 21:00:56.658070 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:56.656140    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4348ddc3-36e1-4f59-be98-2bac043474e7-istio-token\") pod \"e2e-ait-83851760-openshift-default-5d466c5bd5-jj89h\" (UID: \"4348ddc3-36e1-4f59-be98-2bac043474e7\") " pod="openshift-ingress/e2e-ait-83851760-openshift-default-5d466c5bd5-jj89h"
Oct 30 21:00:56.658070 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:56.656171    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4348ddc3-36e1-4f59-be98-2bac043474e7-istio-envoy\") pod \"e2e-ait-83851760-openshift-default-5d466c5bd5-jj89h\" (UID: \"4348ddc3-36e1-4f59-be98-2bac043474e7\") " pod="openshift-ingress/e2e-ait-83851760-openshift-default-5d466c5bd5-jj89h"
Oct 30 21:00:56.658070 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:56.656171    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4348ddc3-36e1-4f59-be98-2bac043474e7-workload-certs\") pod \"e2e-ait-83851760-openshift-default-5d466c5bd5-jj89h\" (UID: \"4348ddc3-36e1-4f59-be98-2bac043474e7\") " pod="openshift-ingress/e2e-ait-83851760-openshift-default-5d466c5bd5-jj89h"
Oct 30 21:00:56.658070 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:56.656643    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4348ddc3-36e1-4f59-be98-2bac043474e7-workload-socket\") pod \"e2e-ait-83851760-openshift-default-5d466c5bd5-jj89h\" (UID: \"4348ddc3-36e1-4f59-be98-2bac043474e7\") " pod="openshift-ingress/e2e-ait-83851760-openshift-default-5d466c5bd5-jj89h"
Oct 30 21:00:56.658070 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:56.656840    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4348ddc3-36e1-4f59-be98-2bac043474e7-credential-socket\") pod \"e2e-ait-83851760-openshift-default-5d466c5bd5-jj89h\" (UID: \"4348ddc3-36e1-4f59-be98-2bac043474e7\") " pod="openshift-ingress/e2e-ait-83851760-openshift-default-5d466c5bd5-jj89h"
Oct 30 21:00:56.701075 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:56.690151    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4348ddc3-36e1-4f59-be98-2bac043474e7-istio-podinfo\") pod \"e2e-ait-83851760-openshift-default-5d466c5bd5-jj89h\" (UID: \"4348ddc3-36e1-4f59-be98-2bac043474e7\") " pod="openshift-ingress/e2e-ait-83851760-openshift-default-5d466c5bd5-jj89h"
Oct 30 21:00:56.701075 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:56.696165    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4348ddc3-36e1-4f59-be98-2bac043474e7-istio-envoy\") pod \"e2e-ait-83851760-openshift-default-5d466c5bd5-jj89h\" (UID: \"4348ddc3-36e1-4f59-be98-2bac043474e7\") " pod="openshift-ingress/e2e-ait-83851760-openshift-default-5d466c5bd5-jj89h"
Oct 30 21:00:56.717601 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:56.717566    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d2zvw\" (UniqueName: \"kubernetes.io/projected/4348ddc3-36e1-4f59-be98-2bac043474e7-kube-api-access-d2zvw\") pod \"e2e-ait-83851760-openshift-default-5d466c5bd5-jj89h\" (UID: \"4348ddc3-36e1-4f59-be98-2bac043474e7\") " pod="openshift-ingress/e2e-ait-83851760-openshift-default-5d466c5bd5-jj89h"
Oct 30 21:00:56.724553 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:56.722559    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4348ddc3-36e1-4f59-be98-2bac043474e7-istio-token\") pod \"e2e-ait-83851760-openshift-default-5d466c5bd5-jj89h\" (UID: \"4348ddc3-36e1-4f59-be98-2bac043474e7\") " pod="openshift-ingress/e2e-ait-83851760-openshift-default-5d466c5bd5-jj89h"
Oct 30 21:00:56.935638 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:56.935606    6004 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-83851760-openshift-default-5d466c5bd5-jj89h"
Oct 30 21:00:57.401199 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:57.401166    6004 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-83851760-openshift-default-5d466c5bd5-jj89h"]
Oct 30 21:00:57.401989 ip-10-0-138-85 kubenswrapper[6004]: W1030 21:00:57.401959    6004 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4348ddc3_36e1_4f59_be98_2bac043474e7.slice/crio-bcecf1398ef896dd00282d196a98b16cffe67b1314516a705c24f7560065ef4a WatchSource:0}: Error finding container bcecf1398ef896dd00282d196a98b16cffe67b1314516a705c24f7560065ef4a: Status 404 returned error can't find the container with id bcecf1398ef896dd00282d196a98b16cffe67b1314516a705c24f7560065ef4a
Oct 30 21:00:57.404944 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:57.404914    6004 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 21:00:57.405077 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:57.404973    6004 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 21:00:57.405077 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:57.405003    6004 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 21:00:57.725896 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:57.725854    6004 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-83851760-openshift-default-5d466c5bd5-jj89h" event={"ID":"4348ddc3-36e1-4f59-be98-2bac043474e7","Type":"ContainerStarted","Data":"2e029cd1131d5688c60c8a07380ecaacf791187d4dbc2e9334a1a92c930b6654"}
Oct 30 21:00:57.726407 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:57.725922    6004 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-83851760-openshift-default-5d466c5bd5-jj89h" event={"ID":"4348ddc3-36e1-4f59-be98-2bac043474e7","Type":"ContainerStarted","Data":"bcecf1398ef896dd00282d196a98b16cffe67b1314516a705c24f7560065ef4a"}
Oct 30 21:00:57.844615 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:57.844544    6004 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-83851760-openshift-default-5d466c5bd5-jj89h" podStartSLOduration=1.844524894 podStartE2EDuration="1.844524894s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:00:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:00:57.843431015 +0000 UTC m=+1363.763217135" watchObservedRunningTime="2026-10-30 21:00:57.844524894 +0000 UTC m=+1363.764311013"
Oct 30 21:00:57.936881 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:57.936841    6004 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-83851760-openshift-default-5d466c5bd5-jj89h"
Oct 30 21:00:58.942606 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:58.942573    6004 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-83851760-openshift-default-5d466c5bd5-jj89h"
Oct 30 21:00:59.743929 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:59.743898    6004 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-83851760-openshift-default-5d466c5bd5-jj89h"
Oct 30 21:00:59.744780 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:00:59.744758    6004 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-83851760-openshift-default-5d466c5bd5-jj89h"
Oct 30 21:01:14.293136 ip-10-0-138-85 kubenswrapper[6004]: E1030 21:01:14.293089    6004 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-zz4wr" containerName="extractor"
Oct 30 21:01:17.374074 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:01:17.373144    6004 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-2b425d/distinct-w5-2b425d-kserve-dd4dcf7f-b227k" podUID="802e5037-d6f5-4a37-a95f-b49dda7f8b1b" containerName="main" probeResult="failure" output="Get \"https://10.132.0.67:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:01:17.529201 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:01:17.529145    6004 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-f9f277/distinct-w1-f9f277-kserve-f947bc879-lzs6w" podUID="f4ab8826-a6f1-41e6-897f-b808635017c5" containerName="main" probeResult="failure" output="Get \"https://10.132.0.68:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:01:17.690073 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:01:17.682186    6004 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w4-1fdaa7/distinct-2-w4-1fdaa7-kserve-59f4d6788b-b6gl4" podUID="f6d2856c-84b5-426d-bfcd-ef613ab44242" containerName="main" probeResult="failure" output="Get \"https://10.132.0.73:8000/health\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:01:17.733073 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:01:17.732838    6004 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-d061d0/distinct-2-w2-d061d0-kserve-5c6bb99fbf-b4kqs" podUID="32264f6c-999b-4bad-bd2e-7664cadc0669" containerName="main" probeResult="failure" output="Get \"https://10.132.0.71:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:01:18.000131 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:01:17.999561    6004 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w4-1fdaa7-openshift-default-84586db7d5-vf7tj"]
Oct 30 21:01:18.017604 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:01:18.017573    6004 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-1fdaa7-openshift-default-84586db7d5-vf7tj"
Oct 30 21:01:18.086142 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:01:18.085145    6004 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w4-1fdaa7-openshift-default-84586db7d5-46jqd"]
Oct 30 21:01:18.113887 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:01:18.113854    6004 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w4-1fdaa7-openshift-default-84586db7d5-vf7tj"]
Oct 30 21:01:18.114243 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:01:18.114221    6004 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-1fdaa7-openshift-default-84586db7d5-46jqd"
Oct 30 21:01:18.220090 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:01:18.174273    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4f353b43-913f-4043-bac3-50b745209bf2-istio-podinfo\") pod \"e2e-worker-w4-1fdaa7-openshift-default-84586db7d5-46jqd\" (UID: \"4f353b43-913f-4043-bac3-50b745209bf2\") " pod="openshift-ingress/e2e-worker-w4-1fdaa7-openshift-default-84586db7d5-46jqd"
Oct 30 21:01:18.230201 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:01:18.230154    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4b9cc2c7-4e42-4ab3-90a8-5fda80c79f2f-credential-socket\") pod \"e2e-worker-w4-1fdaa7-openshift-default-84586db7d5-vf7tj\" (UID: \"4b9cc2c7-4e42-4ab3-90a8-5fda80c79f2f\") " pod="openshift-ingress/e2e-worker-w4-1fdaa7-openshift-default-84586db7d5-vf7tj"
Oct 30 21:01:18.231069 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:01:18.230453    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cs8kl\" (UniqueName: \"kubernetes.io/projected/4f353b43-913f-4043-bac3-50b745209bf2-kube-api-access-cs8kl\") pod \"e2e-worker-w4-1fdaa7-openshift-default-84586db7d5-46jqd\" (UID: \"4f353b43-913f-4043-bac3-50b745209bf2\") " pod="openshift-ingress/e2e-worker-w4-1fdaa7-openshift-default-84586db7d5-46jqd"
Oct 30 21:01:18.231282 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:01:18.231256    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4b9cc2c7-4e42-4ab3-90a8-5fda80c79f2f-istio-envoy\") pod \"e2e-worker-w4-1fdaa7-openshift-default-84586db7d5-vf7tj\" (UID: \"4b9cc2c7-4e42-4ab3-90a8-5fda80c79f2f\") " pod="openshift-ingress/e2e-worker-w4-1fdaa7-openshift-default-84586db7d5-vf7tj"
Oct 30 21:01:18.231414 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:01:18.231399    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4b9cc2c7-4e42-4ab3-90a8-5fda80c79f2f-istio-token\") pod \"e2e-worker-w4-1fdaa7-openshift-default-84586db7d5-vf7tj\" (UID: \"4b9cc2c7-4e42-4ab3-90a8-5fda80c79f2f\") " pod="openshift-ingress/e2e-worker-w4-1fdaa7-openshift-default-84586db7d5-vf7tj"
Oct 30 21:01:18.231512 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:01:18.231498    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4f353b43-913f-4043-bac3-50b745209bf2-workload-certs\") pod \"e2e-worker-w4-1fdaa7-openshift-default-84586db7d5-46jqd\" (UID: \"4f353b43-913f-4043-bac3-50b745209bf2\") " pod="openshift-ingress/e2e-worker-w4-1fdaa7-openshift-default-84586db7d5-46jqd"
Oct 30 21:01:18.231633 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:01:18.231620    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4b9cc2c7-4e42-4ab3-90a8-5fda80c79f2f-istiod-ca-cert\") pod \"e2e-worker-w4-1fdaa7-openshift-default-84586db7d5-vf7tj\" (UID: \"4b9cc2c7-4e42-4ab3-90a8-5fda80c79f2f\") " pod="openshift-ingress/e2e-worker-w4-1fdaa7-openshift-default-84586db7d5-vf7tj"
Oct 30 21:01:18.231730 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:01:18.231717    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4f353b43-913f-4043-bac3-50b745209bf2-istio-data\") pod \"e2e-worker-w4-1fdaa7-openshift-default-84586db7d5-46jqd\" (UID: \"4f353b43-913f-4043-bac3-50b745209bf2\") " pod="openshift-ingress/e2e-worker-w4-1fdaa7-openshift-default-84586db7d5-46jqd"
Oct 30 21:01:18.231896 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:01:18.231882    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4b9cc2c7-4e42-4ab3-90a8-5fda80c79f2f-workload-socket\") pod \"e2e-worker-w4-1fdaa7-openshift-default-84586db7d5-vf7tj\" (UID: \"4b9cc2c7-4e42-4ab3-90a8-5fda80c79f2f\") " pod="openshift-ingress/e2e-worker-w4-1fdaa7-openshift-default-84586db7d5-vf7tj"
Oct 30 21:01:18.232006 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:01:18.231992    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4b9cc2c7-4e42-4ab3-90a8-5fda80c79f2f-istio-podinfo\") pod \"e2e-worker-w4-1fdaa7-openshift-default-84586db7d5-vf7tj\" (UID: \"4b9cc2c7-4e42-4ab3-90a8-5fda80c79f2f\") " pod="openshift-ingress/e2e-worker-w4-1fdaa7-openshift-default-84586db7d5-vf7tj"
Oct 30 21:01:18.232225 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:01:18.232210    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4f353b43-913f-4043-bac3-50b745209bf2-istio-token\") pod \"e2e-worker-w4-1fdaa7-openshift-default-84586db7d5-46jqd\" (UID: \"4f353b43-913f-4043-bac3-50b745209bf2\") " pod="openshift-ingress/e2e-worker-w4-1fdaa7-openshift-default-84586db7d5-46jqd"
Oct 30 21:01:18.232360 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:01:18.232346    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-956hx\" (UniqueName: \"kubernetes.io/projected/4b9cc2c7-4e42-4ab3-90a8-5fda80c79f2f-kube-api-access-956hx\") pod \"e2e-worker-w4-1fdaa7-openshift-default-84586db7d5-vf7tj\" (UID: \"4b9cc2c7-4e42-4ab3-90a8-5fda80c79f2f\") " pod="openshift-ingress/e2e-worker-w4-1fdaa7-openshift-default-84586db7d5-vf7tj"
Oct 30 21:01:18.232508 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:01:18.232495    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4b9cc2c7-4e42-4ab3-90a8-5fda80c79f2f-workload-certs\") pod \"e2e-worker-w4-1fdaa7-openshift-default-84586db7d5-vf7tj\" (UID: \"4b9cc2c7-4e42-4ab3-90a8-5fda80c79f2f\") " pod="openshift-ingress/e2e-worker-w4-1fdaa7-openshift-default-84586db7d5-vf7tj"
Oct 30 21:01:18.232607 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:01:18.232592    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4b9cc2c7-4e42-4ab3-90a8-5fda80c79f2f-istio-data\") pod \"e2e-worker-w4-1fdaa7-openshift-default-84586db7d5-vf7tj\" (UID: \"4b9cc2c7-4e42-4ab3-90a8-5fda80c79f2f\") " pod="openshift-ingress/e2e-worker-w4-1fdaa7-openshift-default-84586db7d5-vf7tj"
Oct 30 21:01:18.232728 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:01:18.232714    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4f353b43-913f-4043-bac3-50b745209bf2-istiod-ca-cert\") pod \"e2e-worker-w4-1fdaa7-openshift-default-84586db7d5-46jqd\" (UID: \"4f353b43-913f-4043-bac3-50b745209bf2\") " pod="openshift-ingress/e2e-worker-w4-1fdaa7-openshift-default-84586db7d5-46jqd"
Oct 30 21:01:18.232849 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:01:18.232835    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4f353b43-913f-4043-bac3-50b745209bf2-credential-socket\") pod \"e2e-worker-w4-1fdaa7-openshift-default-84586db7d5-46jqd\" (UID: \"4f353b43-913f-4043-bac3-50b745209bf2\") " pod="openshift-ingress/e2e-worker-w4-1fdaa7-openshift-default-84586db7d5-46jqd"
Oct 30 21:01:18.232972 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:01:18.232958    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4f353b43-913f-4043-bac3-50b745209bf2-workload-socket\") pod \"e2e-worker-w4-1fdaa7-openshift-default-84586db7d5-46jqd\" (UID: \"4f353b43-913f-4043-bac3-50b745209bf2\") " pod="openshift-ingress/e2e-worker-w4-1fdaa7-openshift-default-84586db7d5-46jqd"
Oct 30 21:01:18.233087 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:01:18.233073    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4f353b43-913f-4043-bac3-50b745209bf2-istio-envoy\") pod \"e2e-worker-w4-1fdaa7-openshift-default-84586db7d5-46jqd\" (UID: \"4f353b43-913f-4043-bac3-50b745209bf2\") " pod="openshift-ingress/e2e-worker-w4-1fdaa7-openshift-default-84586db7d5-46jqd"
Oct 30 21:01:18.233455 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:01:18.185163    6004 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w4-1fdaa7-openshift-default-84586db7d5-46jqd"]
Oct 30 21:01:18.352097 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:01:18.334945    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4f353b43-913f-4043-bac3-50b745209bf2-credential-socket\") pod \"e2e-worker-w4-1fdaa7-openshift-default-84586db7d5-46jqd\" (UID: \"4f353b43-913f-4043-bac3-50b745209bf2\") " pod="openshift-ingress/e2e-worker-w4-1fdaa7-openshift-default-84586db7d5-46jqd"
Oct 30 21:01:18.352097 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:01:18.335011    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4f353b43-913f-4043-bac3-50b745209bf2-workload-socket\") pod \"e2e-worker-w4-1fdaa7-openshift-default-84586db7d5-46jqd\" (UID: \"4f353b43-913f-4043-bac3-50b745209bf2\") " pod="openshift-ingress/e2e-worker-w4-1fdaa7-openshift-default-84586db7d5-46jqd"
Oct 30 21:01:18.352097 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:01:18.335042    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4f353b43-913f-4043-bac3-50b745209bf2-istio-envoy\") pod \"e2e-worker-w4-1fdaa7-openshift-default-84586db7d5-46jqd\" (UID: \"4f353b43-913f-4043-bac3-50b745209bf2\") " pod="openshift-ingress/e2e-worker-w4-1fdaa7-openshift-default-84586db7d5-46jqd"
Oct 30 21:01:18.352097 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:01:18.335144    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4f353b43-913f-4043-bac3-50b745209bf2-istio-podinfo\") pod \"e2e-worker-w4-1fdaa7-openshift-default-84586db7d5-46jqd\" (UID: \"4f353b43-913f-4043-bac3-50b745209bf2\") " pod="openshift-ingress/e2e-worker-w4-1fdaa7-openshift-default-84586db7d5-46jqd"
Oct 30 21:01:18.352097 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:01:18.335180    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4b9cc2c7-4e42-4ab3-90a8-5fda80c79f2f-credential-socket\") pod \"e2e-worker-w4-1fdaa7-openshift-default-84586db7d5-vf7tj\" (UID: \"4b9cc2c7-4e42-4ab3-90a8-5fda80c79f2f\") " pod="openshift-ingress/e2e-worker-w4-1fdaa7-openshift-default-84586db7d5-vf7tj"
Oct 30 21:01:18.352097 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:01:18.335203    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cs8kl\" (UniqueName: \"kubernetes.io/projected/4f353b43-913f-4043-bac3-50b745209bf2-kube-api-access-cs8kl\") pod \"e2e-worker-w4-1fdaa7-openshift-default-84586db7d5-46jqd\" (UID: \"4f353b43-913f-4043-bac3-50b745209bf2\") " pod="openshift-ingress/e2e-worker-w4-1fdaa7-openshift-default-84586db7d5-46jqd"
Oct 30 21:01:18.352097 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:01:18.335235    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4b9cc2c7-4e42-4ab3-90a8-5fda80c79f2f-istio-envoy\") pod \"e2e-worker-w4-1fdaa7-openshift-default-84586db7d5-vf7tj\" (UID: \"4b9cc2c7-4e42-4ab3-90a8-5fda80c79f2f\") " pod="openshift-ingress/e2e-worker-w4-1fdaa7-openshift-default-84586db7d5-vf7tj"
Oct 30 21:01:18.352097 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:01:18.335268    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4b9cc2c7-4e42-4ab3-90a8-5fda80c79f2f-istio-token\") pod \"e2e-worker-w4-1fdaa7-openshift-default-84586db7d5-vf7tj\" (UID: \"4b9cc2c7-4e42-4ab3-90a8-5fda80c79f2f\") " pod="openshift-ingress/e2e-worker-w4-1fdaa7-openshift-default-84586db7d5-vf7tj"
Oct 30 21:01:18.352097 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:01:18.335289    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4f353b43-913f-4043-bac3-50b745209bf2-workload-certs\") pod \"e2e-worker-w4-1fdaa7-openshift-default-84586db7d5-46jqd\" (UID: \"4f353b43-913f-4043-bac3-50b745209bf2\") " pod="openshift-ingress/e2e-worker-w4-1fdaa7-openshift-default-84586db7d5-46jqd"
Oct 30 21:01:18.352097 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:01:18.335345    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4b9cc2c7-4e42-4ab3-90a8-5fda80c79f2f-istiod-ca-cert\") pod \"e2e-worker-w4-1fdaa7-openshift-default-84586db7d5-vf7tj\" (UID: \"4b9cc2c7-4e42-4ab3-90a8-5fda80c79f2f\") " pod="openshift-ingress/e2e-worker-w4-1fdaa7-openshift-default-84586db7d5-vf7tj"
Oct 30 21:01:18.352097 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:01:18.335367    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4f353b43-913f-4043-bac3-50b745209bf2-istio-data\") pod \"e2e-worker-w4-1fdaa7-openshift-default-84586db7d5-46jqd\" (UID: \"4f353b43-913f-4043-bac3-50b745209bf2\") " pod="openshift-ingress/e2e-worker-w4-1fdaa7-openshift-default-84586db7d5-46jqd"
Oct 30 21:01:18.352097 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:01:18.335440    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4b9cc2c7-4e42-4ab3-90a8-5fda80c79f2f-workload-socket\") pod \"e2e-worker-w4-1fdaa7-openshift-default-84586db7d5-vf7tj\" (UID: \"4b9cc2c7-4e42-4ab3-90a8-5fda80c79f2f\") " pod="openshift-ingress/e2e-worker-w4-1fdaa7-openshift-default-84586db7d5-vf7tj"
Oct 30 21:01:18.352097 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:01:18.335474    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4b9cc2c7-4e42-4ab3-90a8-5fda80c79f2f-istio-podinfo\") pod \"e2e-worker-w4-1fdaa7-openshift-default-84586db7d5-vf7tj\" (UID: \"4b9cc2c7-4e42-4ab3-90a8-5fda80c79f2f\") " pod="openshift-ingress/e2e-worker-w4-1fdaa7-openshift-default-84586db7d5-vf7tj"
Oct 30 21:01:18.352097 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:01:18.335604    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4f353b43-913f-4043-bac3-50b745209bf2-istio-token\") pod \"e2e-worker-w4-1fdaa7-openshift-default-84586db7d5-46jqd\" (UID: \"4f353b43-913f-4043-bac3-50b745209bf2\") " pod="openshift-ingress/e2e-worker-w4-1fdaa7-openshift-default-84586db7d5-46jqd"
Oct 30 21:01:18.352097 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:01:18.335653    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-956hx\" (UniqueName: \"kubernetes.io/projected/4b9cc2c7-4e42-4ab3-90a8-5fda80c79f2f-kube-api-access-956hx\") pod \"e2e-worker-w4-1fdaa7-openshift-default-84586db7d5-vf7tj\" (UID: \"4b9cc2c7-4e42-4ab3-90a8-5fda80c79f2f\") " pod="openshift-ingress/e2e-worker-w4-1fdaa7-openshift-default-84586db7d5-vf7tj"
Oct 30 21:01:18.352097 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:01:18.335728    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4b9cc2c7-4e42-4ab3-90a8-5fda80c79f2f-workload-certs\") pod \"e2e-worker-w4-1fdaa7-openshift-default-84586db7d5-vf7tj\" (UID: \"4b9cc2c7-4e42-4ab3-90a8-5fda80c79f2f\") " pod="openshift-ingress/e2e-worker-w4-1fdaa7-openshift-default-84586db7d5-vf7tj"
Oct 30 21:01:18.352097 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:01:18.335755    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4b9cc2c7-4e42-4ab3-90a8-5fda80c79f2f-istio-data\") pod \"e2e-worker-w4-1fdaa7-openshift-default-84586db7d5-vf7tj\" (UID: \"4b9cc2c7-4e42-4ab3-90a8-5fda80c79f2f\") " pod="openshift-ingress/e2e-worker-w4-1fdaa7-openshift-default-84586db7d5-vf7tj"
Oct 30 21:01:18.352097 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:01:18.335808    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4f353b43-913f-4043-bac3-50b745209bf2-istiod-ca-cert\") pod \"e2e-worker-w4-1fdaa7-openshift-default-84586db7d5-46jqd\" (UID: \"4f353b43-913f-4043-bac3-50b745209bf2\") " pod="openshift-ingress/e2e-worker-w4-1fdaa7-openshift-default-84586db7d5-46jqd"
Oct 30 21:01:18.352097 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:01:18.336691    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4f353b43-913f-4043-bac3-50b745209bf2-istiod-ca-cert\") pod \"e2e-worker-w4-1fdaa7-openshift-default-84586db7d5-46jqd\" (UID: \"4f353b43-913f-4043-bac3-50b745209bf2\") " pod="openshift-ingress/e2e-worker-w4-1fdaa7-openshift-default-84586db7d5-46jqd"
Oct 30 21:01:18.352097 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:01:18.336997    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4f353b43-913f-4043-bac3-50b745209bf2-credential-socket\") pod \"e2e-worker-w4-1fdaa7-openshift-default-84586db7d5-46jqd\" (UID: \"4f353b43-913f-4043-bac3-50b745209bf2\") " pod="openshift-ingress/e2e-worker-w4-1fdaa7-openshift-default-84586db7d5-46jqd"
Oct 30 21:01:18.352097 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:01:18.337354    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4f353b43-913f-4043-bac3-50b745209bf2-workload-socket\") pod \"e2e-worker-w4-1fdaa7-openshift-default-84586db7d5-46jqd\" (UID: \"4f353b43-913f-4043-bac3-50b745209bf2\") " pod="openshift-ingress/e2e-worker-w4-1fdaa7-openshift-default-84586db7d5-46jqd"
Oct 30 21:01:18.352097 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:01:18.340524    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4b9cc2c7-4e42-4ab3-90a8-5fda80c79f2f-istiod-ca-cert\") pod \"e2e-worker-w4-1fdaa7-openshift-default-84586db7d5-vf7tj\" (UID: \"4b9cc2c7-4e42-4ab3-90a8-5fda80c79f2f\") " pod="openshift-ingress/e2e-worker-w4-1fdaa7-openshift-default-84586db7d5-vf7tj"
Oct 30 21:01:18.352097 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:01:18.341012    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4b9cc2c7-4e42-4ab3-90a8-5fda80c79f2f-workload-certs\") pod \"e2e-worker-w4-1fdaa7-openshift-default-84586db7d5-vf7tj\" (UID: \"4b9cc2c7-4e42-4ab3-90a8-5fda80c79f2f\") " pod="openshift-ingress/e2e-worker-w4-1fdaa7-openshift-default-84586db7d5-vf7tj"
Oct 30 21:01:18.352097 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:01:18.341290    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4f353b43-913f-4043-bac3-50b745209bf2-workload-certs\") pod \"e2e-worker-w4-1fdaa7-openshift-default-84586db7d5-46jqd\" (UID: \"4f353b43-913f-4043-bac3-50b745209bf2\") " pod="openshift-ingress/e2e-worker-w4-1fdaa7-openshift-default-84586db7d5-46jqd"
Oct 30 21:01:18.352097 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:01:18.341787    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4b9cc2c7-4e42-4ab3-90a8-5fda80c79f2f-credential-socket\") pod \"e2e-worker-w4-1fdaa7-openshift-default-84586db7d5-vf7tj\" (UID: \"4b9cc2c7-4e42-4ab3-90a8-5fda80c79f2f\") " pod="openshift-ingress/e2e-worker-w4-1fdaa7-openshift-default-84586db7d5-vf7tj"
Oct 30 21:01:18.352097 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:01:18.341935    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4b9cc2c7-4e42-4ab3-90a8-5fda80c79f2f-workload-socket\") pod \"e2e-worker-w4-1fdaa7-openshift-default-84586db7d5-vf7tj\" (UID: \"4b9cc2c7-4e42-4ab3-90a8-5fda80c79f2f\") " pod="openshift-ingress/e2e-worker-w4-1fdaa7-openshift-default-84586db7d5-vf7tj"
Oct 30 21:01:18.352097 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:01:18.342289    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4b9cc2c7-4e42-4ab3-90a8-5fda80c79f2f-istio-data\") pod \"e2e-worker-w4-1fdaa7-openshift-default-84586db7d5-vf7tj\" (UID: \"4b9cc2c7-4e42-4ab3-90a8-5fda80c79f2f\") " pod="openshift-ingress/e2e-worker-w4-1fdaa7-openshift-default-84586db7d5-vf7tj"
Oct 30 21:01:18.352097 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:01:18.342551    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4f353b43-913f-4043-bac3-50b745209bf2-istio-data\") pod \"e2e-worker-w4-1fdaa7-openshift-default-84586db7d5-46jqd\" (UID: \"4f353b43-913f-4043-bac3-50b745209bf2\") " pod="openshift-ingress/e2e-worker-w4-1fdaa7-openshift-default-84586db7d5-46jqd"
Oct 30 21:01:18.352097 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:01:18.345119    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4b9cc2c7-4e42-4ab3-90a8-5fda80c79f2f-istio-podinfo\") pod \"e2e-worker-w4-1fdaa7-openshift-default-84586db7d5-vf7tj\" (UID: \"4b9cc2c7-4e42-4ab3-90a8-5fda80c79f2f\") " pod="openshift-ingress/e2e-worker-w4-1fdaa7-openshift-default-84586db7d5-vf7tj"
Oct 30 21:01:18.361574 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:01:18.361511    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4f353b43-913f-4043-bac3-50b745209bf2-istio-podinfo\") pod \"e2e-worker-w4-1fdaa7-openshift-default-84586db7d5-46jqd\" (UID: \"4f353b43-913f-4043-bac3-50b745209bf2\") " pod="openshift-ingress/e2e-worker-w4-1fdaa7-openshift-default-84586db7d5-46jqd"
Oct 30 21:01:18.361965 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:01:18.361942    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4f353b43-913f-4043-bac3-50b745209bf2-istio-envoy\") pod \"e2e-worker-w4-1fdaa7-openshift-default-84586db7d5-46jqd\" (UID: \"4f353b43-913f-4043-bac3-50b745209bf2\") " pod="openshift-ingress/e2e-worker-w4-1fdaa7-openshift-default-84586db7d5-46jqd"
Oct 30 21:01:18.364123 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:01:18.364096    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4b9cc2c7-4e42-4ab3-90a8-5fda80c79f2f-istio-envoy\") pod \"e2e-worker-w4-1fdaa7-openshift-default-84586db7d5-vf7tj\" (UID: \"4b9cc2c7-4e42-4ab3-90a8-5fda80c79f2f\") " pod="openshift-ingress/e2e-worker-w4-1fdaa7-openshift-default-84586db7d5-vf7tj"
Oct 30 21:01:18.397724 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:01:18.397663    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cs8kl\" (UniqueName: \"kubernetes.io/projected/4f353b43-913f-4043-bac3-50b745209bf2-kube-api-access-cs8kl\") pod \"e2e-worker-w4-1fdaa7-openshift-default-84586db7d5-46jqd\" (UID: \"4f353b43-913f-4043-bac3-50b745209bf2\") " pod="openshift-ingress/e2e-worker-w4-1fdaa7-openshift-default-84586db7d5-46jqd"
Oct 30 21:01:18.402493 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:01:18.402468    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4f353b43-913f-4043-bac3-50b745209bf2-istio-token\") pod \"e2e-worker-w4-1fdaa7-openshift-default-84586db7d5-46jqd\" (UID: \"4f353b43-913f-4043-bac3-50b745209bf2\") " pod="openshift-ingress/e2e-worker-w4-1fdaa7-openshift-default-84586db7d5-46jqd"
Oct 30 21:01:18.403825 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:01:18.403803    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4b9cc2c7-4e42-4ab3-90a8-5fda80c79f2f-istio-token\") pod \"e2e-worker-w4-1fdaa7-openshift-default-84586db7d5-vf7tj\" (UID: \"4b9cc2c7-4e42-4ab3-90a8-5fda80c79f2f\") " pod="openshift-ingress/e2e-worker-w4-1fdaa7-openshift-default-84586db7d5-vf7tj"
Oct 30 21:01:18.405377 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:01:18.405354    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-956hx\" (UniqueName: \"kubernetes.io/projected/4b9cc2c7-4e42-4ab3-90a8-5fda80c79f2f-kube-api-access-956hx\") pod \"e2e-worker-w4-1fdaa7-openshift-default-84586db7d5-vf7tj\" (UID: \"4b9cc2c7-4e42-4ab3-90a8-5fda80c79f2f\") " pod="openshift-ingress/e2e-worker-w4-1fdaa7-openshift-default-84586db7d5-vf7tj"
Oct 30 21:01:18.588509 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:01:18.588477    6004 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-1fdaa7-openshift-default-84586db7d5-46jqd"
Oct 30 21:01:18.684257 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:01:18.684223    6004 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-1fdaa7-openshift-default-84586db7d5-vf7tj"
Oct 30 21:01:19.029446 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:01:19.029409    6004 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w4-1fdaa7-openshift-default-84586db7d5-46jqd"]
Oct 30 21:01:19.064368 ip-10-0-138-85 kubenswrapper[6004]: W1030 21:01:19.064332    6004 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4f353b43_913f_4043_bac3_50b745209bf2.slice/crio-e54b676a863055c5e2f2f9f6b89212b36d4f89198a11f54ecc8269a5d3fb7e47 WatchSource:0}: Error finding container e54b676a863055c5e2f2f9f6b89212b36d4f89198a11f54ecc8269a5d3fb7e47: Status 404 returned error can't find the container with id e54b676a863055c5e2f2f9f6b89212b36d4f89198a11f54ecc8269a5d3fb7e47
Oct 30 21:01:19.066912 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:01:19.066881    6004 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 21:01:19.066986 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:01:19.066947    6004 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 21:01:19.066986 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:01:19.066974    6004 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 21:01:19.144488 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:01:19.144447    6004 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w4-1fdaa7-openshift-default-84586db7d5-vf7tj"]
Oct 30 21:01:19.144960 ip-10-0-138-85 kubenswrapper[6004]: W1030 21:01:19.144935    6004 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4b9cc2c7_4e42_4ab3_90a8_5fda80c79f2f.slice/crio-32010f01df7c367bcf6f8b9de47a696de8b90df1680c0b6fc418b1d50c6910ed WatchSource:0}: Error finding container 32010f01df7c367bcf6f8b9de47a696de8b90df1680c0b6fc418b1d50c6910ed: Status 404 returned error can't find the container with id 32010f01df7c367bcf6f8b9de47a696de8b90df1680c0b6fc418b1d50c6910ed
Oct 30 21:01:19.147677 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:01:19.147648    6004 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 21:01:19.147772 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:01:19.147711    6004 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 21:01:19.147772 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:01:19.147740    6004 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 21:01:19.986748 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:01:19.986705    6004 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-1fdaa7-openshift-default-84586db7d5-vf7tj" event={"ID":"4b9cc2c7-4e42-4ab3-90a8-5fda80c79f2f","Type":"ContainerStarted","Data":"0c0498ab75bea1b822fe80050b889299b3b474a7e5c4d362f2e99a6bedd5655a"}
Oct 30 21:01:19.987448 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:01:19.987416    6004 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-1fdaa7-openshift-default-84586db7d5-vf7tj" event={"ID":"4b9cc2c7-4e42-4ab3-90a8-5fda80c79f2f","Type":"ContainerStarted","Data":"32010f01df7c367bcf6f8b9de47a696de8b90df1680c0b6fc418b1d50c6910ed"}
Oct 30 21:01:19.989946 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:01:19.989907    6004 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-1fdaa7-openshift-default-84586db7d5-46jqd" event={"ID":"4f353b43-913f-4043-bac3-50b745209bf2","Type":"ContainerStarted","Data":"cf3448e334adddf7d3aa20cee5f1c6cc044d1c9a52ed324dd015bffc0a00b4a9"}
Oct 30 21:01:19.990123 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:01:19.989962    6004 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-1fdaa7-openshift-default-84586db7d5-46jqd" event={"ID":"4f353b43-913f-4043-bac3-50b745209bf2","Type":"ContainerStarted","Data":"e54b676a863055c5e2f2f9f6b89212b36d4f89198a11f54ecc8269a5d3fb7e47"}
Oct 30 21:01:20.301130 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:01:20.300459    6004 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w4-1fdaa7-openshift-default-84586db7d5-vf7tj" podStartSLOduration=3.300439025 podStartE2EDuration="3.300439025s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:01:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:01:20.181653318 +0000 UTC m=+1386.101439448" watchObservedRunningTime="2026-10-30 21:01:20.300439025 +0000 UTC m=+1386.220225144"
Oct 30 21:01:20.404347 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:01:20.403557    6004 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w4-1fdaa7-openshift-default-84586db7d5-46jqd" podStartSLOduration=3.40353517 podStartE2EDuration="3.40353517s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:01:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:01:20.399514247 +0000 UTC m=+1386.319300382" watchObservedRunningTime="2026-10-30 21:01:20.40353517 +0000 UTC m=+1386.323321289"
Oct 30 21:01:20.590943 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:01:20.590171    6004 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w4-1fdaa7-openshift-default-84586db7d5-46jqd"
Oct 30 21:01:20.591119 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:01:20.591003    6004 patch_prober.go:29] interesting pod/e2e-worker-w4-1fdaa7-openshift-default-84586db7d5-46jqd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.87:15021/healthz/ready\": dial tcp 10.132.0.87:15021: connect: connection refused" start-of-body=
Oct 30 21:01:20.591119 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:01:20.591073    6004 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-1fdaa7-openshift-default-84586db7d5-46jqd" podUID="4f353b43-913f-4043-bac3-50b745209bf2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.87:15021/healthz/ready\": dial tcp 10.132.0.87:15021: connect: connection refused"
Oct 30 21:01:20.693165 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:01:20.693123    6004 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w4-1fdaa7-openshift-default-84586db7d5-vf7tj"
Oct 30 21:01:20.694598 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:01:20.694571    6004 patch_prober.go:29] interesting pod/e2e-worker-w4-1fdaa7-openshift-default-84586db7d5-vf7tj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.86:15021/healthz/ready\": dial tcp 10.132.0.86:15021: connect: connection refused" start-of-body=
Oct 30 21:01:20.694818 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:01:20.694787    6004 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-1fdaa7-openshift-default-84586db7d5-vf7tj" podUID="4b9cc2c7-4e42-4ab3-90a8-5fda80c79f2f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.86:15021/healthz/ready\": dial tcp 10.132.0.86:15021: connect: connection refused"
Oct 30 21:01:21.590025 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:01:21.589996    6004 patch_prober.go:29] interesting pod/e2e-worker-w4-1fdaa7-openshift-default-84586db7d5-46jqd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.87:15021/healthz/ready\": dial tcp 10.132.0.87:15021: connect: connection refused" start-of-body=
Oct 30 21:01:21.590527 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:01:21.590495    6004 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-1fdaa7-openshift-default-84586db7d5-46jqd" podUID="4f353b43-913f-4043-bac3-50b745209bf2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.87:15021/healthz/ready\": dial tcp 10.132.0.87:15021: connect: connection refused"
Oct 30 21:01:21.687074 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:01:21.686433    6004 patch_prober.go:29] interesting pod/e2e-worker-w4-1fdaa7-openshift-default-84586db7d5-vf7tj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.86:15021/healthz/ready\": dial tcp 10.132.0.86:15021: connect: connection refused" start-of-body=
Oct 30 21:01:21.687074 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:01:21.686492    6004 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-1fdaa7-openshift-default-84586db7d5-vf7tj" podUID="4b9cc2c7-4e42-4ab3-90a8-5fda80c79f2f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.86:15021/healthz/ready\": dial tcp 10.132.0.86:15021: connect: connection refused"
Oct 30 21:01:22.589559 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:01:22.589519    6004 patch_prober.go:29] interesting pod/e2e-worker-w4-1fdaa7-openshift-default-84586db7d5-46jqd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.87:15021/healthz/ready\": dial tcp 10.132.0.87:15021: connect: connection refused" start-of-body=
Oct 30 21:01:22.589764 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:01:22.589574    6004 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-1fdaa7-openshift-default-84586db7d5-46jqd" podUID="4f353b43-913f-4043-bac3-50b745209bf2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.87:15021/healthz/ready\": dial tcp 10.132.0.87:15021: connect: connection refused"
Oct 30 21:01:22.687865 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:01:22.687826    6004 patch_prober.go:29] interesting pod/e2e-worker-w4-1fdaa7-openshift-default-84586db7d5-vf7tj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.86:15021/healthz/ready\": dial tcp 10.132.0.86:15021: connect: connection refused" start-of-body=
Oct 30 21:01:22.688558 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:01:22.688521    6004 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-1fdaa7-openshift-default-84586db7d5-vf7tj" podUID="4b9cc2c7-4e42-4ab3-90a8-5fda80c79f2f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.86:15021/healthz/ready\": dial tcp 10.132.0.86:15021: connect: connection refused"
Oct 30 21:01:23.598714 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:01:23.598674    6004 patch_prober.go:29] interesting pod/e2e-worker-w4-1fdaa7-openshift-default-84586db7d5-46jqd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.87:15021/healthz/ready\": dial tcp 10.132.0.87:15021: connect: connection refused" start-of-body=
Oct 30 21:01:23.599021 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:01:23.598982    6004 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-1fdaa7-openshift-default-84586db7d5-46jqd" podUID="4f353b43-913f-4043-bac3-50b745209bf2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.87:15021/healthz/ready\": dial tcp 10.132.0.87:15021: connect: connection refused"
Oct 30 21:01:23.688575 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:01:23.688533    6004 patch_prober.go:29] interesting pod/e2e-worker-w4-1fdaa7-openshift-default-84586db7d5-vf7tj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.86:15021/healthz/ready\": dial tcp 10.132.0.86:15021: connect: connection refused" start-of-body=
Oct 30 21:01:23.689222 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:01:23.689185    6004 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-1fdaa7-openshift-default-84586db7d5-vf7tj" podUID="4b9cc2c7-4e42-4ab3-90a8-5fda80c79f2f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.86:15021/healthz/ready\": dial tcp 10.132.0.86:15021: connect: connection refused"
Oct 30 21:01:24.591113 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:01:24.591075    6004 patch_prober.go:29] interesting pod/e2e-worker-w4-1fdaa7-openshift-default-84586db7d5-46jqd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.87:15021/healthz/ready\": dial tcp 10.132.0.87:15021: connect: connection refused" start-of-body=
Oct 30 21:01:24.591433 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:01:24.591400    6004 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-1fdaa7-openshift-default-84586db7d5-46jqd" podUID="4f353b43-913f-4043-bac3-50b745209bf2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.87:15021/healthz/ready\": dial tcp 10.132.0.87:15021: connect: connection refused"
Oct 30 21:01:24.685474 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:01:24.685434    6004 patch_prober.go:29] interesting pod/e2e-worker-w4-1fdaa7-openshift-default-84586db7d5-vf7tj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.86:15021/healthz/ready\": dial tcp 10.132.0.86:15021: connect: connection refused" start-of-body=
Oct 30 21:01:24.685780 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:01:24.685751    6004 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-1fdaa7-openshift-default-84586db7d5-vf7tj" podUID="4b9cc2c7-4e42-4ab3-90a8-5fda80c79f2f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.86:15021/healthz/ready\": dial tcp 10.132.0.86:15021: connect: connection refused"
Oct 30 21:01:25.589499 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:01:25.589459    6004 patch_prober.go:29] interesting pod/e2e-worker-w4-1fdaa7-openshift-default-84586db7d5-46jqd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.87:15021/healthz/ready\": dial tcp 10.132.0.87:15021: connect: connection refused" start-of-body=
Oct 30 21:01:25.590036 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:01:25.589523    6004 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-1fdaa7-openshift-default-84586db7d5-46jqd" podUID="4f353b43-913f-4043-bac3-50b745209bf2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.87:15021/healthz/ready\": dial tcp 10.132.0.87:15021: connect: connection refused"
Oct 30 21:01:25.687082 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:01:25.687016    6004 patch_prober.go:29] interesting pod/e2e-worker-w4-1fdaa7-openshift-default-84586db7d5-vf7tj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.86:15021/healthz/ready\": dial tcp 10.132.0.86:15021: connect: connection refused" start-of-body=
Oct 30 21:01:25.687440 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:01:25.687408    6004 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-1fdaa7-openshift-default-84586db7d5-vf7tj" podUID="4b9cc2c7-4e42-4ab3-90a8-5fda80c79f2f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.86:15021/healthz/ready\": dial tcp 10.132.0.86:15021: connect: connection refused"
Oct 30 21:01:26.938667 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:01:26.938634    6004 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w4-1fdaa7-openshift-default-84586db7d5-46jqd"
Oct 30 21:01:26.940134 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:01:26.940108    6004 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w4-1fdaa7-openshift-default-84586db7d5-46jqd"
Oct 30 21:01:26.940930 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:01:26.940911    6004 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w4-1fdaa7-openshift-default-84586db7d5-46jqd"
Oct 30 21:01:27.114284 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:01:27.114249    6004 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w4-1fdaa7-openshift-default-84586db7d5-vf7tj"
Oct 30 21:01:27.114598 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:01:27.114565    6004 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w4-1fdaa7-openshift-default-84586db7d5-vf7tj"
Oct 30 21:01:27.115690 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:01:27.115669    6004 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w4-1fdaa7-openshift-default-84586db7d5-vf7tj"
Oct 30 21:01:34.571955 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:01:34.571917    6004 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-2xprk"]
Oct 30 21:01:34.576250 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:01:34.576228    6004 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-2xprk"
Oct 30 21:01:34.629477 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:01:34.629439    6004 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Oct 30 21:01:34.629639 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:01:34.629538    6004 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Oct 30 21:01:34.629639 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:01:34.629562    6004 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Oct 30 21:01:34.662636 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:01:34.662596    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/1a9526fe-0a73-4405-8e2f-f2aefa4cf495-cacerts\") pod \"istiod-openshift-gateway-7ddd9cfdc8-2xprk\" (UID: \"1a9526fe-0a73-4405-8e2f-f2aefa4cf495\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-2xprk"
Oct 30 21:01:34.662636 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:01:34.662631    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s54k2\" (UniqueName: \"kubernetes.io/projected/1a9526fe-0a73-4405-8e2f-f2aefa4cf495-kube-api-access-s54k2\") pod \"istiod-openshift-gateway-7ddd9cfdc8-2xprk\" (UID: \"1a9526fe-0a73-4405-8e2f-f2aefa4cf495\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-2xprk"
Oct 30 21:01:34.662849 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:01:34.662705    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/1a9526fe-0a73-4405-8e2f-f2aefa4cf495-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7ddd9cfdc8-2xprk\" (UID: \"1a9526fe-0a73-4405-8e2f-f2aefa4cf495\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-2xprk"
Oct 30 21:01:34.662849 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:01:34.662764    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/1a9526fe-0a73-4405-8e2f-f2aefa4cf495-local-certs\") pod \"istiod-openshift-gateway-7ddd9cfdc8-2xprk\" (UID: \"1a9526fe-0a73-4405-8e2f-f2aefa4cf495\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-2xprk"
Oct 30 21:01:34.662920 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:01:34.662846    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/1a9526fe-0a73-4405-8e2f-f2aefa4cf495-istio-kubeconfig\") pod \"istiod-openshift-gateway-7ddd9cfdc8-2xprk\" (UID: \"1a9526fe-0a73-4405-8e2f-f2aefa4cf495\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-2xprk"
Oct 30 21:01:34.662920 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:01:34.662894    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1a9526fe-0a73-4405-8e2f-f2aefa4cf495-istio-token\") pod \"istiod-openshift-gateway-7ddd9cfdc8-2xprk\" (UID: \"1a9526fe-0a73-4405-8e2f-f2aefa4cf495\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-2xprk"
Oct 30 21:01:34.663101 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:01:34.663083    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/1a9526fe-0a73-4405-8e2f-f2aefa4cf495-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7ddd9cfdc8-2xprk\" (UID: \"1a9526fe-0a73-4405-8e2f-f2aefa4cf495\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-2xprk"
Oct 30 21:01:34.679669 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:01:34.679640    6004 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-pwj8h\""
Oct 30 21:01:34.684092 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:01:34.684066    6004 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-2xprk"]
Oct 30 21:01:34.767231 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:01:34.767175    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1a9526fe-0a73-4405-8e2f-f2aefa4cf495-istio-token\") pod \"istiod-openshift-gateway-7ddd9cfdc8-2xprk\" (UID: \"1a9526fe-0a73-4405-8e2f-f2aefa4cf495\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-2xprk"
Oct 30 21:01:34.767459 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:01:34.767374    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/1a9526fe-0a73-4405-8e2f-f2aefa4cf495-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7ddd9cfdc8-2xprk\" (UID: \"1a9526fe-0a73-4405-8e2f-f2aefa4cf495\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-2xprk"
Oct 30 21:01:34.767538 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:01:34.767457    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/1a9526fe-0a73-4405-8e2f-f2aefa4cf495-cacerts\") pod \"istiod-openshift-gateway-7ddd9cfdc8-2xprk\" (UID: \"1a9526fe-0a73-4405-8e2f-f2aefa4cf495\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-2xprk"
Oct 30 21:01:34.767538 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:01:34.767480    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s54k2\" (UniqueName: \"kubernetes.io/projected/1a9526fe-0a73-4405-8e2f-f2aefa4cf495-kube-api-access-s54k2\") pod \"istiod-openshift-gateway-7ddd9cfdc8-2xprk\" (UID: \"1a9526fe-0a73-4405-8e2f-f2aefa4cf495\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-2xprk"
Oct 30 21:01:34.767712 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:01:34.767573    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/1a9526fe-0a73-4405-8e2f-f2aefa4cf495-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7ddd9cfdc8-2xprk\" (UID: \"1a9526fe-0a73-4405-8e2f-f2aefa4cf495\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-2xprk"
Oct 30 21:01:34.767712 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:01:34.767650    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/1a9526fe-0a73-4405-8e2f-f2aefa4cf495-local-certs\") pod \"istiod-openshift-gateway-7ddd9cfdc8-2xprk\" (UID: \"1a9526fe-0a73-4405-8e2f-f2aefa4cf495\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-2xprk"
Oct 30 21:01:34.767830 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:01:34.767730    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/1a9526fe-0a73-4405-8e2f-f2aefa4cf495-istio-kubeconfig\") pod \"istiod-openshift-gateway-7ddd9cfdc8-2xprk\" (UID: \"1a9526fe-0a73-4405-8e2f-f2aefa4cf495\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-2xprk"
Oct 30 21:01:34.772731 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:01:34.772700    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/1a9526fe-0a73-4405-8e2f-f2aefa4cf495-local-certs\") pod \"istiod-openshift-gateway-7ddd9cfdc8-2xprk\" (UID: \"1a9526fe-0a73-4405-8e2f-f2aefa4cf495\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-2xprk"
Oct 30 21:01:34.774325 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:01:34.774299    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/1a9526fe-0a73-4405-8e2f-f2aefa4cf495-cacerts\") pod \"istiod-openshift-gateway-7ddd9cfdc8-2xprk\" (UID: \"1a9526fe-0a73-4405-8e2f-f2aefa4cf495\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-2xprk"
Oct 30 21:01:34.776612 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:01:34.776354    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/1a9526fe-0a73-4405-8e2f-f2aefa4cf495-istio-kubeconfig\") pod \"istiod-openshift-gateway-7ddd9cfdc8-2xprk\" (UID: \"1a9526fe-0a73-4405-8e2f-f2aefa4cf495\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-2xprk"
Oct 30 21:01:34.776612 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:01:34.776576    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/1a9526fe-0a73-4405-8e2f-f2aefa4cf495-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7ddd9cfdc8-2xprk\" (UID: \"1a9526fe-0a73-4405-8e2f-f2aefa4cf495\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-2xprk"
Oct 30 21:01:34.777304 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:01:34.777280    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/1a9526fe-0a73-4405-8e2f-f2aefa4cf495-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7ddd9cfdc8-2xprk\" (UID: \"1a9526fe-0a73-4405-8e2f-f2aefa4cf495\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-2xprk"
Oct 30 21:01:34.827378 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:01:34.827291    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1a9526fe-0a73-4405-8e2f-f2aefa4cf495-istio-token\") pod \"istiod-openshift-gateway-7ddd9cfdc8-2xprk\" (UID: \"1a9526fe-0a73-4405-8e2f-f2aefa4cf495\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-2xprk"
Oct 30 21:01:34.827842 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:01:34.827818    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s54k2\" (UniqueName: \"kubernetes.io/projected/1a9526fe-0a73-4405-8e2f-f2aefa4cf495-kube-api-access-s54k2\") pod \"istiod-openshift-gateway-7ddd9cfdc8-2xprk\" (UID: \"1a9526fe-0a73-4405-8e2f-f2aefa4cf495\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-2xprk"
Oct 30 21:01:34.890551 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:01:34.890514    6004 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-2xprk"
Oct 30 21:01:35.319172 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:01:35.319145    6004 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-2xprk"]
Oct 30 21:01:35.319539 ip-10-0-138-85 kubenswrapper[6004]: W1030 21:01:35.319516    6004 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1a9526fe_0a73_4405_8e2f_f2aefa4cf495.slice/crio-2870614616a249b46c1df0d09d6bb91096fb4f49b276ad38e4d2a42427db3f69 WatchSource:0}: Error finding container 2870614616a249b46c1df0d09d6bb91096fb4f49b276ad38e4d2a42427db3f69: Status 404 returned error can't find the container with id 2870614616a249b46c1df0d09d6bb91096fb4f49b276ad38e4d2a42427db3f69
Oct 30 21:01:35.366027 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:01:35.365975    6004 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-2xprk" event={"ID":"1a9526fe-0a73-4405-8e2f-f2aefa4cf495","Type":"ContainerStarted","Data":"2870614616a249b46c1df0d09d6bb91096fb4f49b276ad38e4d2a42427db3f69"}
Oct 30 21:01:39.417074 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:01:39.417018    6004 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 21:01:39.417355 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:01:39.417095    6004 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 21:01:40.402097 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:01:40.402035    6004 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-2xprk" event={"ID":"1a9526fe-0a73-4405-8e2f-f2aefa4cf495","Type":"ContainerStarted","Data":"ce0e5be9a89d64a9236d05c51783990b538a29d2c5e991caef281cf3d83955d6"}
Oct 30 21:01:40.402303 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:01:40.402116    6004 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-2xprk"
Oct 30 21:01:40.404139 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:01:40.404100    6004 patch_prober.go:29] interesting pod/istiod-openshift-gateway-7ddd9cfdc8-2xprk container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Oct 30 21:01:40.404275 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:01:40.404167    6004 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-2xprk" podUID="1a9526fe-0a73-4405-8e2f-f2aefa4cf495" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 30 21:01:40.616712 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:01:40.616635    6004 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-2xprk" podStartSLOduration=2.5224098230000003 podStartE2EDuration="6.616618072s" totalImagesPullingTime="4.094208249s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:01:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:01:40.576261232 +0000 UTC m=+1406.496047350" watchObservedRunningTime="2026-10-30 21:01:40.616618072 +0000 UTC m=+1406.536404192"
Oct 30 21:01:41.408902 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:01:41.408874    6004 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-2xprk"
Oct 30 21:01:43.092375 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:01:43.092342    6004 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-769df7846c-846s7"]
Oct 30 21:01:43.096849 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:01:43.096827    6004 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-846s7"
Oct 30 21:01:43.149564 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:01:43.149531    6004 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-qbqvq\""
Oct 30 21:01:43.218812 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:01:43.216588    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dbbzv\" (UniqueName: \"kubernetes.io/projected/a6eb53ac-7fdc-4ad3-9b83-4068cc24066b-kube-api-access-dbbzv\") pod \"maas-default-gateway-openshift-default-769df7846c-846s7\" (UID: \"a6eb53ac-7fdc-4ad3-9b83-4068cc24066b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-846s7"
Oct 30 21:01:43.218812 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:01:43.216642    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a6eb53ac-7fdc-4ad3-9b83-4068cc24066b-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-769df7846c-846s7\" (UID: \"a6eb53ac-7fdc-4ad3-9b83-4068cc24066b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-846s7"
Oct 30 21:01:43.218812 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:01:43.216730    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a6eb53ac-7fdc-4ad3-9b83-4068cc24066b-istio-data\") pod \"maas-default-gateway-openshift-default-769df7846c-846s7\" (UID: \"a6eb53ac-7fdc-4ad3-9b83-4068cc24066b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-846s7"
Oct 30 21:01:43.218812 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:01:43.216811    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a6eb53ac-7fdc-4ad3-9b83-4068cc24066b-workload-socket\") pod \"maas-default-gateway-openshift-default-769df7846c-846s7\" (UID: \"a6eb53ac-7fdc-4ad3-9b83-4068cc24066b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-846s7"
Oct 30 21:01:43.218812 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:01:43.216904    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a6eb53ac-7fdc-4ad3-9b83-4068cc24066b-istio-podinfo\") pod \"maas-default-gateway-openshift-default-769df7846c-846s7\" (UID: \"a6eb53ac-7fdc-4ad3-9b83-4068cc24066b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-846s7"
Oct 30 21:01:43.218812 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:01:43.217041    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a6eb53ac-7fdc-4ad3-9b83-4068cc24066b-credential-socket\") pod \"maas-default-gateway-openshift-default-769df7846c-846s7\" (UID: \"a6eb53ac-7fdc-4ad3-9b83-4068cc24066b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-846s7"
Oct 30 21:01:43.218812 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:01:43.217141    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a6eb53ac-7fdc-4ad3-9b83-4068cc24066b-workload-certs\") pod \"maas-default-gateway-openshift-default-769df7846c-846s7\" (UID: \"a6eb53ac-7fdc-4ad3-9b83-4068cc24066b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-846s7"
Oct 30 21:01:43.218812 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:01:43.217188    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a6eb53ac-7fdc-4ad3-9b83-4068cc24066b-istio-token\") pod \"maas-default-gateway-openshift-default-769df7846c-846s7\" (UID: \"a6eb53ac-7fdc-4ad3-9b83-4068cc24066b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-846s7"
Oct 30 21:01:43.218812 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:01:43.217216    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a6eb53ac-7fdc-4ad3-9b83-4068cc24066b-istio-envoy\") pod \"maas-default-gateway-openshift-default-769df7846c-846s7\" (UID: \"a6eb53ac-7fdc-4ad3-9b83-4068cc24066b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-846s7"
Oct 30 21:01:43.219870 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:01:43.219844    6004 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-769df7846c-846s7"]
Oct 30 21:01:43.318804 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:01:43.318754    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a6eb53ac-7fdc-4ad3-9b83-4068cc24066b-credential-socket\") pod \"maas-default-gateway-openshift-default-769df7846c-846s7\" (UID: \"a6eb53ac-7fdc-4ad3-9b83-4068cc24066b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-846s7"
Oct 30 21:01:43.318987 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:01:43.318895    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a6eb53ac-7fdc-4ad3-9b83-4068cc24066b-workload-certs\") pod \"maas-default-gateway-openshift-default-769df7846c-846s7\" (UID: \"a6eb53ac-7fdc-4ad3-9b83-4068cc24066b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-846s7"
Oct 30 21:01:43.318987 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:01:43.318941    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a6eb53ac-7fdc-4ad3-9b83-4068cc24066b-istio-token\") pod \"maas-default-gateway-openshift-default-769df7846c-846s7\" (UID: \"a6eb53ac-7fdc-4ad3-9b83-4068cc24066b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-846s7"
Oct 30 21:01:43.318987 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:01:43.318965    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a6eb53ac-7fdc-4ad3-9b83-4068cc24066b-istio-envoy\") pod \"maas-default-gateway-openshift-default-769df7846c-846s7\" (UID: \"a6eb53ac-7fdc-4ad3-9b83-4068cc24066b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-846s7"
Oct 30 21:01:43.319190 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:01:43.319021    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dbbzv\" (UniqueName: \"kubernetes.io/projected/a6eb53ac-7fdc-4ad3-9b83-4068cc24066b-kube-api-access-dbbzv\") pod \"maas-default-gateway-openshift-default-769df7846c-846s7\" (UID: \"a6eb53ac-7fdc-4ad3-9b83-4068cc24066b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-846s7"
Oct 30 21:01:43.319190 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:01:43.319095    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a6eb53ac-7fdc-4ad3-9b83-4068cc24066b-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-769df7846c-846s7\" (UID: \"a6eb53ac-7fdc-4ad3-9b83-4068cc24066b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-846s7"
Oct 30 21:01:43.319190 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:01:43.319148    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a6eb53ac-7fdc-4ad3-9b83-4068cc24066b-istio-data\") pod \"maas-default-gateway-openshift-default-769df7846c-846s7\" (UID: \"a6eb53ac-7fdc-4ad3-9b83-4068cc24066b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-846s7"
Oct 30 21:01:43.319190 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:01:43.319149    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a6eb53ac-7fdc-4ad3-9b83-4068cc24066b-credential-socket\") pod \"maas-default-gateway-openshift-default-769df7846c-846s7\" (UID: \"a6eb53ac-7fdc-4ad3-9b83-4068cc24066b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-846s7"
Oct 30 21:01:43.319394 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:01:43.319263    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a6eb53ac-7fdc-4ad3-9b83-4068cc24066b-workload-socket\") pod \"maas-default-gateway-openshift-default-769df7846c-846s7\" (UID: \"a6eb53ac-7fdc-4ad3-9b83-4068cc24066b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-846s7"
Oct 30 21:01:43.319451 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:01:43.319393    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a6eb53ac-7fdc-4ad3-9b83-4068cc24066b-istio-podinfo\") pod \"maas-default-gateway-openshift-default-769df7846c-846s7\" (UID: \"a6eb53ac-7fdc-4ad3-9b83-4068cc24066b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-846s7"
Oct 30 21:01:43.319512 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:01:43.319482    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a6eb53ac-7fdc-4ad3-9b83-4068cc24066b-workload-certs\") pod \"maas-default-gateway-openshift-default-769df7846c-846s7\" (UID: \"a6eb53ac-7fdc-4ad3-9b83-4068cc24066b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-846s7"
Oct 30 21:01:43.319790 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:01:43.319762    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a6eb53ac-7fdc-4ad3-9b83-4068cc24066b-istio-data\") pod \"maas-default-gateway-openshift-default-769df7846c-846s7\" (UID: \"a6eb53ac-7fdc-4ad3-9b83-4068cc24066b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-846s7"
Oct 30 21:01:43.320352 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:01:43.320327    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a6eb53ac-7fdc-4ad3-9b83-4068cc24066b-workload-socket\") pod \"maas-default-gateway-openshift-default-769df7846c-846s7\" (UID: \"a6eb53ac-7fdc-4ad3-9b83-4068cc24066b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-846s7"
Oct 30 21:01:43.320503 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:01:43.320478    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a6eb53ac-7fdc-4ad3-9b83-4068cc24066b-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-769df7846c-846s7\" (UID: \"a6eb53ac-7fdc-4ad3-9b83-4068cc24066b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-846s7"
Oct 30 21:01:43.322194 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:01:43.322166    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a6eb53ac-7fdc-4ad3-9b83-4068cc24066b-istio-podinfo\") pod \"maas-default-gateway-openshift-default-769df7846c-846s7\" (UID: \"a6eb53ac-7fdc-4ad3-9b83-4068cc24066b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-846s7"
Oct 30 21:01:43.322726 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:01:43.322707    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a6eb53ac-7fdc-4ad3-9b83-4068cc24066b-istio-envoy\") pod \"maas-default-gateway-openshift-default-769df7846c-846s7\" (UID: \"a6eb53ac-7fdc-4ad3-9b83-4068cc24066b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-846s7"
Oct 30 21:01:43.377411 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:01:43.377336    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a6eb53ac-7fdc-4ad3-9b83-4068cc24066b-istio-token\") pod \"maas-default-gateway-openshift-default-769df7846c-846s7\" (UID: \"a6eb53ac-7fdc-4ad3-9b83-4068cc24066b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-846s7"
Oct 30 21:01:43.377548 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:01:43.377433    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dbbzv\" (UniqueName: \"kubernetes.io/projected/a6eb53ac-7fdc-4ad3-9b83-4068cc24066b-kube-api-access-dbbzv\") pod \"maas-default-gateway-openshift-default-769df7846c-846s7\" (UID: \"a6eb53ac-7fdc-4ad3-9b83-4068cc24066b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-846s7"
Oct 30 21:01:43.410082 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:01:43.410036    6004 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-846s7"
Oct 30 21:01:43.844253 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:01:43.844219    6004 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-769df7846c-846s7"]
Oct 30 21:01:43.844569 ip-10-0-138-85 kubenswrapper[6004]: W1030 21:01:43.844539    6004 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda6eb53ac_7fdc_4ad3_9b83_4068cc24066b.slice/crio-88f5ef2e382ad7cd28766fff51c4bc3a3aff6f9028fffb2d2d8c6698198fa7f5 WatchSource:0}: Error finding container 88f5ef2e382ad7cd28766fff51c4bc3a3aff6f9028fffb2d2d8c6698198fa7f5: Status 404 returned error can't find the container with id 88f5ef2e382ad7cd28766fff51c4bc3a3aff6f9028fffb2d2d8c6698198fa7f5
Oct 30 21:01:43.847236 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:01:43.847201    6004 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 21:01:43.847345 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:01:43.847287    6004 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 21:01:43.847385 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:01:43.847338    6004 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 21:01:44.289749 ip-10-0-138-85 kubenswrapper[6004]: E1030 21:01:44.289717    6004 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-zz4wr" containerName="extractor"
Oct 30 21:01:44.430629 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:01:44.430588    6004 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-846s7" event={"ID":"a6eb53ac-7fdc-4ad3-9b83-4068cc24066b","Type":"ContainerStarted","Data":"13e9f43fc864a860d74223992db442d25d387c0b567be0072bcdc38abc5c604d"}
Oct 30 21:01:44.430812 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:01:44.430651    6004 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-846s7" event={"ID":"a6eb53ac-7fdc-4ad3-9b83-4068cc24066b","Type":"ContainerStarted","Data":"88f5ef2e382ad7cd28766fff51c4bc3a3aff6f9028fffb2d2d8c6698198fa7f5"}
Oct 30 21:01:44.560132 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:01:44.555860    6004 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-846s7" podStartSLOduration=1.5558372249999999 podStartE2EDuration="1.555837225s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:01:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:01:44.552544901 +0000 UTC m=+1410.472331020" watchObservedRunningTime="2026-10-30 21:01:44.555837225 +0000 UTC m=+1410.475623343"
Oct 30 21:01:45.410407 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:01:45.410358    6004 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-846s7"
Oct 30 21:01:45.412261 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:01:45.412230    6004 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-769df7846c-846s7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.89:15021/healthz/ready\": dial tcp 10.132.0.89:15021: connect: connection refused" start-of-body=
Oct 30 21:01:45.412375 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:01:45.412277    6004 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-846s7" podUID="a6eb53ac-7fdc-4ad3-9b83-4068cc24066b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.89:15021/healthz/ready\": dial tcp 10.132.0.89:15021: connect: connection refused"
Oct 30 21:01:46.411437 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:01:46.411398    6004 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-769df7846c-846s7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.89:15021/healthz/ready\": dial tcp 10.132.0.89:15021: connect: connection refused" start-of-body=
Oct 30 21:01:46.411838 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:01:46.411464    6004 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-846s7" podUID="a6eb53ac-7fdc-4ad3-9b83-4068cc24066b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.89:15021/healthz/ready\": dial tcp 10.132.0.89:15021: connect: connection refused"
Oct 30 21:01:47.410583 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:01:47.410545    6004 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-769df7846c-846s7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.89:15021/healthz/ready\": dial tcp 10.132.0.89:15021: connect: connection refused" start-of-body=
Oct 30 21:01:47.410794 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:01:47.410617    6004 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-846s7" podUID="a6eb53ac-7fdc-4ad3-9b83-4068cc24066b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.89:15021/healthz/ready\": dial tcp 10.132.0.89:15021: connect: connection refused"
Oct 30 21:01:48.410585 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:01:48.410547    6004 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-769df7846c-846s7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.89:15021/healthz/ready\": dial tcp 10.132.0.89:15021: connect: connection refused" start-of-body=
Oct 30 21:01:48.411100 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:01:48.410609    6004 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-846s7" podUID="a6eb53ac-7fdc-4ad3-9b83-4068cc24066b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.89:15021/healthz/ready\": dial tcp 10.132.0.89:15021: connect: connection refused"
Oct 30 21:01:49.411427 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:01:49.411388    6004 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-769df7846c-846s7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.89:15021/healthz/ready\": dial tcp 10.132.0.89:15021: connect: connection refused" start-of-body=
Oct 30 21:01:49.411928 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:01:49.411452    6004 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-846s7" podUID="a6eb53ac-7fdc-4ad3-9b83-4068cc24066b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.89:15021/healthz/ready\": dial tcp 10.132.0.89:15021: connect: connection refused"
Oct 30 21:01:50.411452 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:01:50.411411    6004 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-769df7846c-846s7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.89:15021/healthz/ready\": dial tcp 10.132.0.89:15021: connect: connection refused" start-of-body=
Oct 30 21:01:50.411963 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:01:50.411475    6004 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-846s7" podUID="a6eb53ac-7fdc-4ad3-9b83-4068cc24066b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.89:15021/healthz/ready\": dial tcp 10.132.0.89:15021: connect: connection refused"
Oct 30 21:01:51.410828 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:01:51.410789    6004 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-769df7846c-846s7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.89:15021/healthz/ready\": dial tcp 10.132.0.89:15021: connect: connection refused" start-of-body=
Oct 30 21:01:51.411018 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:01:51.410863    6004 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-846s7" podUID="a6eb53ac-7fdc-4ad3-9b83-4068cc24066b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.89:15021/healthz/ready\": dial tcp 10.132.0.89:15021: connect: connection refused"
Oct 30 21:01:52.438106 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:01:52.438070    6004 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-846s7"
Oct 30 21:01:52.438727 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:01:52.438701    6004 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-846s7"
Oct 30 21:01:52.439992 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:01:52.439970    6004 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-846s7"
Oct 30 21:02:02.518201 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:02:02.518149    6004 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-f9f277/distinct-w1-f9f277-kserve-f947bc879-lzs6w" podUID="f4ab8826-a6f1-41e6-897f-b808635017c5" containerName="main" probeResult="failure" output="Get \"https://10.132.0.68:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:02:02.669237 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:02:02.668130    6004 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-d061d0/premium-w2-d061d0-kserve-5c589d8c9f-rt7v4" podUID="769fd172-1d4c-4cd3-8eda-e8d4850c0f67" containerName="main" probeResult="failure" output="Get \"https://10.132.0.62:8000/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:02:02.736392 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:02:02.736324    6004 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-d061d0/distinct-2-w2-d061d0-kserve-5c6bb99fbf-b4kqs" podUID="32264f6c-999b-4bad-bd2e-7664cadc0669" containerName="main" probeResult="failure" output="Get \"https://10.132.0.71:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:02:03.317708 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:02:03.317664    6004 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-1fdaa7/distinct-2-w4-1fdaa7-kserve-59f4d6788b-b6gl4" podUID="f6d2856c-84b5-426d-bfcd-ef613ab44242" containerName="main" probeResult="failure" output="Get \"https://10.132.0.73:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:02:03.386076 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:02:03.377868    6004 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-2b425d/distinct-w5-2b425d-kserve-dd4dcf7f-b227k" podUID="802e5037-d6f5-4a37-a95f-b49dda7f8b1b" containerName="main" probeResult="failure" output="Get \"https://10.132.0.67:8000/ready\": context deadline exceeded"
Oct 30 21:02:03.523567 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:02:03.522284    6004 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-f9f277/distinct-w1-f9f277-kserve-f947bc879-lzs6w" podUID="f4ab8826-a6f1-41e6-897f-b808635017c5" containerName="main" probeResult="failure" output="Get \"https://10.132.0.68:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:02:03.525372 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:02:03.524317    6004 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w1-f9f277/distinct-w1-f9f277-kserve-f947bc879-lzs6w"
Oct 30 21:02:03.674008 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:02:03.672129    6004 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-d061d0/premium-w2-d061d0-kserve-5c589d8c9f-rt7v4" podUID="769fd172-1d4c-4cd3-8eda-e8d4850c0f67" containerName="main" probeResult="failure" output="Get \"https://10.132.0.62:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:02:03.674008 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:02:03.672847    6004 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w2-d061d0/premium-w2-d061d0-kserve-5c589d8c9f-rt7v4"
Oct 30 21:02:03.753786 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:02:03.752173    6004 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-d061d0/distinct-2-w2-d061d0-kserve-5c6bb99fbf-b4kqs" podUID="32264f6c-999b-4bad-bd2e-7664cadc0669" containerName="main" probeResult="failure" output="Get \"https://10.132.0.71:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:02:03.753786 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:02:03.752651    6004 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w2-d061d0/distinct-2-w2-d061d0-kserve-5c6bb99fbf-b4kqs"
Oct 30 21:02:03.817157 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:02:03.817044    6004 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w2-d061d0/distinct-2-w2-d061d0-kserve-5c6bb99fbf-b4kqs"
Oct 30 21:02:04.399074 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:02:04.398227    6004 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-2b425d/distinct-w5-2b425d-kserve-dd4dcf7f-b227k" podUID="802e5037-d6f5-4a37-a95f-b49dda7f8b1b" containerName="main" probeResult="failure" output="Get \"https://10.132.0.67:8000/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:02:04.446936 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:02:04.446904    6004 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w2-d061d0/premium-w2-d061d0-kserve-5c589d8c9f-rt7v4"
Oct 30 21:02:04.447259 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:02:04.447241    6004 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w1-f9f277/distinct-w1-f9f277-kserve-f947bc879-lzs6w"
Oct 30 21:02:04.474259 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:02:04.474217    6004 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w5-2b425d/distinct-w5-2b425d-kserve-dd4dcf7f-b227k"
Oct 30 21:02:05.044187 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:02:05.042580    6004 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w5-2b425d/distinct-w5-2b425d-kserve-dd4dcf7f-b227k"
Oct 30 21:02:14.289314 ip-10-0-138-85 kubenswrapper[6004]: E1030 21:02:14.289269    6004 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-zz4wr" containerName="extractor"
Oct 30 21:02:28.465488 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:02:28.465402    6004 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-769df7846c-lvdfj"]
Oct 30 21:02:28.473845 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:02:28.473818    6004 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-lvdfj"
Oct 30 21:02:28.583662 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:02:28.583625    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/44ec9e0c-2e06-45a6-a8bb-871640460980-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-769df7846c-lvdfj\" (UID: \"44ec9e0c-2e06-45a6-a8bb-871640460980\") " pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-lvdfj"
Oct 30 21:02:28.583869 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:02:28.583762    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/44ec9e0c-2e06-45a6-a8bb-871640460980-workload-socket\") pod \"maas-default-gateway-openshift-default-769df7846c-lvdfj\" (UID: \"44ec9e0c-2e06-45a6-a8bb-871640460980\") " pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-lvdfj"
Oct 30 21:02:28.583869 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:02:28.583852    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/44ec9e0c-2e06-45a6-a8bb-871640460980-istio-data\") pod \"maas-default-gateway-openshift-default-769df7846c-lvdfj\" (UID: \"44ec9e0c-2e06-45a6-a8bb-871640460980\") " pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-lvdfj"
Oct 30 21:02:28.583985 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:02:28.583887    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/44ec9e0c-2e06-45a6-a8bb-871640460980-credential-socket\") pod \"maas-default-gateway-openshift-default-769df7846c-lvdfj\" (UID: \"44ec9e0c-2e06-45a6-a8bb-871640460980\") " pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-lvdfj"
Oct 30 21:02:28.583985 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:02:28.583925    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rlzj9\" (UniqueName: \"kubernetes.io/projected/44ec9e0c-2e06-45a6-a8bb-871640460980-kube-api-access-rlzj9\") pod \"maas-default-gateway-openshift-default-769df7846c-lvdfj\" (UID: \"44ec9e0c-2e06-45a6-a8bb-871640460980\") " pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-lvdfj"
Oct 30 21:02:28.584115 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:02:28.583996    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/44ec9e0c-2e06-45a6-a8bb-871640460980-istio-envoy\") pod \"maas-default-gateway-openshift-default-769df7846c-lvdfj\" (UID: \"44ec9e0c-2e06-45a6-a8bb-871640460980\") " pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-lvdfj"
Oct 30 21:02:28.584115 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:02:28.584043    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/44ec9e0c-2e06-45a6-a8bb-871640460980-istio-token\") pod \"maas-default-gateway-openshift-default-769df7846c-lvdfj\" (UID: \"44ec9e0c-2e06-45a6-a8bb-871640460980\") " pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-lvdfj"
Oct 30 21:02:28.584115 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:02:28.584110    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/44ec9e0c-2e06-45a6-a8bb-871640460980-istio-podinfo\") pod \"maas-default-gateway-openshift-default-769df7846c-lvdfj\" (UID: \"44ec9e0c-2e06-45a6-a8bb-871640460980\") " pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-lvdfj"
Oct 30 21:02:28.584281 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:02:28.584135    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/44ec9e0c-2e06-45a6-a8bb-871640460980-workload-certs\") pod \"maas-default-gateway-openshift-default-769df7846c-lvdfj\" (UID: \"44ec9e0c-2e06-45a6-a8bb-871640460980\") " pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-lvdfj"
Oct 30 21:02:28.599470 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:02:28.599436    6004 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-769df7846c-lvdfj"]
Oct 30 21:02:28.685515 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:02:28.685481    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/44ec9e0c-2e06-45a6-a8bb-871640460980-istio-token\") pod \"maas-default-gateway-openshift-default-769df7846c-lvdfj\" (UID: \"44ec9e0c-2e06-45a6-a8bb-871640460980\") " pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-lvdfj"
Oct 30 21:02:28.685698 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:02:28.685542    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/44ec9e0c-2e06-45a6-a8bb-871640460980-istio-podinfo\") pod \"maas-default-gateway-openshift-default-769df7846c-lvdfj\" (UID: \"44ec9e0c-2e06-45a6-a8bb-871640460980\") " pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-lvdfj"
Oct 30 21:02:28.685698 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:02:28.685576    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/44ec9e0c-2e06-45a6-a8bb-871640460980-workload-certs\") pod \"maas-default-gateway-openshift-default-769df7846c-lvdfj\" (UID: \"44ec9e0c-2e06-45a6-a8bb-871640460980\") " pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-lvdfj"
Oct 30 21:02:28.685698 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:02:28.685614    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/44ec9e0c-2e06-45a6-a8bb-871640460980-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-769df7846c-lvdfj\" (UID: \"44ec9e0c-2e06-45a6-a8bb-871640460980\") " pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-lvdfj"
Oct 30 21:02:28.685857 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:02:28.685727    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/44ec9e0c-2e06-45a6-a8bb-871640460980-workload-socket\") pod \"maas-default-gateway-openshift-default-769df7846c-lvdfj\" (UID: \"44ec9e0c-2e06-45a6-a8bb-871640460980\") " pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-lvdfj"
Oct 30 21:02:28.685857 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:02:28.685822    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/44ec9e0c-2e06-45a6-a8bb-871640460980-istio-data\") pod \"maas-default-gateway-openshift-default-769df7846c-lvdfj\" (UID: \"44ec9e0c-2e06-45a6-a8bb-871640460980\") " pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-lvdfj"
Oct 30 21:02:28.685963 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:02:28.685873    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/44ec9e0c-2e06-45a6-a8bb-871640460980-credential-socket\") pod \"maas-default-gateway-openshift-default-769df7846c-lvdfj\" (UID: \"44ec9e0c-2e06-45a6-a8bb-871640460980\") " pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-lvdfj"
Oct 30 21:02:28.685963 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:02:28.685929    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rlzj9\" (UniqueName: \"kubernetes.io/projected/44ec9e0c-2e06-45a6-a8bb-871640460980-kube-api-access-rlzj9\") pod \"maas-default-gateway-openshift-default-769df7846c-lvdfj\" (UID: \"44ec9e0c-2e06-45a6-a8bb-871640460980\") " pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-lvdfj"
Oct 30 21:02:28.686118 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:02:28.686084    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/44ec9e0c-2e06-45a6-a8bb-871640460980-workload-certs\") pod \"maas-default-gateway-openshift-default-769df7846c-lvdfj\" (UID: \"44ec9e0c-2e06-45a6-a8bb-871640460980\") " pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-lvdfj"
Oct 30 21:02:28.686291 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:02:28.686145    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/44ec9e0c-2e06-45a6-a8bb-871640460980-istio-envoy\") pod \"maas-default-gateway-openshift-default-769df7846c-lvdfj\" (UID: \"44ec9e0c-2e06-45a6-a8bb-871640460980\") " pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-lvdfj"
Oct 30 21:02:28.686394 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:02:28.686372    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/44ec9e0c-2e06-45a6-a8bb-871640460980-istio-data\") pod \"maas-default-gateway-openshift-default-769df7846c-lvdfj\" (UID: \"44ec9e0c-2e06-45a6-a8bb-871640460980\") " pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-lvdfj"
Oct 30 21:02:28.686577 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:02:28.686553    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/44ec9e0c-2e06-45a6-a8bb-871640460980-workload-socket\") pod \"maas-default-gateway-openshift-default-769df7846c-lvdfj\" (UID: \"44ec9e0c-2e06-45a6-a8bb-871640460980\") " pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-lvdfj"
Oct 30 21:02:28.686666 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:02:28.686633    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/44ec9e0c-2e06-45a6-a8bb-871640460980-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-769df7846c-lvdfj\" (UID: \"44ec9e0c-2e06-45a6-a8bb-871640460980\") " pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-lvdfj"
Oct 30 21:02:28.686729 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:02:28.686702    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/44ec9e0c-2e06-45a6-a8bb-871640460980-credential-socket\") pod \"maas-default-gateway-openshift-default-769df7846c-lvdfj\" (UID: \"44ec9e0c-2e06-45a6-a8bb-871640460980\") " pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-lvdfj"
Oct 30 21:02:28.688155 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:02:28.688135    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/44ec9e0c-2e06-45a6-a8bb-871640460980-istio-podinfo\") pod \"maas-default-gateway-openshift-default-769df7846c-lvdfj\" (UID: \"44ec9e0c-2e06-45a6-a8bb-871640460980\") " pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-lvdfj"
Oct 30 21:02:28.689819 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:02:28.689793    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/44ec9e0c-2e06-45a6-a8bb-871640460980-istio-envoy\") pod \"maas-default-gateway-openshift-default-769df7846c-lvdfj\" (UID: \"44ec9e0c-2e06-45a6-a8bb-871640460980\") " pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-lvdfj"
Oct 30 21:02:28.749828 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:02:28.749753    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/44ec9e0c-2e06-45a6-a8bb-871640460980-istio-token\") pod \"maas-default-gateway-openshift-default-769df7846c-lvdfj\" (UID: \"44ec9e0c-2e06-45a6-a8bb-871640460980\") " pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-lvdfj"
Oct 30 21:02:28.750040 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:02:28.749987    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rlzj9\" (UniqueName: \"kubernetes.io/projected/44ec9e0c-2e06-45a6-a8bb-871640460980-kube-api-access-rlzj9\") pod \"maas-default-gateway-openshift-default-769df7846c-lvdfj\" (UID: \"44ec9e0c-2e06-45a6-a8bb-871640460980\") " pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-lvdfj"
Oct 30 21:02:28.790282 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:02:28.790249    6004 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-lvdfj"
Oct 30 21:02:29.249672 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:02:29.249641    6004 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-769df7846c-lvdfj"]
Oct 30 21:02:29.250611 ip-10-0-138-85 kubenswrapper[6004]: W1030 21:02:29.250582    6004 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod44ec9e0c_2e06_45a6_a8bb_871640460980.slice/crio-608368f2034be321895e590072ac6f58488582d14f18566e3836b6b6c045241f WatchSource:0}: Error finding container 608368f2034be321895e590072ac6f58488582d14f18566e3836b6b6c045241f: Status 404 returned error can't find the container with id 608368f2034be321895e590072ac6f58488582d14f18566e3836b6b6c045241f
Oct 30 21:02:29.253180 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:02:29.253143    6004 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 21:02:29.253279 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:02:29.253224    6004 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 21:02:29.253279 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:02:29.253269    6004 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 21:02:29.930389 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:02:29.930353    6004 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-lvdfj" event={"ID":"44ec9e0c-2e06-45a6-a8bb-871640460980","Type":"ContainerStarted","Data":"fb3684cc1646ca1f6190899db5252143fd3a874b95f63fa88a452a51b5184ec1"}
Oct 30 21:02:29.930844 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:02:29.930418    6004 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-lvdfj" event={"ID":"44ec9e0c-2e06-45a6-a8bb-871640460980","Type":"ContainerStarted","Data":"608368f2034be321895e590072ac6f58488582d14f18566e3836b6b6c045241f"}
Oct 30 21:02:30.101202 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:02:30.101132    6004 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-lvdfj" podStartSLOduration=2.101117089 podStartE2EDuration="2.101117089s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:02:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:02:30.099019882 +0000 UTC m=+1456.018806000" watchObservedRunningTime="2026-10-30 21:02:30.101117089 +0000 UTC m=+1456.020903207"
Oct 30 21:02:30.791748 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:02:30.791715    6004 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-lvdfj"
Oct 30 21:02:30.796567 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:02:30.796531    6004 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-769df7846c-lvdfj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.90:15021/healthz/ready\": dial tcp 10.132.0.90:15021: connect: connection refused" start-of-body=
Oct 30 21:02:30.796830 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:02:30.796802    6004 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-lvdfj" podUID="44ec9e0c-2e06-45a6-a8bb-871640460980" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.90:15021/healthz/ready\": dial tcp 10.132.0.90:15021: connect: connection refused"
Oct 30 21:02:31.791530 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:02:31.791494    6004 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-769df7846c-lvdfj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.90:15021/healthz/ready\": dial tcp 10.132.0.90:15021: connect: connection refused" start-of-body=
Oct 30 21:02:31.791960 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:02:31.791549    6004 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-lvdfj" podUID="44ec9e0c-2e06-45a6-a8bb-871640460980" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.90:15021/healthz/ready\": dial tcp 10.132.0.90:15021: connect: connection refused"
Oct 30 21:02:32.791066 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:02:32.791018    6004 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-769df7846c-lvdfj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.90:15021/healthz/ready\": dial tcp 10.132.0.90:15021: connect: connection refused" start-of-body=
Oct 30 21:02:32.791264 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:02:32.791111    6004 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-lvdfj" podUID="44ec9e0c-2e06-45a6-a8bb-871640460980" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.90:15021/healthz/ready\": dial tcp 10.132.0.90:15021: connect: connection refused"
Oct 30 21:02:33.791424 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:02:33.791388    6004 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-769df7846c-lvdfj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.90:15021/healthz/ready\": dial tcp 10.132.0.90:15021: connect: connection refused" start-of-body=
Oct 30 21:02:33.791878 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:02:33.791460    6004 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-lvdfj" podUID="44ec9e0c-2e06-45a6-a8bb-871640460980" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.90:15021/healthz/ready\": dial tcp 10.132.0.90:15021: connect: connection refused"
Oct 30 21:02:34.790767 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:02:34.790734    6004 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-769df7846c-lvdfj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.90:15021/healthz/ready\": dial tcp 10.132.0.90:15021: connect: connection refused" start-of-body=
Oct 30 21:02:34.791085 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:02:34.790786    6004 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-lvdfj" podUID="44ec9e0c-2e06-45a6-a8bb-871640460980" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.90:15021/healthz/ready\": dial tcp 10.132.0.90:15021: connect: connection refused"
Oct 30 21:02:35.790963 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:02:35.790927    6004 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-769df7846c-lvdfj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.90:15021/healthz/ready\": dial tcp 10.132.0.90:15021: connect: connection refused" start-of-body=
Oct 30 21:02:35.791418 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:02:35.790982    6004 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-lvdfj" podUID="44ec9e0c-2e06-45a6-a8bb-871640460980" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.90:15021/healthz/ready\": dial tcp 10.132.0.90:15021: connect: connection refused"
Oct 30 21:02:36.790764 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:02:36.790722    6004 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-769df7846c-lvdfj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.90:15021/healthz/ready\": dial tcp 10.132.0.90:15021: connect: connection refused" start-of-body=
Oct 30 21:02:36.790941 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:02:36.790781    6004 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-lvdfj" podUID="44ec9e0c-2e06-45a6-a8bb-871640460980" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.90:15021/healthz/ready\": dial tcp 10.132.0.90:15021: connect: connection refused"
Oct 30 21:02:38.372550 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:02:38.372516    6004 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-lvdfj"
Oct 30 21:02:38.373560 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:02:38.373529    6004 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-lvdfj"
Oct 30 21:02:38.374467 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:02:38.374435    6004 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-lvdfj"
Oct 30 21:02:43.567944 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:02:43.567902    6004 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-769df7846c-r95sw"]
Oct 30 21:02:43.573270 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:02:43.573245    6004 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-r95sw"
Oct 30 21:02:43.684017 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:02:43.681765    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tst9n\" (UniqueName: \"kubernetes.io/projected/230542f2-9ac3-4abe-83af-8f63a2c3c240-kube-api-access-tst9n\") pod \"maas-default-gateway-openshift-default-769df7846c-r95sw\" (UID: \"230542f2-9ac3-4abe-83af-8f63a2c3c240\") " pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-r95sw"
Oct 30 21:02:43.684017 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:02:43.681849    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/230542f2-9ac3-4abe-83af-8f63a2c3c240-istio-envoy\") pod \"maas-default-gateway-openshift-default-769df7846c-r95sw\" (UID: \"230542f2-9ac3-4abe-83af-8f63a2c3c240\") " pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-r95sw"
Oct 30 21:02:43.684017 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:02:43.681896    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/230542f2-9ac3-4abe-83af-8f63a2c3c240-istio-token\") pod \"maas-default-gateway-openshift-default-769df7846c-r95sw\" (UID: \"230542f2-9ac3-4abe-83af-8f63a2c3c240\") " pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-r95sw"
Oct 30 21:02:43.684017 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:02:43.681925    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/230542f2-9ac3-4abe-83af-8f63a2c3c240-workload-certs\") pod \"maas-default-gateway-openshift-default-769df7846c-r95sw\" (UID: \"230542f2-9ac3-4abe-83af-8f63a2c3c240\") " pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-r95sw"
Oct 30 21:02:43.684017 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:02:43.681988    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/230542f2-9ac3-4abe-83af-8f63a2c3c240-workload-socket\") pod \"maas-default-gateway-openshift-default-769df7846c-r95sw\" (UID: \"230542f2-9ac3-4abe-83af-8f63a2c3c240\") " pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-r95sw"
Oct 30 21:02:43.684017 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:02:43.682027    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/230542f2-9ac3-4abe-83af-8f63a2c3c240-istio-data\") pod \"maas-default-gateway-openshift-default-769df7846c-r95sw\" (UID: \"230542f2-9ac3-4abe-83af-8f63a2c3c240\") " pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-r95sw"
Oct 30 21:02:43.684017 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:02:43.682211    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/230542f2-9ac3-4abe-83af-8f63a2c3c240-credential-socket\") pod \"maas-default-gateway-openshift-default-769df7846c-r95sw\" (UID: \"230542f2-9ac3-4abe-83af-8f63a2c3c240\") " pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-r95sw"
Oct 30 21:02:43.684017 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:02:43.682297    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/230542f2-9ac3-4abe-83af-8f63a2c3c240-istio-podinfo\") pod \"maas-default-gateway-openshift-default-769df7846c-r95sw\" (UID: \"230542f2-9ac3-4abe-83af-8f63a2c3c240\") " pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-r95sw"
Oct 30 21:02:43.684017 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:02:43.682322    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/230542f2-9ac3-4abe-83af-8f63a2c3c240-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-769df7846c-r95sw\" (UID: \"230542f2-9ac3-4abe-83af-8f63a2c3c240\") " pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-r95sw"
Oct 30 21:02:43.684017 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:02:43.683362    6004 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-769df7846c-r95sw"]
Oct 30 21:02:43.783449 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:02:43.783412    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/230542f2-9ac3-4abe-83af-8f63a2c3c240-istio-envoy\") pod \"maas-default-gateway-openshift-default-769df7846c-r95sw\" (UID: \"230542f2-9ac3-4abe-83af-8f63a2c3c240\") " pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-r95sw"
Oct 30 21:02:43.783449 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:02:43.783463    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/230542f2-9ac3-4abe-83af-8f63a2c3c240-istio-token\") pod \"maas-default-gateway-openshift-default-769df7846c-r95sw\" (UID: \"230542f2-9ac3-4abe-83af-8f63a2c3c240\") " pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-r95sw"
Oct 30 21:02:43.783709 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:02:43.783488    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/230542f2-9ac3-4abe-83af-8f63a2c3c240-workload-certs\") pod \"maas-default-gateway-openshift-default-769df7846c-r95sw\" (UID: \"230542f2-9ac3-4abe-83af-8f63a2c3c240\") " pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-r95sw"
Oct 30 21:02:43.783709 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:02:43.783528    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/230542f2-9ac3-4abe-83af-8f63a2c3c240-workload-socket\") pod \"maas-default-gateway-openshift-default-769df7846c-r95sw\" (UID: \"230542f2-9ac3-4abe-83af-8f63a2c3c240\") " pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-r95sw"
Oct 30 21:02:43.783709 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:02:43.783550    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/230542f2-9ac3-4abe-83af-8f63a2c3c240-istio-data\") pod \"maas-default-gateway-openshift-default-769df7846c-r95sw\" (UID: \"230542f2-9ac3-4abe-83af-8f63a2c3c240\") " pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-r95sw"
Oct 30 21:02:43.783709 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:02:43.783657    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/230542f2-9ac3-4abe-83af-8f63a2c3c240-credential-socket\") pod \"maas-default-gateway-openshift-default-769df7846c-r95sw\" (UID: \"230542f2-9ac3-4abe-83af-8f63a2c3c240\") " pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-r95sw"
Oct 30 21:02:43.783918 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:02:43.783710    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/230542f2-9ac3-4abe-83af-8f63a2c3c240-istio-podinfo\") pod \"maas-default-gateway-openshift-default-769df7846c-r95sw\" (UID: \"230542f2-9ac3-4abe-83af-8f63a2c3c240\") " pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-r95sw"
Oct 30 21:02:43.783918 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:02:43.783726    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/230542f2-9ac3-4abe-83af-8f63a2c3c240-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-769df7846c-r95sw\" (UID: \"230542f2-9ac3-4abe-83af-8f63a2c3c240\") " pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-r95sw"
Oct 30 21:02:43.783918 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:02:43.783771    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tst9n\" (UniqueName: \"kubernetes.io/projected/230542f2-9ac3-4abe-83af-8f63a2c3c240-kube-api-access-tst9n\") pod \"maas-default-gateway-openshift-default-769df7846c-r95sw\" (UID: \"230542f2-9ac3-4abe-83af-8f63a2c3c240\") " pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-r95sw"
Oct 30 21:02:43.784499 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:02:43.784472    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/230542f2-9ac3-4abe-83af-8f63a2c3c240-workload-certs\") pod \"maas-default-gateway-openshift-default-769df7846c-r95sw\" (UID: \"230542f2-9ac3-4abe-83af-8f63a2c3c240\") " pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-r95sw"
Oct 30 21:02:43.784594 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:02:43.784515    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/230542f2-9ac3-4abe-83af-8f63a2c3c240-workload-socket\") pod \"maas-default-gateway-openshift-default-769df7846c-r95sw\" (UID: \"230542f2-9ac3-4abe-83af-8f63a2c3c240\") " pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-r95sw"
Oct 30 21:02:43.784594 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:02:43.784573    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/230542f2-9ac3-4abe-83af-8f63a2c3c240-credential-socket\") pod \"maas-default-gateway-openshift-default-769df7846c-r95sw\" (UID: \"230542f2-9ac3-4abe-83af-8f63a2c3c240\") " pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-r95sw"
Oct 30 21:02:43.785302 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:02:43.784799    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/230542f2-9ac3-4abe-83af-8f63a2c3c240-istio-data\") pod \"maas-default-gateway-openshift-default-769df7846c-r95sw\" (UID: \"230542f2-9ac3-4abe-83af-8f63a2c3c240\") " pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-r95sw"
Oct 30 21:02:43.785441 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:02:43.785390    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/230542f2-9ac3-4abe-83af-8f63a2c3c240-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-769df7846c-r95sw\" (UID: \"230542f2-9ac3-4abe-83af-8f63a2c3c240\") " pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-r95sw"
Oct 30 21:02:43.786682 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:02:43.786660    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/230542f2-9ac3-4abe-83af-8f63a2c3c240-istio-envoy\") pod \"maas-default-gateway-openshift-default-769df7846c-r95sw\" (UID: \"230542f2-9ac3-4abe-83af-8f63a2c3c240\") " pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-r95sw"
Oct 30 21:02:43.787544 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:02:43.787518    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/230542f2-9ac3-4abe-83af-8f63a2c3c240-istio-podinfo\") pod \"maas-default-gateway-openshift-default-769df7846c-r95sw\" (UID: \"230542f2-9ac3-4abe-83af-8f63a2c3c240\") " pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-r95sw"
Oct 30 21:02:43.861123 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:02:43.844800    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/230542f2-9ac3-4abe-83af-8f63a2c3c240-istio-token\") pod \"maas-default-gateway-openshift-default-769df7846c-r95sw\" (UID: \"230542f2-9ac3-4abe-83af-8f63a2c3c240\") " pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-r95sw"
Oct 30 21:02:43.861123 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:02:43.852816    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tst9n\" (UniqueName: \"kubernetes.io/projected/230542f2-9ac3-4abe-83af-8f63a2c3c240-kube-api-access-tst9n\") pod \"maas-default-gateway-openshift-default-769df7846c-r95sw\" (UID: \"230542f2-9ac3-4abe-83af-8f63a2c3c240\") " pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-r95sw"
Oct 30 21:02:43.888622 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:02:43.888580    6004 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-r95sw"
Oct 30 21:02:44.297410 ip-10-0-138-85 kubenswrapper[6004]: E1030 21:02:44.297375    6004 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-zz4wr" containerName="extractor"
Oct 30 21:02:44.368564 ip-10-0-138-85 kubenswrapper[6004]: W1030 21:02:44.368526    6004 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod230542f2_9ac3_4abe_83af_8f63a2c3c240.slice/crio-8804f87efee45c051ef310c9f9f8f7a7db904b4d4d5bf498a6eded8068f62413 WatchSource:0}: Error finding container 8804f87efee45c051ef310c9f9f8f7a7db904b4d4d5bf498a6eded8068f62413: Status 404 returned error can't find the container with id 8804f87efee45c051ef310c9f9f8f7a7db904b4d4d5bf498a6eded8068f62413
Oct 30 21:02:44.369823 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:02:44.369734    6004 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-769df7846c-r95sw"]
Oct 30 21:02:44.371792 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:02:44.371756    6004 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 21:02:44.371895 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:02:44.371841    6004 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 21:02:44.371895 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:02:44.371876    6004 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 21:02:45.117547 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:02:45.116700    6004 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-r95sw" event={"ID":"230542f2-9ac3-4abe-83af-8f63a2c3c240","Type":"ContainerStarted","Data":"6869693d566b0b1bef8b7e86fd8681b794cf464dcb83852a4f715215705b15ff"}
Oct 30 21:02:45.117547 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:02:45.116765    6004 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-r95sw" event={"ID":"230542f2-9ac3-4abe-83af-8f63a2c3c240","Type":"ContainerStarted","Data":"8804f87efee45c051ef310c9f9f8f7a7db904b4d4d5bf498a6eded8068f62413"}
Oct 30 21:02:45.348236 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:02:45.348182    6004 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-r95sw" podStartSLOduration=2.3481674310000002 podStartE2EDuration="2.348167431s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:02:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:02:45.297568869 +0000 UTC m=+1471.217354988" watchObservedRunningTime="2026-10-30 21:02:45.348167431 +0000 UTC m=+1471.267953551"
Oct 30 21:02:45.889461 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:02:45.889414    6004 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-r95sw"
Oct 30 21:02:45.891039 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:02:45.891007    6004 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-769df7846c-r95sw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.91:15021/healthz/ready\": dial tcp 10.132.0.91:15021: connect: connection refused" start-of-body=
Oct 30 21:02:45.891209 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:02:45.891077    6004 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-r95sw" podUID="230542f2-9ac3-4abe-83af-8f63a2c3c240" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.91:15021/healthz/ready\": dial tcp 10.132.0.91:15021: connect: connection refused"
Oct 30 21:02:46.889345 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:02:46.889305    6004 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-769df7846c-r95sw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.91:15021/healthz/ready\": dial tcp 10.132.0.91:15021: connect: connection refused" start-of-body=
Oct 30 21:02:46.889817 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:02:46.889356    6004 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-r95sw" podUID="230542f2-9ac3-4abe-83af-8f63a2c3c240" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.91:15021/healthz/ready\": dial tcp 10.132.0.91:15021: connect: connection refused"
Oct 30 21:02:47.889258 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:02:47.889202    6004 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-769df7846c-r95sw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.91:15021/healthz/ready\": dial tcp 10.132.0.91:15021: connect: connection refused" start-of-body=
Oct 30 21:02:47.889468 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:02:47.889281    6004 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-r95sw" podUID="230542f2-9ac3-4abe-83af-8f63a2c3c240" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.91:15021/healthz/ready\": dial tcp 10.132.0.91:15021: connect: connection refused"
Oct 30 21:02:48.889373 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:02:48.889332    6004 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-769df7846c-r95sw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.91:15021/healthz/ready\": dial tcp 10.132.0.91:15021: connect: connection refused" start-of-body=
Oct 30 21:02:48.889545 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:02:48.889387    6004 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-r95sw" podUID="230542f2-9ac3-4abe-83af-8f63a2c3c240" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.91:15021/healthz/ready\": dial tcp 10.132.0.91:15021: connect: connection refused"
Oct 30 21:02:49.894073 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:02:49.889021    6004 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-769df7846c-r95sw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.91:15021/healthz/ready\": dial tcp 10.132.0.91:15021: connect: connection refused" start-of-body=
Oct 30 21:02:49.894073 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:02:49.889113    6004 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-r95sw" podUID="230542f2-9ac3-4abe-83af-8f63a2c3c240" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.91:15021/healthz/ready\": dial tcp 10.132.0.91:15021: connect: connection refused"
Oct 30 21:02:50.889888 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:02:50.889850    6004 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-769df7846c-r95sw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.91:15021/healthz/ready\": dial tcp 10.132.0.91:15021: connect: connection refused" start-of-body=
Oct 30 21:02:50.890839 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:02:50.889917    6004 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-r95sw" podUID="230542f2-9ac3-4abe-83af-8f63a2c3c240" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.91:15021/healthz/ready\": dial tcp 10.132.0.91:15021: connect: connection refused"
Oct 30 21:02:51.200419 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:02:51.200378    6004 generic.go:356] "Generic (PLEG): container finished" podID="4348ddc3-36e1-4f59-be98-2bac043474e7" containerID="2e029cd1131d5688c60c8a07380ecaacf791187d4dbc2e9334a1a92c930b6654" exitCode=0
Oct 30 21:02:51.200922 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:02:51.200457    6004 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-83851760-openshift-default-5d466c5bd5-jj89h" event={"ID":"4348ddc3-36e1-4f59-be98-2bac043474e7","Type":"ContainerDied","Data":"2e029cd1131d5688c60c8a07380ecaacf791187d4dbc2e9334a1a92c930b6654"}
Oct 30 21:02:51.201037 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:02:51.201018    6004 scope.go:122] "RemoveContainer" containerID="2e029cd1131d5688c60c8a07380ecaacf791187d4dbc2e9334a1a92c930b6654"
Oct 30 21:02:51.202959 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:02:51.202931    6004 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 21:02:51.203082 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:02:51.202999    6004 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 21:02:51.203082 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:02:51.203033    6004 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 21:02:51.889346 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:02:51.889302    6004 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-769df7846c-r95sw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.91:15021/healthz/ready\": dial tcp 10.132.0.91:15021: connect: connection refused" start-of-body=
Oct 30 21:02:51.889544 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:02:51.889367    6004 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-r95sw" podUID="230542f2-9ac3-4abe-83af-8f63a2c3c240" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.91:15021/healthz/ready\": dial tcp 10.132.0.91:15021: connect: connection refused"
Oct 30 21:02:52.209649 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:02:52.209609    6004 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-83851760-openshift-default-5d466c5bd5-jj89h" event={"ID":"4348ddc3-36e1-4f59-be98-2bac043474e7","Type":"ContainerStarted","Data":"9ee43108bbc16df673b9a7de1ede4f66eac256540c1d57f8e5edf6dd21a91d29"}
Oct 30 21:02:52.889276 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:02:52.889240    6004 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-769df7846c-r95sw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.91:15021/healthz/ready\": dial tcp 10.132.0.91:15021: connect: connection refused" start-of-body=
Oct 30 21:02:52.889466 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:02:52.889300    6004 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-r95sw" podUID="230542f2-9ac3-4abe-83af-8f63a2c3c240" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.91:15021/healthz/ready\": dial tcp 10.132.0.91:15021: connect: connection refused"
Oct 30 21:02:52.938427 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:02:52.938391    6004 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-83851760-openshift-default-5d466c5bd5-jj89h"
Oct 30 21:02:52.938792 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:02:52.938699    6004 patch_prober.go:29] interesting pod/e2e-ait-83851760-openshift-default-5d466c5bd5-jj89h container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.85:15021/healthz/ready\": dial tcp 10.132.0.85:15021: connect: connection refused" start-of-body=
Oct 30 21:02:52.938961 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:02:52.938937    6004 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-83851760-openshift-default-5d466c5bd5-jj89h" podUID="4348ddc3-36e1-4f59-be98-2bac043474e7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.85:15021/healthz/ready\": dial tcp 10.132.0.85:15021: connect: connection refused"
Oct 30 21:02:53.938912 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:02:53.938448    6004 patch_prober.go:29] interesting pod/e2e-ait-83851760-openshift-default-5d466c5bd5-jj89h container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.85:15021/healthz/ready\": dial tcp 10.132.0.85:15021: connect: connection refused" start-of-body=
Oct 30 21:02:53.938912 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:02:53.938514    6004 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-83851760-openshift-default-5d466c5bd5-jj89h" podUID="4348ddc3-36e1-4f59-be98-2bac043474e7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.85:15021/healthz/ready\": dial tcp 10.132.0.85:15021: connect: connection refused"
Oct 30 21:02:54.165075 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:02:54.164336    6004 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-r95sw"
Oct 30 21:02:54.169071 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:02:54.165893    6004 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-r95sw"
Oct 30 21:02:54.173138 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:02:54.170625    6004 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-r95sw"
Oct 30 21:02:54.949079 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:02:54.947430    6004 patch_prober.go:29] interesting pod/e2e-ait-83851760-openshift-default-5d466c5bd5-jj89h container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.85:15021/healthz/ready\": dial tcp 10.132.0.85:15021: connect: connection refused" start-of-body=
Oct 30 21:02:54.949079 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:02:54.947492    6004 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-83851760-openshift-default-5d466c5bd5-jj89h" podUID="4348ddc3-36e1-4f59-be98-2bac043474e7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.85:15021/healthz/ready\": dial tcp 10.132.0.85:15021: connect: connection refused"
Oct 30 21:02:55.937460 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:02:55.937423    6004 patch_prober.go:29] interesting pod/e2e-ait-83851760-openshift-default-5d466c5bd5-jj89h container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.85:15021/healthz/ready\": dial tcp 10.132.0.85:15021: connect: connection refused" start-of-body=
Oct 30 21:02:55.937751 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:02:55.937723    6004 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-83851760-openshift-default-5d466c5bd5-jj89h" podUID="4348ddc3-36e1-4f59-be98-2bac043474e7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.85:15021/healthz/ready\": dial tcp 10.132.0.85:15021: connect: connection refused"
Oct 30 21:02:56.946075 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:02:56.938390    6004 patch_prober.go:29] interesting pod/e2e-ait-83851760-openshift-default-5d466c5bd5-jj89h container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.85:15021/healthz/ready\": dial tcp 10.132.0.85:15021: connect: connection refused" start-of-body=
Oct 30 21:02:56.946075 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:02:56.938457    6004 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-83851760-openshift-default-5d466c5bd5-jj89h" podUID="4348ddc3-36e1-4f59-be98-2bac043474e7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.85:15021/healthz/ready\": dial tcp 10.132.0.85:15021: connect: connection refused"
Oct 30 21:02:57.941570 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:02:57.941539    6004 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-83851760-openshift-default-5d466c5bd5-jj89h"
Oct 30 21:02:57.942011 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:02:57.941992    6004 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-83851760-openshift-default-5d466c5bd5-jj89h"
Oct 30 21:02:57.942709 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:02:57.942689    6004 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-83851760-openshift-default-5d466c5bd5-jj89h"
Oct 30 21:03:14.286524 ip-10-0-138-85 kubenswrapper[6004]: E1030 21:03:14.286486    6004 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-zz4wr" containerName="extractor"
Oct 30 21:03:14.464493 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:03:14.464462    6004 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-sb7ds_90cd3de0-c573-41c2-bf3e-cf0e46a41d50/console-operator/2.log"
Oct 30 21:03:14.468611 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:03:14.468578    6004 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-sb7ds_90cd3de0-c573-41c2-bf3e-cf0e46a41d50/console-operator/2.log"
Oct 30 21:03:39.528467 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:03:39.519919    6004 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-83851760-openshift-default-5d466c5bd5-jj89h"]
Oct 30 21:03:39.569118 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:03:39.557341    6004 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-83851760-openshift-default-5d466c5bd5-jj89h" podUID="4348ddc3-36e1-4f59-be98-2bac043474e7" containerName="istio-proxy" containerID="cri-o://9ee43108bbc16df673b9a7de1ede4f66eac256540c1d57f8e5edf6dd21a91d29" gracePeriod=30
Oct 30 21:03:42.944645 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:03:42.944601    6004 patch_prober.go:29] interesting pod/e2e-ait-83851760-openshift-default-5d466c5bd5-jj89h container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=upstream connect error or disconnect/reset before headers. reset reason: remote connection failure, transport failure reason: delayed connect error: Connection refused
Oct 30 21:03:42.945152 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:03:42.944669    6004 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ait-83851760-openshift-default-5d466c5bd5-jj89h" podUID="4348ddc3-36e1-4f59-be98-2bac043474e7" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 30 21:03:44.292900 ip-10-0-138-85 kubenswrapper[6004]: E1030 21:03:44.292861    6004 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-zz4wr" containerName="extractor"
Oct 30 21:03:44.826707 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:03:44.826658    6004 generic.go:356] "Generic (PLEG): container finished" podID="4348ddc3-36e1-4f59-be98-2bac043474e7" containerID="9ee43108bbc16df673b9a7de1ede4f66eac256540c1d57f8e5edf6dd21a91d29" exitCode=0
Oct 30 21:03:44.826896 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:03:44.826735    6004 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-83851760-openshift-default-5d466c5bd5-jj89h" event={"ID":"4348ddc3-36e1-4f59-be98-2bac043474e7","Type":"ContainerDied","Data":"9ee43108bbc16df673b9a7de1ede4f66eac256540c1d57f8e5edf6dd21a91d29"}
Oct 30 21:03:44.826896 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:03:44.826824    6004 scope.go:122] "RemoveContainer" containerID="2e029cd1131d5688c60c8a07380ecaacf791187d4dbc2e9334a1a92c930b6654"
Oct 30 21:03:44.900938 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:03:44.900914    6004 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-83851760-openshift-default-5d466c5bd5-jj89h"
Oct 30 21:03:45.033920 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:03:45.033826    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/4348ddc3-36e1-4f59-be98-2bac043474e7-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4348ddc3-36e1-4f59-be98-2bac043474e7-workload-socket\") pod \"4348ddc3-36e1-4f59-be98-2bac043474e7\" (UID: \"4348ddc3-36e1-4f59-be98-2bac043474e7\") "
Oct 30 21:03:45.033920 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:03:45.033892    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/4348ddc3-36e1-4f59-be98-2bac043474e7-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4348ddc3-36e1-4f59-be98-2bac043474e7-istio-envoy\") pod \"4348ddc3-36e1-4f59-be98-2bac043474e7\" (UID: \"4348ddc3-36e1-4f59-be98-2bac043474e7\") "
Oct 30 21:03:45.034237 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:03:45.033922    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/4348ddc3-36e1-4f59-be98-2bac043474e7-istio-token\" (UniqueName: \"kubernetes.io/projected/4348ddc3-36e1-4f59-be98-2bac043474e7-istio-token\") pod \"4348ddc3-36e1-4f59-be98-2bac043474e7\" (UID: \"4348ddc3-36e1-4f59-be98-2bac043474e7\") "
Oct 30 21:03:45.034237 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:03:45.034028    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/4348ddc3-36e1-4f59-be98-2bac043474e7-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4348ddc3-36e1-4f59-be98-2bac043474e7-credential-socket\") pod \"4348ddc3-36e1-4f59-be98-2bac043474e7\" (UID: \"4348ddc3-36e1-4f59-be98-2bac043474e7\") "
Oct 30 21:03:45.034237 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:03:45.034101    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/4348ddc3-36e1-4f59-be98-2bac043474e7-kube-api-access-d2zvw\" (UniqueName: \"kubernetes.io/projected/4348ddc3-36e1-4f59-be98-2bac043474e7-kube-api-access-d2zvw\") pod \"4348ddc3-36e1-4f59-be98-2bac043474e7\" (UID: \"4348ddc3-36e1-4f59-be98-2bac043474e7\") "
Oct 30 21:03:45.034237 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:03:45.034125    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4348ddc3-36e1-4f59-be98-2bac043474e7-workload-socket" pod "4348ddc3-36e1-4f59-be98-2bac043474e7" (UID: "4348ddc3-36e1-4f59-be98-2bac043474e7"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:03:45.034237 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:03:45.034211    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/4348ddc3-36e1-4f59-be98-2bac043474e7-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4348ddc3-36e1-4f59-be98-2bac043474e7-istiod-ca-cert\") pod \"4348ddc3-36e1-4f59-be98-2bac043474e7\" (UID: \"4348ddc3-36e1-4f59-be98-2bac043474e7\") "
Oct 30 21:03:45.034502 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:03:45.034285    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/4348ddc3-36e1-4f59-be98-2bac043474e7-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4348ddc3-36e1-4f59-be98-2bac043474e7-istio-data\") pod \"4348ddc3-36e1-4f59-be98-2bac043474e7\" (UID: \"4348ddc3-36e1-4f59-be98-2bac043474e7\") "
Oct 30 21:03:45.034502 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:03:45.034337    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/4348ddc3-36e1-4f59-be98-2bac043474e7-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4348ddc3-36e1-4f59-be98-2bac043474e7-istio-podinfo\") pod \"4348ddc3-36e1-4f59-be98-2bac043474e7\" (UID: \"4348ddc3-36e1-4f59-be98-2bac043474e7\") "
Oct 30 21:03:45.034502 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:03:45.034448    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/4348ddc3-36e1-4f59-be98-2bac043474e7-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4348ddc3-36e1-4f59-be98-2bac043474e7-workload-certs\") pod \"4348ddc3-36e1-4f59-be98-2bac043474e7\" (UID: \"4348ddc3-36e1-4f59-be98-2bac043474e7\") "
Oct 30 21:03:45.034661 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:03:45.034576    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4348ddc3-36e1-4f59-be98-2bac043474e7-credential-socket" pod "4348ddc3-36e1-4f59-be98-2bac043474e7" (UID: "4348ddc3-36e1-4f59-be98-2bac043474e7"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:03:45.034748 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:03:45.034666    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4348ddc3-36e1-4f59-be98-2bac043474e7-istio-data" pod "4348ddc3-36e1-4f59-be98-2bac043474e7" (UID: "4348ddc3-36e1-4f59-be98-2bac043474e7"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:03:45.034801 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:03:45.034766    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4348ddc3-36e1-4f59-be98-2bac043474e7-istiod-ca-cert" pod "4348ddc3-36e1-4f59-be98-2bac043474e7" (UID: "4348ddc3-36e1-4f59-be98-2bac043474e7"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:03:45.034910 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:03:45.034888    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4348ddc3-36e1-4f59-be98-2bac043474e7-workload-certs" pod "4348ddc3-36e1-4f59-be98-2bac043474e7" (UID: "4348ddc3-36e1-4f59-be98-2bac043474e7"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:03:45.035322 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:03:45.035291    6004 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4348ddc3-36e1-4f59-be98-2bac043474e7-workload-socket\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:03:45.035432 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:03:45.035326    6004 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4348ddc3-36e1-4f59-be98-2bac043474e7-credential-socket\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:03:45.035432 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:03:45.035340    6004 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4348ddc3-36e1-4f59-be98-2bac043474e7-istiod-ca-cert\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:03:45.035432 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:03:45.035356    6004 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4348ddc3-36e1-4f59-be98-2bac043474e7-istio-data\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:03:45.035432 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:03:45.035369    6004 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4348ddc3-36e1-4f59-be98-2bac043474e7-workload-certs\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:03:45.037150 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:03:45.037121    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4348ddc3-36e1-4f59-be98-2bac043474e7-istio-token" pod "4348ddc3-36e1-4f59-be98-2bac043474e7" (UID: "4348ddc3-36e1-4f59-be98-2bac043474e7"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:03:45.037338 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:03:45.037318    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/4348ddc3-36e1-4f59-be98-2bac043474e7-istio-podinfo" pod "4348ddc3-36e1-4f59-be98-2bac043474e7" (UID: "4348ddc3-36e1-4f59-be98-2bac043474e7"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 21:03:45.037507 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:03:45.037484    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4348ddc3-36e1-4f59-be98-2bac043474e7-kube-api-access-d2zvw" pod "4348ddc3-36e1-4f59-be98-2bac043474e7" (UID: "4348ddc3-36e1-4f59-be98-2bac043474e7"). InnerVolumeSpecName "kube-api-access-d2zvw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:03:45.037575 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:03:45.037493    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4348ddc3-36e1-4f59-be98-2bac043474e7-istio-envoy" pod "4348ddc3-36e1-4f59-be98-2bac043474e7" (UID: "4348ddc3-36e1-4f59-be98-2bac043474e7"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:03:45.136751 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:03:45.136711    6004 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4348ddc3-36e1-4f59-be98-2bac043474e7-istio-podinfo\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:03:45.136751 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:03:45.136750    6004 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4348ddc3-36e1-4f59-be98-2bac043474e7-istio-envoy\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:03:45.137006 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:03:45.136763    6004 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4348ddc3-36e1-4f59-be98-2bac043474e7-istio-token\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:03:45.137006 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:03:45.136779    6004 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d2zvw\" (UniqueName: \"kubernetes.io/projected/4348ddc3-36e1-4f59-be98-2bac043474e7-kube-api-access-d2zvw\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:03:45.835881 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:03:45.835852    6004 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-83851760-openshift-default-5d466c5bd5-jj89h"
Oct 30 21:03:45.836516 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:03:45.835889    6004 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-83851760-openshift-default-5d466c5bd5-jj89h" event={"ID":"4348ddc3-36e1-4f59-be98-2bac043474e7","Type":"ContainerDied","Data":"bcecf1398ef896dd00282d196a98b16cffe67b1314516a705c24f7560065ef4a"}
Oct 30 21:03:45.836516 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:03:45.835955    6004 scope.go:122] "RemoveContainer" containerID="9ee43108bbc16df673b9a7de1ede4f66eac256540c1d57f8e5edf6dd21a91d29"
Oct 30 21:03:46.066715 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:03:46.066674    6004 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-83851760-openshift-default-5d466c5bd5-jj89h"]
Oct 30 21:03:46.117026 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:03:46.116950    6004 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-83851760-openshift-default-5d466c5bd5-jj89h"]
Oct 30 21:03:46.233737 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:03:46.233701    6004 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="4348ddc3-36e1-4f59-be98-2bac043474e7" path="/var/lib/kubelet/pods/4348ddc3-36e1-4f59-be98-2bac043474e7/volumes"
Oct 30 21:04:14.287449 ip-10-0-138-85 kubenswrapper[6004]: E1030 21:04:14.287385    6004 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-zz4wr" containerName="extractor"
Oct 30 21:04:18.526574 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:04:18.526537    6004 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w6-8fa2a7-openshift-default-69876bd499-pmvdv"]
Oct 30 21:04:18.527096 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:04:18.526764    6004 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w6-8fa2a7-openshift-default-69876bd499-pmvdv" podUID="525254d6-96ad-4f59-becb-684cbf65e012" containerName="istio-proxy" containerID="cri-o://eb824dbc51bfc651d7765f07b571c77b0cbe79bfe90bc32f1c9b94a9ffaf28e0" gracePeriod=30
Oct 30 21:04:23.815346 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:04:23.815317    6004 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w6-8fa2a7-openshift-default-69876bd499-pmvdv"
Oct 30 21:04:23.912893 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:04:23.912843    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/525254d6-96ad-4f59-becb-684cbf65e012-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/525254d6-96ad-4f59-becb-684cbf65e012-istio-envoy\") pod \"525254d6-96ad-4f59-becb-684cbf65e012\" (UID: \"525254d6-96ad-4f59-becb-684cbf65e012\") "
Oct 30 21:04:23.913114 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:04:23.912917    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/525254d6-96ad-4f59-becb-684cbf65e012-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/525254d6-96ad-4f59-becb-684cbf65e012-credential-socket\") pod \"525254d6-96ad-4f59-becb-684cbf65e012\" (UID: \"525254d6-96ad-4f59-becb-684cbf65e012\") "
Oct 30 21:04:23.913114 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:04:23.912972    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/525254d6-96ad-4f59-becb-684cbf65e012-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/525254d6-96ad-4f59-becb-684cbf65e012-istio-data\") pod \"525254d6-96ad-4f59-becb-684cbf65e012\" (UID: \"525254d6-96ad-4f59-becb-684cbf65e012\") "
Oct 30 21:04:23.913114 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:04:23.913018    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/525254d6-96ad-4f59-becb-684cbf65e012-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/525254d6-96ad-4f59-becb-684cbf65e012-istiod-ca-cert\") pod \"525254d6-96ad-4f59-becb-684cbf65e012\" (UID: \"525254d6-96ad-4f59-becb-684cbf65e012\") "
Oct 30 21:04:23.913294 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:04:23.913122    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/525254d6-96ad-4f59-becb-684cbf65e012-kube-api-access-sl5x5\" (UniqueName: \"kubernetes.io/projected/525254d6-96ad-4f59-becb-684cbf65e012-kube-api-access-sl5x5\") pod \"525254d6-96ad-4f59-becb-684cbf65e012\" (UID: \"525254d6-96ad-4f59-becb-684cbf65e012\") "
Oct 30 21:04:23.913294 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:04:23.913209    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/525254d6-96ad-4f59-becb-684cbf65e012-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/525254d6-96ad-4f59-becb-684cbf65e012-istio-podinfo\") pod \"525254d6-96ad-4f59-becb-684cbf65e012\" (UID: \"525254d6-96ad-4f59-becb-684cbf65e012\") "
Oct 30 21:04:23.913399 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:04:23.913295    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/525254d6-96ad-4f59-becb-684cbf65e012-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/525254d6-96ad-4f59-becb-684cbf65e012-workload-certs\") pod \"525254d6-96ad-4f59-becb-684cbf65e012\" (UID: \"525254d6-96ad-4f59-becb-684cbf65e012\") "
Oct 30 21:04:23.913399 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:04:23.913278    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/525254d6-96ad-4f59-becb-684cbf65e012-credential-socket" pod "525254d6-96ad-4f59-becb-684cbf65e012" (UID: "525254d6-96ad-4f59-becb-684cbf65e012"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:04:23.913399 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:04:23.913287    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/525254d6-96ad-4f59-becb-684cbf65e012-istio-data" pod "525254d6-96ad-4f59-becb-684cbf65e012" (UID: "525254d6-96ad-4f59-becb-684cbf65e012"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:04:23.913553 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:04:23.913415    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/525254d6-96ad-4f59-becb-684cbf65e012-istio-token\" (UniqueName: \"kubernetes.io/projected/525254d6-96ad-4f59-becb-684cbf65e012-istio-token\") pod \"525254d6-96ad-4f59-becb-684cbf65e012\" (UID: \"525254d6-96ad-4f59-becb-684cbf65e012\") "
Oct 30 21:04:23.913553 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:04:23.913468    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/525254d6-96ad-4f59-becb-684cbf65e012-istiod-ca-cert" pod "525254d6-96ad-4f59-becb-684cbf65e012" (UID: "525254d6-96ad-4f59-becb-684cbf65e012"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:04:23.913648 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:04:23.913563    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/525254d6-96ad-4f59-becb-684cbf65e012-workload-certs" pod "525254d6-96ad-4f59-becb-684cbf65e012" (UID: "525254d6-96ad-4f59-becb-684cbf65e012"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:04:23.913648 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:04:23.913618    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/525254d6-96ad-4f59-becb-684cbf65e012-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/525254d6-96ad-4f59-becb-684cbf65e012-workload-socket\") pod \"525254d6-96ad-4f59-becb-684cbf65e012\" (UID: \"525254d6-96ad-4f59-becb-684cbf65e012\") "
Oct 30 21:04:23.913975 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:04:23.913945    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/525254d6-96ad-4f59-becb-684cbf65e012-workload-socket" pod "525254d6-96ad-4f59-becb-684cbf65e012" (UID: "525254d6-96ad-4f59-becb-684cbf65e012"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:04:23.914355 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:04:23.914331    6004 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/525254d6-96ad-4f59-becb-684cbf65e012-workload-socket\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:04:23.914450 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:04:23.914361    6004 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/525254d6-96ad-4f59-becb-684cbf65e012-credential-socket\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:04:23.914450 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:04:23.914375    6004 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/525254d6-96ad-4f59-becb-684cbf65e012-istio-data\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:04:23.914450 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:04:23.914389    6004 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/525254d6-96ad-4f59-becb-684cbf65e012-istiod-ca-cert\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:04:23.914450 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:04:23.914402    6004 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/525254d6-96ad-4f59-becb-684cbf65e012-workload-certs\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:04:23.915446 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:04:23.915424    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/525254d6-96ad-4f59-becb-684cbf65e012-kube-api-access-sl5x5" pod "525254d6-96ad-4f59-becb-684cbf65e012" (UID: "525254d6-96ad-4f59-becb-684cbf65e012"). InnerVolumeSpecName "kube-api-access-sl5x5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:04:23.915806 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:04:23.915780    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/525254d6-96ad-4f59-becb-684cbf65e012-istio-envoy" pod "525254d6-96ad-4f59-becb-684cbf65e012" (UID: "525254d6-96ad-4f59-becb-684cbf65e012"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:04:23.915908 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:04:23.915883    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/525254d6-96ad-4f59-becb-684cbf65e012-istio-podinfo" pod "525254d6-96ad-4f59-becb-684cbf65e012" (UID: "525254d6-96ad-4f59-becb-684cbf65e012"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 21:04:23.915975 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:04:23.915951    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/525254d6-96ad-4f59-becb-684cbf65e012-istio-token" pod "525254d6-96ad-4f59-becb-684cbf65e012" (UID: "525254d6-96ad-4f59-becb-684cbf65e012"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:04:24.015965 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:04:24.015854    6004 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/525254d6-96ad-4f59-becb-684cbf65e012-istio-token\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:04:24.015965 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:04:24.015895    6004 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/525254d6-96ad-4f59-becb-684cbf65e012-istio-envoy\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:04:24.015965 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:04:24.015913    6004 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sl5x5\" (UniqueName: \"kubernetes.io/projected/525254d6-96ad-4f59-becb-684cbf65e012-kube-api-access-sl5x5\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:04:24.015965 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:04:24.015929    6004 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/525254d6-96ad-4f59-becb-684cbf65e012-istio-podinfo\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:04:24.232175 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:04:24.232137    6004 generic.go:356] "Generic (PLEG): container finished" podID="525254d6-96ad-4f59-becb-684cbf65e012" containerID="eb824dbc51bfc651d7765f07b571c77b0cbe79bfe90bc32f1c9b94a9ffaf28e0" exitCode=0
Oct 30 21:04:24.235401 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:04:24.235380    6004 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w6-8fa2a7-openshift-default-69876bd499-pmvdv"
Oct 30 21:04:24.239716 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:04:24.239687    6004 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-8fa2a7-openshift-default-69876bd499-pmvdv" event={"ID":"525254d6-96ad-4f59-becb-684cbf65e012","Type":"ContainerDied","Data":"eb824dbc51bfc651d7765f07b571c77b0cbe79bfe90bc32f1c9b94a9ffaf28e0"}
Oct 30 21:04:24.239827 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:04:24.239735    6004 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-8fa2a7-openshift-default-69876bd499-pmvdv" event={"ID":"525254d6-96ad-4f59-becb-684cbf65e012","Type":"ContainerDied","Data":"3a6b0cfc709704914c9ff36b0662f31db955ccc7668a87b2cdb29960c055a255"}
Oct 30 21:04:24.239827 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:04:24.239767    6004 scope.go:122] "RemoveContainer" containerID="eb824dbc51bfc651d7765f07b571c77b0cbe79bfe90bc32f1c9b94a9ffaf28e0"
Oct 30 21:04:24.251210 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:04:24.251192    6004 scope.go:122] "RemoveContainer" containerID="eb824dbc51bfc651d7765f07b571c77b0cbe79bfe90bc32f1c9b94a9ffaf28e0"
Oct 30 21:04:24.251499 ip-10-0-138-85 kubenswrapper[6004]: E1030 21:04:24.251477    6004 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"eb824dbc51bfc651d7765f07b571c77b0cbe79bfe90bc32f1c9b94a9ffaf28e0\": container with ID starting with eb824dbc51bfc651d7765f07b571c77b0cbe79bfe90bc32f1c9b94a9ffaf28e0 not found: ID does not exist" containerID="eb824dbc51bfc651d7765f07b571c77b0cbe79bfe90bc32f1c9b94a9ffaf28e0"
Oct 30 21:04:24.251567 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:04:24.251507    6004 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eb824dbc51bfc651d7765f07b571c77b0cbe79bfe90bc32f1c9b94a9ffaf28e0"} err="failed to get container status \"eb824dbc51bfc651d7765f07b571c77b0cbe79bfe90bc32f1c9b94a9ffaf28e0\": rpc error: code = NotFound desc = could not find container \"eb824dbc51bfc651d7765f07b571c77b0cbe79bfe90bc32f1c9b94a9ffaf28e0\": container with ID starting with eb824dbc51bfc651d7765f07b571c77b0cbe79bfe90bc32f1c9b94a9ffaf28e0 not found: ID does not exist"
Oct 30 21:04:24.404519 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:04:24.404485    6004 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w6-8fa2a7-openshift-default-69876bd499-pmvdv"]
Oct 30 21:04:24.407906 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:04:24.407876    6004 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w6-8fa2a7-openshift-default-69876bd499-pmvdv"]
Oct 30 21:04:26.232920 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:04:26.232882    6004 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="525254d6-96ad-4f59-becb-684cbf65e012" path="/var/lib/kubelet/pods/525254d6-96ad-4f59-becb-684cbf65e012/volumes"
Oct 30 21:04:31.929918 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:04:31.929877    6004 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-bf9c0727-5ff4c44c4b-vvckc"]
Oct 30 21:04:31.930717 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:04:31.930694    6004 cpu_manager.go:414] "containerMap: removing container" podUID="525254d6-96ad-4f59-becb-684cbf65e012" containerName="istio-proxy"
Oct 30 21:04:31.930824 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:04:31.930719    6004 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="525254d6-96ad-4f59-becb-684cbf65e012" containerName="istio-proxy"
Oct 30 21:04:31.930824 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:04:31.930761    6004 cpu_manager.go:414] "containerMap: removing container" podUID="4348ddc3-36e1-4f59-be98-2bac043474e7" containerName="istio-proxy"
Oct 30 21:04:31.930824 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:04:31.930770    6004 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="4348ddc3-36e1-4f59-be98-2bac043474e7" containerName="istio-proxy"
Oct 30 21:04:31.930824 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:04:31.930809    6004 cpu_manager.go:414] "containerMap: removing container" podUID="4348ddc3-36e1-4f59-be98-2bac043474e7" containerName="istio-proxy"
Oct 30 21:04:31.930824 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:04:31.930817    6004 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="4348ddc3-36e1-4f59-be98-2bac043474e7" containerName="istio-proxy"
Oct 30 21:04:31.931081 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:04:31.930969    6004 memory_manager.go:365] "RemoveStaleState removing state" podUID="4348ddc3-36e1-4f59-be98-2bac043474e7" containerName="istio-proxy"
Oct 30 21:04:31.931081 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:04:31.930988    6004 memory_manager.go:365] "RemoveStaleState removing state" podUID="4348ddc3-36e1-4f59-be98-2bac043474e7" containerName="istio-proxy"
Oct 30 21:04:31.931081 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:04:31.930998    6004 memory_manager.go:365] "RemoveStaleState removing state" podUID="525254d6-96ad-4f59-becb-684cbf65e012" containerName="istio-proxy"
Oct 30 21:04:31.935920 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:04:31.935899    6004 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-bf9c0727-5ff4c44c4b-vvckc"
Oct 30 21:04:31.990802 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:04:31.990766    6004 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-bf9c0727-5ff4c44c4b-vvckc"]
Oct 30 21:04:32.036787 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:04:32.036754    6004 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-derive-bf9c0727-serving-cert\""
Oct 30 21:04:32.049026 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:04:32.048994    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bfc98489-f90d-4a7a-b85c-5d258cbed4c0-openshift-service-ca\") pod \"maas-api-e2e-derive-bf9c0727-5ff4c44c4b-vvckc\" (UID: \"bfc98489-f90d-4a7a-b85c-5d258cbed4c0\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-bf9c0727-5ff4c44c4b-vvckc"
Oct 30 21:04:32.049263 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:04:32.049232    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4x8fw\" (UniqueName: \"kubernetes.io/projected/bfc98489-f90d-4a7a-b85c-5d258cbed4c0-kube-api-access-4x8fw\") pod \"maas-api-e2e-derive-bf9c0727-5ff4c44c4b-vvckc\" (UID: \"bfc98489-f90d-4a7a-b85c-5d258cbed4c0\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-bf9c0727-5ff4c44c4b-vvckc"
Oct 30 21:04:32.049324 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:04:32.049291    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bfc98489-f90d-4a7a-b85c-5d258cbed4c0-metrics-certs\") pod \"maas-api-e2e-derive-bf9c0727-5ff4c44c4b-vvckc\" (UID: \"bfc98489-f90d-4a7a-b85c-5d258cbed4c0\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-bf9c0727-5ff4c44c4b-vvckc"
Oct 30 21:04:32.049411 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:04:32.049395    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bfc98489-f90d-4a7a-b85c-5d258cbed4c0-maas-api-tls\") pod \"maas-api-e2e-derive-bf9c0727-5ff4c44c4b-vvckc\" (UID: \"bfc98489-f90d-4a7a-b85c-5d258cbed4c0\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-bf9c0727-5ff4c44c4b-vvckc"
Oct 30 21:04:32.150776 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:04:32.150742    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4x8fw\" (UniqueName: \"kubernetes.io/projected/bfc98489-f90d-4a7a-b85c-5d258cbed4c0-kube-api-access-4x8fw\") pod \"maas-api-e2e-derive-bf9c0727-5ff4c44c4b-vvckc\" (UID: \"bfc98489-f90d-4a7a-b85c-5d258cbed4c0\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-bf9c0727-5ff4c44c4b-vvckc"
Oct 30 21:04:32.150776 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:04:32.150782    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bfc98489-f90d-4a7a-b85c-5d258cbed4c0-metrics-certs\") pod \"maas-api-e2e-derive-bf9c0727-5ff4c44c4b-vvckc\" (UID: \"bfc98489-f90d-4a7a-b85c-5d258cbed4c0\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-bf9c0727-5ff4c44c4b-vvckc"
Oct 30 21:04:32.151032 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:04:32.150822    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bfc98489-f90d-4a7a-b85c-5d258cbed4c0-maas-api-tls\") pod \"maas-api-e2e-derive-bf9c0727-5ff4c44c4b-vvckc\" (UID: \"bfc98489-f90d-4a7a-b85c-5d258cbed4c0\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-bf9c0727-5ff4c44c4b-vvckc"
Oct 30 21:04:32.151032 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:04:32.150913    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bfc98489-f90d-4a7a-b85c-5d258cbed4c0-openshift-service-ca\") pod \"maas-api-e2e-derive-bf9c0727-5ff4c44c4b-vvckc\" (UID: \"bfc98489-f90d-4a7a-b85c-5d258cbed4c0\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-bf9c0727-5ff4c44c4b-vvckc"
Oct 30 21:04:32.151164 ip-10-0-138-85 kubenswrapper[6004]: E1030 21:04:32.151026    6004 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-derive-bf9c0727-serving-cert: secret "maas-api-e2e-derive-bf9c0727-serving-cert" not found
Oct 30 21:04:32.151164 ip-10-0-138-85 kubenswrapper[6004]: E1030 21:04:32.151114    6004 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bfc98489-f90d-4a7a-b85c-5d258cbed4c0-maas-api-tls podName:bfc98489-f90d-4a7a-b85c-5d258cbed4c0 nodeName:}" failed. No retries permitted until 2026-10-30 21:04:32.651093581 +0000 UTC m=+1578.570879694 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/bfc98489-f90d-4a7a-b85c-5d258cbed4c0-maas-api-tls") pod "maas-api-e2e-derive-bf9c0727-5ff4c44c4b-vvckc" (UID: "bfc98489-f90d-4a7a-b85c-5d258cbed4c0") : secret "maas-api-e2e-derive-bf9c0727-serving-cert" not found
Oct 30 21:04:32.151658 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:04:32.151641    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bfc98489-f90d-4a7a-b85c-5d258cbed4c0-openshift-service-ca\") pod \"maas-api-e2e-derive-bf9c0727-5ff4c44c4b-vvckc\" (UID: \"bfc98489-f90d-4a7a-b85c-5d258cbed4c0\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-bf9c0727-5ff4c44c4b-vvckc"
Oct 30 21:04:32.153419 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:04:32.153391    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bfc98489-f90d-4a7a-b85c-5d258cbed4c0-metrics-certs\") pod \"maas-api-e2e-derive-bf9c0727-5ff4c44c4b-vvckc\" (UID: \"bfc98489-f90d-4a7a-b85c-5d258cbed4c0\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-bf9c0727-5ff4c44c4b-vvckc"
Oct 30 21:04:32.211145 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:04:32.211108    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4x8fw\" (UniqueName: \"kubernetes.io/projected/bfc98489-f90d-4a7a-b85c-5d258cbed4c0-kube-api-access-4x8fw\") pod \"maas-api-e2e-derive-bf9c0727-5ff4c44c4b-vvckc\" (UID: \"bfc98489-f90d-4a7a-b85c-5d258cbed4c0\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-bf9c0727-5ff4c44c4b-vvckc"
Oct 30 21:04:32.659247 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:04:32.659155    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bfc98489-f90d-4a7a-b85c-5d258cbed4c0-maas-api-tls\") pod \"maas-api-e2e-derive-bf9c0727-5ff4c44c4b-vvckc\" (UID: \"bfc98489-f90d-4a7a-b85c-5d258cbed4c0\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-bf9c0727-5ff4c44c4b-vvckc"
Oct 30 21:04:32.661617 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:04:32.661589    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bfc98489-f90d-4a7a-b85c-5d258cbed4c0-maas-api-tls\") pod \"maas-api-e2e-derive-bf9c0727-5ff4c44c4b-vvckc\" (UID: \"bfc98489-f90d-4a7a-b85c-5d258cbed4c0\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-bf9c0727-5ff4c44c4b-vvckc"
Oct 30 21:04:32.850483 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:04:32.850449    6004 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-bf9c0727-5ff4c44c4b-vvckc"
Oct 30 21:04:33.264583 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:04:33.258137    6004 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-bf9c0727-5ff4c44c4b-vvckc"]
Oct 30 21:04:33.305415 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:04:33.305380    6004 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-bf9c0727-5ff4c44c4b-vvckc" event={"ID":"bfc98489-f90d-4a7a-b85c-5d258cbed4c0","Type":"ContainerStarted","Data":"267642a6f801615f41455a578a69c6ca581406377463b759949f44348224465d"}
Oct 30 21:04:34.317690 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:04:34.317655    6004 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-bf9c0727-5ff4c44c4b-vvckc" event={"ID":"bfc98489-f90d-4a7a-b85c-5d258cbed4c0","Type":"ContainerStarted","Data":"5fbefa319c4263398be79c52d1d5130e46e42411a9ebea8d833ea72fc4fe96af"}
Oct 30 21:04:34.318253 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:04:34.317989    6004 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-bf9c0727-5ff4c44c4b-vvckc"
Oct 30 21:04:34.460676 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:04:34.457666    6004 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-derive-bf9c0727-5ff4c44c4b-vvckc" podStartSLOduration=2.543193478 podStartE2EDuration="3.457644078s" totalImagesPullingTime="914.4506ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:04:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:04:34.451485389 +0000 UTC m=+1580.371271509" watchObservedRunningTime="2026-10-30 21:04:34.457644078 +0000 UTC m=+1580.377430197"
Oct 30 21:04:40.330429 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:04:40.330401    6004 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-bf9c0727-5ff4c44c4b-vvckc"
Oct 30 21:04:44.299496 ip-10-0-138-85 kubenswrapper[6004]: E1030 21:04:44.299450    6004 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-zz4wr" containerName="extractor"
Oct 30 21:04:56.723858 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:04:56.723827    6004 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-derive-bf9c0727-openshift-default-7fb479dd89-f7bw8"]
Oct 30 21:04:56.729245 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:04:56.729227    6004 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-bf9c0727-openshift-default-7fb479dd89-f7bw8"
Oct 30 21:04:56.782063 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:04:56.782023    6004 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-derive-bf9c0727-openshift-default-dockercfg-d4rns\""
Oct 30 21:04:56.888012 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:04:56.887978    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/20463dad-83a0-4ba2-9de8-824d5e46bdec-workload-certs\") pod \"e2e-derive-bf9c0727-openshift-default-7fb479dd89-f7bw8\" (UID: \"20463dad-83a0-4ba2-9de8-824d5e46bdec\") " pod="openshift-ingress/e2e-derive-bf9c0727-openshift-default-7fb479dd89-f7bw8"
Oct 30 21:04:56.888230 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:04:56.888150    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/20463dad-83a0-4ba2-9de8-824d5e46bdec-istio-podinfo\") pod \"e2e-derive-bf9c0727-openshift-default-7fb479dd89-f7bw8\" (UID: \"20463dad-83a0-4ba2-9de8-824d5e46bdec\") " pod="openshift-ingress/e2e-derive-bf9c0727-openshift-default-7fb479dd89-f7bw8"
Oct 30 21:04:56.888230 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:04:56.888179    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/20463dad-83a0-4ba2-9de8-824d5e46bdec-istiod-ca-cert\") pod \"e2e-derive-bf9c0727-openshift-default-7fb479dd89-f7bw8\" (UID: \"20463dad-83a0-4ba2-9de8-824d5e46bdec\") " pod="openshift-ingress/e2e-derive-bf9c0727-openshift-default-7fb479dd89-f7bw8"
Oct 30 21:04:56.888363 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:04:56.888314    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mtprl\" (UniqueName: \"kubernetes.io/projected/20463dad-83a0-4ba2-9de8-824d5e46bdec-kube-api-access-mtprl\") pod \"e2e-derive-bf9c0727-openshift-default-7fb479dd89-f7bw8\" (UID: \"20463dad-83a0-4ba2-9de8-824d5e46bdec\") " pod="openshift-ingress/e2e-derive-bf9c0727-openshift-default-7fb479dd89-f7bw8"
Oct 30 21:04:56.888423 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:04:56.888378    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/20463dad-83a0-4ba2-9de8-824d5e46bdec-istio-data\") pod \"e2e-derive-bf9c0727-openshift-default-7fb479dd89-f7bw8\" (UID: \"20463dad-83a0-4ba2-9de8-824d5e46bdec\") " pod="openshift-ingress/e2e-derive-bf9c0727-openshift-default-7fb479dd89-f7bw8"
Oct 30 21:04:56.888478 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:04:56.888430    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/20463dad-83a0-4ba2-9de8-824d5e46bdec-istio-token\") pod \"e2e-derive-bf9c0727-openshift-default-7fb479dd89-f7bw8\" (UID: \"20463dad-83a0-4ba2-9de8-824d5e46bdec\") " pod="openshift-ingress/e2e-derive-bf9c0727-openshift-default-7fb479dd89-f7bw8"
Oct 30 21:04:56.888533 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:04:56.888494    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/20463dad-83a0-4ba2-9de8-824d5e46bdec-workload-socket\") pod \"e2e-derive-bf9c0727-openshift-default-7fb479dd89-f7bw8\" (UID: \"20463dad-83a0-4ba2-9de8-824d5e46bdec\") " pod="openshift-ingress/e2e-derive-bf9c0727-openshift-default-7fb479dd89-f7bw8"
Oct 30 21:04:56.888533 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:04:56.888526    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/20463dad-83a0-4ba2-9de8-824d5e46bdec-istio-envoy\") pod \"e2e-derive-bf9c0727-openshift-default-7fb479dd89-f7bw8\" (UID: \"20463dad-83a0-4ba2-9de8-824d5e46bdec\") " pod="openshift-ingress/e2e-derive-bf9c0727-openshift-default-7fb479dd89-f7bw8"
Oct 30 21:04:56.888642 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:04:56.888567    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/20463dad-83a0-4ba2-9de8-824d5e46bdec-credential-socket\") pod \"e2e-derive-bf9c0727-openshift-default-7fb479dd89-f7bw8\" (UID: \"20463dad-83a0-4ba2-9de8-824d5e46bdec\") " pod="openshift-ingress/e2e-derive-bf9c0727-openshift-default-7fb479dd89-f7bw8"
Oct 30 21:04:56.928409 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:04:56.928376    6004 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-bf9c0727-openshift-default-7fb479dd89-f7bw8"]
Oct 30 21:04:56.990142 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:04:56.989963    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/20463dad-83a0-4ba2-9de8-824d5e46bdec-workload-certs\") pod \"e2e-derive-bf9c0727-openshift-default-7fb479dd89-f7bw8\" (UID: \"20463dad-83a0-4ba2-9de8-824d5e46bdec\") " pod="openshift-ingress/e2e-derive-bf9c0727-openshift-default-7fb479dd89-f7bw8"
Oct 30 21:04:56.990142 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:04:56.990109    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/20463dad-83a0-4ba2-9de8-824d5e46bdec-istio-podinfo\") pod \"e2e-derive-bf9c0727-openshift-default-7fb479dd89-f7bw8\" (UID: \"20463dad-83a0-4ba2-9de8-824d5e46bdec\") " pod="openshift-ingress/e2e-derive-bf9c0727-openshift-default-7fb479dd89-f7bw8"
Oct 30 21:04:56.990345 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:04:56.990141    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/20463dad-83a0-4ba2-9de8-824d5e46bdec-istiod-ca-cert\") pod \"e2e-derive-bf9c0727-openshift-default-7fb479dd89-f7bw8\" (UID: \"20463dad-83a0-4ba2-9de8-824d5e46bdec\") " pod="openshift-ingress/e2e-derive-bf9c0727-openshift-default-7fb479dd89-f7bw8"
Oct 30 21:04:56.990345 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:04:56.990180    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mtprl\" (UniqueName: \"kubernetes.io/projected/20463dad-83a0-4ba2-9de8-824d5e46bdec-kube-api-access-mtprl\") pod \"e2e-derive-bf9c0727-openshift-default-7fb479dd89-f7bw8\" (UID: \"20463dad-83a0-4ba2-9de8-824d5e46bdec\") " pod="openshift-ingress/e2e-derive-bf9c0727-openshift-default-7fb479dd89-f7bw8"
Oct 30 21:04:56.990345 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:04:56.990222    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/20463dad-83a0-4ba2-9de8-824d5e46bdec-istio-data\") pod \"e2e-derive-bf9c0727-openshift-default-7fb479dd89-f7bw8\" (UID: \"20463dad-83a0-4ba2-9de8-824d5e46bdec\") " pod="openshift-ingress/e2e-derive-bf9c0727-openshift-default-7fb479dd89-f7bw8"
Oct 30 21:04:56.990345 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:04:56.990258    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/20463dad-83a0-4ba2-9de8-824d5e46bdec-istio-token\") pod \"e2e-derive-bf9c0727-openshift-default-7fb479dd89-f7bw8\" (UID: \"20463dad-83a0-4ba2-9de8-824d5e46bdec\") " pod="openshift-ingress/e2e-derive-bf9c0727-openshift-default-7fb479dd89-f7bw8"
Oct 30 21:04:56.990345 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:04:56.990302    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/20463dad-83a0-4ba2-9de8-824d5e46bdec-workload-socket\") pod \"e2e-derive-bf9c0727-openshift-default-7fb479dd89-f7bw8\" (UID: \"20463dad-83a0-4ba2-9de8-824d5e46bdec\") " pod="openshift-ingress/e2e-derive-bf9c0727-openshift-default-7fb479dd89-f7bw8"
Oct 30 21:04:56.990345 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:04:56.990326    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/20463dad-83a0-4ba2-9de8-824d5e46bdec-istio-envoy\") pod \"e2e-derive-bf9c0727-openshift-default-7fb479dd89-f7bw8\" (UID: \"20463dad-83a0-4ba2-9de8-824d5e46bdec\") " pod="openshift-ingress/e2e-derive-bf9c0727-openshift-default-7fb479dd89-f7bw8"
Oct 30 21:04:56.990533 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:04:56.990367    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/20463dad-83a0-4ba2-9de8-824d5e46bdec-credential-socket\") pod \"e2e-derive-bf9c0727-openshift-default-7fb479dd89-f7bw8\" (UID: \"20463dad-83a0-4ba2-9de8-824d5e46bdec\") " pod="openshift-ingress/e2e-derive-bf9c0727-openshift-default-7fb479dd89-f7bw8"
Oct 30 21:04:56.990533 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:04:56.990425    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/20463dad-83a0-4ba2-9de8-824d5e46bdec-workload-certs\") pod \"e2e-derive-bf9c0727-openshift-default-7fb479dd89-f7bw8\" (UID: \"20463dad-83a0-4ba2-9de8-824d5e46bdec\") " pod="openshift-ingress/e2e-derive-bf9c0727-openshift-default-7fb479dd89-f7bw8"
Oct 30 21:04:56.990731 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:04:56.990713    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/20463dad-83a0-4ba2-9de8-824d5e46bdec-credential-socket\") pod \"e2e-derive-bf9c0727-openshift-default-7fb479dd89-f7bw8\" (UID: \"20463dad-83a0-4ba2-9de8-824d5e46bdec\") " pod="openshift-ingress/e2e-derive-bf9c0727-openshift-default-7fb479dd89-f7bw8"
Oct 30 21:04:56.990932 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:04:56.990915    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/20463dad-83a0-4ba2-9de8-824d5e46bdec-workload-socket\") pod \"e2e-derive-bf9c0727-openshift-default-7fb479dd89-f7bw8\" (UID: \"20463dad-83a0-4ba2-9de8-824d5e46bdec\") " pod="openshift-ingress/e2e-derive-bf9c0727-openshift-default-7fb479dd89-f7bw8"
Oct 30 21:04:56.991009 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:04:56.990983    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/20463dad-83a0-4ba2-9de8-824d5e46bdec-istiod-ca-cert\") pod \"e2e-derive-bf9c0727-openshift-default-7fb479dd89-f7bw8\" (UID: \"20463dad-83a0-4ba2-9de8-824d5e46bdec\") " pod="openshift-ingress/e2e-derive-bf9c0727-openshift-default-7fb479dd89-f7bw8"
Oct 30 21:04:56.991352 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:04:56.991324    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/20463dad-83a0-4ba2-9de8-824d5e46bdec-istio-data\") pod \"e2e-derive-bf9c0727-openshift-default-7fb479dd89-f7bw8\" (UID: \"20463dad-83a0-4ba2-9de8-824d5e46bdec\") " pod="openshift-ingress/e2e-derive-bf9c0727-openshift-default-7fb479dd89-f7bw8"
Oct 30 21:04:56.993151 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:04:56.993127    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/20463dad-83a0-4ba2-9de8-824d5e46bdec-istio-envoy\") pod \"e2e-derive-bf9c0727-openshift-default-7fb479dd89-f7bw8\" (UID: \"20463dad-83a0-4ba2-9de8-824d5e46bdec\") " pod="openshift-ingress/e2e-derive-bf9c0727-openshift-default-7fb479dd89-f7bw8"
Oct 30 21:04:56.993281 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:04:56.993265    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/20463dad-83a0-4ba2-9de8-824d5e46bdec-istio-podinfo\") pod \"e2e-derive-bf9c0727-openshift-default-7fb479dd89-f7bw8\" (UID: \"20463dad-83a0-4ba2-9de8-824d5e46bdec\") " pod="openshift-ingress/e2e-derive-bf9c0727-openshift-default-7fb479dd89-f7bw8"
Oct 30 21:04:57.048575 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:04:57.048540    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/20463dad-83a0-4ba2-9de8-824d5e46bdec-istio-token\") pod \"e2e-derive-bf9c0727-openshift-default-7fb479dd89-f7bw8\" (UID: \"20463dad-83a0-4ba2-9de8-824d5e46bdec\") " pod="openshift-ingress/e2e-derive-bf9c0727-openshift-default-7fb479dd89-f7bw8"
Oct 30 21:04:57.048742 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:04:57.048657    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mtprl\" (UniqueName: \"kubernetes.io/projected/20463dad-83a0-4ba2-9de8-824d5e46bdec-kube-api-access-mtprl\") pod \"e2e-derive-bf9c0727-openshift-default-7fb479dd89-f7bw8\" (UID: \"20463dad-83a0-4ba2-9de8-824d5e46bdec\") " pod="openshift-ingress/e2e-derive-bf9c0727-openshift-default-7fb479dd89-f7bw8"
Oct 30 21:04:57.344979 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:04:57.344879    6004 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-bf9c0727-openshift-default-7fb479dd89-f7bw8"
Oct 30 21:04:57.780658 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:04:57.780626    6004 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-bf9c0727-openshift-default-7fb479dd89-f7bw8"]
Oct 30 21:04:57.781828 ip-10-0-138-85 kubenswrapper[6004]: W1030 21:04:57.781790    6004 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod20463dad_83a0_4ba2_9de8_824d5e46bdec.slice/crio-ac8870eaf14762da77bd5bd80078484424f73f66bfc810993750aa59d21e485f WatchSource:0}: Error finding container ac8870eaf14762da77bd5bd80078484424f73f66bfc810993750aa59d21e485f: Status 404 returned error can't find the container with id ac8870eaf14762da77bd5bd80078484424f73f66bfc810993750aa59d21e485f
Oct 30 21:04:57.784385 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:04:57.784348    6004 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 21:04:57.784498 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:04:57.784415    6004 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 21:04:57.784498 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:04:57.784446    6004 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 21:04:58.608207 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:04:58.608172    6004 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-bf9c0727-openshift-default-7fb479dd89-f7bw8" event={"ID":"20463dad-83a0-4ba2-9de8-824d5e46bdec","Type":"ContainerStarted","Data":"580794f81ed2655b3d30828e14cd4643a5bc457b6ef411fa06d4a212acdc4ea1"}
Oct 30 21:04:58.608397 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:04:58.608225    6004 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-bf9c0727-openshift-default-7fb479dd89-f7bw8" event={"ID":"20463dad-83a0-4ba2-9de8-824d5e46bdec","Type":"ContainerStarted","Data":"ac8870eaf14762da77bd5bd80078484424f73f66bfc810993750aa59d21e485f"}
Oct 30 21:04:58.780914 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:04:58.780859    6004 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-derive-bf9c0727-openshift-default-7fb479dd89-f7bw8" podStartSLOduration=2.780841305 podStartE2EDuration="2.780841305s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:04:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:04:58.776479941 +0000 UTC m=+1604.696266060" watchObservedRunningTime="2026-10-30 21:04:58.780841305 +0000 UTC m=+1604.700627495"
Oct 30 21:04:59.352085 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:04:59.348429    6004 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-bf9c0727-openshift-default-7fb479dd89-f7bw8"
Oct 30 21:04:59.352085 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:04:59.351690    6004 patch_prober.go:29] interesting pod/e2e-derive-bf9c0727-openshift-default-7fb479dd89-f7bw8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.93:15021/healthz/ready\": dial tcp 10.132.0.93:15021: connect: connection refused" start-of-body=
Oct 30 21:04:59.352085 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:04:59.351750    6004 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-bf9c0727-openshift-default-7fb479dd89-f7bw8" podUID="20463dad-83a0-4ba2-9de8-824d5e46bdec" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.93:15021/healthz/ready\": dial tcp 10.132.0.93:15021: connect: connection refused"
Oct 30 21:05:00.346083 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:05:00.345430    6004 patch_prober.go:29] interesting pod/e2e-derive-bf9c0727-openshift-default-7fb479dd89-f7bw8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.93:15021/healthz/ready\": dial tcp 10.132.0.93:15021: connect: connection refused" start-of-body=
Oct 30 21:05:00.346083 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:05:00.345511    6004 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-bf9c0727-openshift-default-7fb479dd89-f7bw8" podUID="20463dad-83a0-4ba2-9de8-824d5e46bdec" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.93:15021/healthz/ready\": dial tcp 10.132.0.93:15021: connect: connection refused"
Oct 30 21:05:01.358073 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:05:01.355420    6004 patch_prober.go:29] interesting pod/e2e-derive-bf9c0727-openshift-default-7fb479dd89-f7bw8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.93:15021/healthz/ready\": dial tcp 10.132.0.93:15021: connect: connection refused" start-of-body=
Oct 30 21:05:01.358073 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:05:01.355482    6004 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-bf9c0727-openshift-default-7fb479dd89-f7bw8" podUID="20463dad-83a0-4ba2-9de8-824d5e46bdec" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.93:15021/healthz/ready\": dial tcp 10.132.0.93:15021: connect: connection refused"
Oct 30 21:05:02.360213 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:05:02.360169    6004 patch_prober.go:29] interesting pod/e2e-derive-bf9c0727-openshift-default-7fb479dd89-f7bw8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.93:15021/healthz/ready\": dial tcp 10.132.0.93:15021: connect: connection refused" start-of-body=
Oct 30 21:05:02.360826 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:05:02.360792    6004 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-bf9c0727-openshift-default-7fb479dd89-f7bw8" podUID="20463dad-83a0-4ba2-9de8-824d5e46bdec" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.93:15021/healthz/ready\": dial tcp 10.132.0.93:15021: connect: connection refused"
Oct 30 21:05:03.084060 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:05:03.084015    6004 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w1-f9f277-openshift-default-869d58fb77-dllj5"]
Oct 30 21:05:03.084258 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:05:03.084237    6004 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w1-f9f277-openshift-default-869d58fb77-dllj5" podUID="c1a9de29-3987-4405-b4e0-c9c2586c4f96" containerName="istio-proxy" containerID="cri-o://b0282cc6b7db97faa611b6c779a3c1bd9aba2d46b3615a9dbd007d1b5b643c71" gracePeriod=30
Oct 30 21:05:03.352129 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:05:03.348481    6004 patch_prober.go:29] interesting pod/e2e-derive-bf9c0727-openshift-default-7fb479dd89-f7bw8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.93:15021/healthz/ready\": dial tcp 10.132.0.93:15021: connect: connection refused" start-of-body=
Oct 30 21:05:03.352129 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:05:03.348544    6004 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-bf9c0727-openshift-default-7fb479dd89-f7bw8" podUID="20463dad-83a0-4ba2-9de8-824d5e46bdec" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.93:15021/healthz/ready\": dial tcp 10.132.0.93:15021: connect: connection refused"
Oct 30 21:05:04.349855 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:05:04.349825    6004 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-bf9c0727-openshift-default-7fb479dd89-f7bw8"
Oct 30 21:05:04.350350 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:05:04.350335    6004 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-bf9c0727-openshift-default-7fb479dd89-f7bw8"
Oct 30 21:05:04.351183 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:05:04.351157    6004 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-bf9c0727-openshift-default-7fb479dd89-f7bw8"
Oct 30 21:05:08.369158 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:05:08.369133    6004 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-f9f277-openshift-default-869d58fb77-dllj5"
Oct 30 21:05:08.486294 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:05:08.486259    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/c1a9de29-3987-4405-b4e0-c9c2586c4f96-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c1a9de29-3987-4405-b4e0-c9c2586c4f96-istio-envoy\") pod \"c1a9de29-3987-4405-b4e0-c9c2586c4f96\" (UID: \"c1a9de29-3987-4405-b4e0-c9c2586c4f96\") "
Oct 30 21:05:08.486455 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:05:08.486338    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/c1a9de29-3987-4405-b4e0-c9c2586c4f96-kube-api-access-f5zl9\" (UniqueName: \"kubernetes.io/projected/c1a9de29-3987-4405-b4e0-c9c2586c4f96-kube-api-access-f5zl9\") pod \"c1a9de29-3987-4405-b4e0-c9c2586c4f96\" (UID: \"c1a9de29-3987-4405-b4e0-c9c2586c4f96\") "
Oct 30 21:05:08.486455 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:05:08.486364    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/c1a9de29-3987-4405-b4e0-c9c2586c4f96-istio-token\" (UniqueName: \"kubernetes.io/projected/c1a9de29-3987-4405-b4e0-c9c2586c4f96-istio-token\") pod \"c1a9de29-3987-4405-b4e0-c9c2586c4f96\" (UID: \"c1a9de29-3987-4405-b4e0-c9c2586c4f96\") "
Oct 30 21:05:08.486455 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:05:08.486394    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/c1a9de29-3987-4405-b4e0-c9c2586c4f96-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c1a9de29-3987-4405-b4e0-c9c2586c4f96-istio-data\") pod \"c1a9de29-3987-4405-b4e0-c9c2586c4f96\" (UID: \"c1a9de29-3987-4405-b4e0-c9c2586c4f96\") "
Oct 30 21:05:08.486587 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:05:08.486512    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/c1a9de29-3987-4405-b4e0-c9c2586c4f96-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c1a9de29-3987-4405-b4e0-c9c2586c4f96-workload-certs\") pod \"c1a9de29-3987-4405-b4e0-c9c2586c4f96\" (UID: \"c1a9de29-3987-4405-b4e0-c9c2586c4f96\") "
Oct 30 21:05:08.486646 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:05:08.486611    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/c1a9de29-3987-4405-b4e0-c9c2586c4f96-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c1a9de29-3987-4405-b4e0-c9c2586c4f96-istio-podinfo\") pod \"c1a9de29-3987-4405-b4e0-c9c2586c4f96\" (UID: \"c1a9de29-3987-4405-b4e0-c9c2586c4f96\") "
Oct 30 21:05:08.486706 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:05:08.486686    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/c1a9de29-3987-4405-b4e0-c9c2586c4f96-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c1a9de29-3987-4405-b4e0-c9c2586c4f96-credential-socket\") pod \"c1a9de29-3987-4405-b4e0-c9c2586c4f96\" (UID: \"c1a9de29-3987-4405-b4e0-c9c2586c4f96\") "
Oct 30 21:05:08.486789 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:05:08.486759    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/c1a9de29-3987-4405-b4e0-c9c2586c4f96-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c1a9de29-3987-4405-b4e0-c9c2586c4f96-istiod-ca-cert\") pod \"c1a9de29-3987-4405-b4e0-c9c2586c4f96\" (UID: \"c1a9de29-3987-4405-b4e0-c9c2586c4f96\") "
Oct 30 21:05:08.486866 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:05:08.486828    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/c1a9de29-3987-4405-b4e0-c9c2586c4f96-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c1a9de29-3987-4405-b4e0-c9c2586c4f96-workload-socket\") pod \"c1a9de29-3987-4405-b4e0-c9c2586c4f96\" (UID: \"c1a9de29-3987-4405-b4e0-c9c2586c4f96\") "
Oct 30 21:05:08.487068 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:05:08.486760    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c1a9de29-3987-4405-b4e0-c9c2586c4f96-istio-data" pod "c1a9de29-3987-4405-b4e0-c9c2586c4f96" (UID: "c1a9de29-3987-4405-b4e0-c9c2586c4f96"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:05:08.487068 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:05:08.487011    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c1a9de29-3987-4405-b4e0-c9c2586c4f96-credential-socket" pod "c1a9de29-3987-4405-b4e0-c9c2586c4f96" (UID: "c1a9de29-3987-4405-b4e0-c9c2586c4f96"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:05:08.487068 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:05:08.487002    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c1a9de29-3987-4405-b4e0-c9c2586c4f96-workload-certs" pod "c1a9de29-3987-4405-b4e0-c9c2586c4f96" (UID: "c1a9de29-3987-4405-b4e0-c9c2586c4f96"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:05:08.487264 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:05:08.487113    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c1a9de29-3987-4405-b4e0-c9c2586c4f96-istiod-ca-cert" pod "c1a9de29-3987-4405-b4e0-c9c2586c4f96" (UID: "c1a9de29-3987-4405-b4e0-c9c2586c4f96"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:05:08.487396 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:05:08.487373    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c1a9de29-3987-4405-b4e0-c9c2586c4f96-workload-socket" pod "c1a9de29-3987-4405-b4e0-c9c2586c4f96" (UID: "c1a9de29-3987-4405-b4e0-c9c2586c4f96"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:05:08.487695 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:05:08.487673    6004 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c1a9de29-3987-4405-b4e0-c9c2586c4f96-istio-data\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:05:08.487735 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:05:08.487702    6004 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c1a9de29-3987-4405-b4e0-c9c2586c4f96-workload-certs\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:05:08.487735 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:05:08.487722    6004 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c1a9de29-3987-4405-b4e0-c9c2586c4f96-credential-socket\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:05:08.487808 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:05:08.487737    6004 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c1a9de29-3987-4405-b4e0-c9c2586c4f96-istiod-ca-cert\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:05:08.487808 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:05:08.487751    6004 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c1a9de29-3987-4405-b4e0-c9c2586c4f96-workload-socket\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:05:08.488818 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:05:08.488794    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c1a9de29-3987-4405-b4e0-c9c2586c4f96-istio-token" pod "c1a9de29-3987-4405-b4e0-c9c2586c4f96" (UID: "c1a9de29-3987-4405-b4e0-c9c2586c4f96"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:05:08.488953 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:05:08.488938    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c1a9de29-3987-4405-b4e0-c9c2586c4f96-kube-api-access-f5zl9" pod "c1a9de29-3987-4405-b4e0-c9c2586c4f96" (UID: "c1a9de29-3987-4405-b4e0-c9c2586c4f96"). InnerVolumeSpecName "kube-api-access-f5zl9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:05:08.489115 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:05:08.489097    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c1a9de29-3987-4405-b4e0-c9c2586c4f96-istio-envoy" pod "c1a9de29-3987-4405-b4e0-c9c2586c4f96" (UID: "c1a9de29-3987-4405-b4e0-c9c2586c4f96"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:05:08.489642 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:05:08.489591    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/c1a9de29-3987-4405-b4e0-c9c2586c4f96-istio-podinfo" pod "c1a9de29-3987-4405-b4e0-c9c2586c4f96" (UID: "c1a9de29-3987-4405-b4e0-c9c2586c4f96"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 21:05:08.589848 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:05:08.589808    6004 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c1a9de29-3987-4405-b4e0-c9c2586c4f96-istio-envoy\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:05:08.590037 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:05:08.589852    6004 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f5zl9\" (UniqueName: \"kubernetes.io/projected/c1a9de29-3987-4405-b4e0-c9c2586c4f96-kube-api-access-f5zl9\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:05:08.590037 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:05:08.589871    6004 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c1a9de29-3987-4405-b4e0-c9c2586c4f96-istio-token\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:05:08.590037 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:05:08.589885    6004 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c1a9de29-3987-4405-b4e0-c9c2586c4f96-istio-podinfo\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:05:08.714221 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:05:08.714185    6004 generic.go:356] "Generic (PLEG): container finished" podID="c1a9de29-3987-4405-b4e0-c9c2586c4f96" containerID="b0282cc6b7db97faa611b6c779a3c1bd9aba2d46b3615a9dbd007d1b5b643c71" exitCode=0
Oct 30 21:05:08.714397 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:05:08.714248    6004 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-f9f277-openshift-default-869d58fb77-dllj5"
Oct 30 21:05:08.714397 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:05:08.714267    6004 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-f9f277-openshift-default-869d58fb77-dllj5" event={"ID":"c1a9de29-3987-4405-b4e0-c9c2586c4f96","Type":"ContainerDied","Data":"b0282cc6b7db97faa611b6c779a3c1bd9aba2d46b3615a9dbd007d1b5b643c71"}
Oct 30 21:05:08.714397 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:05:08.714330    6004 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-f9f277-openshift-default-869d58fb77-dllj5" event={"ID":"c1a9de29-3987-4405-b4e0-c9c2586c4f96","Type":"ContainerDied","Data":"08b705ccd1b549327c9139e41149d89b7e47786d2bfee37b2890603663265ed7"}
Oct 30 21:05:08.714397 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:05:08.714353    6004 scope.go:122] "RemoveContainer" containerID="b0282cc6b7db97faa611b6c779a3c1bd9aba2d46b3615a9dbd007d1b5b643c71"
Oct 30 21:05:08.725756 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:05:08.725737    6004 scope.go:122] "RemoveContainer" containerID="b0282cc6b7db97faa611b6c779a3c1bd9aba2d46b3615a9dbd007d1b5b643c71"
Oct 30 21:05:08.726019 ip-10-0-138-85 kubenswrapper[6004]: E1030 21:05:08.726002    6004 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b0282cc6b7db97faa611b6c779a3c1bd9aba2d46b3615a9dbd007d1b5b643c71\": container with ID starting with b0282cc6b7db97faa611b6c779a3c1bd9aba2d46b3615a9dbd007d1b5b643c71 not found: ID does not exist" containerID="b0282cc6b7db97faa611b6c779a3c1bd9aba2d46b3615a9dbd007d1b5b643c71"
Oct 30 21:05:08.726095 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:05:08.726030    6004 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b0282cc6b7db97faa611b6c779a3c1bd9aba2d46b3615a9dbd007d1b5b643c71"} err="failed to get container status \"b0282cc6b7db97faa611b6c779a3c1bd9aba2d46b3615a9dbd007d1b5b643c71\": rpc error: code = NotFound desc = could not find container \"b0282cc6b7db97faa611b6c779a3c1bd9aba2d46b3615a9dbd007d1b5b643c71\": container with ID starting with b0282cc6b7db97faa611b6c779a3c1bd9aba2d46b3615a9dbd007d1b5b643c71 not found: ID does not exist"
Oct 30 21:05:08.883766 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:05:08.883732    6004 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w1-f9f277-openshift-default-869d58fb77-dllj5"]
Oct 30 21:05:08.888460 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:05:08.888429    6004 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w1-f9f277-openshift-default-869d58fb77-dllj5"]
Oct 30 21:05:09.409527 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:05:09.409493    6004 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w4-5c45e5-f8fc47765-x5c9d"]
Oct 30 21:05:09.410538 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:05:09.410518    6004 cpu_manager.go:414] "containerMap: removing container" podUID="c1a9de29-3987-4405-b4e0-c9c2586c4f96" containerName="istio-proxy"
Oct 30 21:05:09.410616 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:05:09.410539    6004 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="c1a9de29-3987-4405-b4e0-c9c2586c4f96" containerName="istio-proxy"
Oct 30 21:05:09.410760 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:05:09.410748    6004 memory_manager.go:365] "RemoveStaleState removing state" podUID="c1a9de29-3987-4405-b4e0-c9c2586c4f96" containerName="istio-proxy"
Oct 30 21:05:09.415937 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:05:09.415914    6004 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w4-5c45e5-f8fc47765-x5c9d"
Oct 30 21:05:09.468245 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:05:09.468214    6004 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w4-5c45e5-f8fc47765-x5c9d"]
Oct 30 21:05:09.468596 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:05:09.468559    6004 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-a-w4-5c45e5-serving-cert\""
Oct 30 21:05:09.502580 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:05:09.502546    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5dcbdf4b-5aba-4987-b808-a45bf7117b4f-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w4-5c45e5-f8fc47765-x5c9d\" (UID: \"5dcbdf4b-5aba-4987-b808-a45bf7117b4f\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w4-5c45e5-f8fc47765-x5c9d"
Oct 30 21:05:09.502768 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:05:09.502747    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4jv8p\" (UniqueName: \"kubernetes.io/projected/5dcbdf4b-5aba-4987-b808-a45bf7117b4f-kube-api-access-4jv8p\") pod \"maas-api-e2e-shared-a-w4-5c45e5-f8fc47765-x5c9d\" (UID: \"5dcbdf4b-5aba-4987-b808-a45bf7117b4f\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w4-5c45e5-f8fc47765-x5c9d"
Oct 30 21:05:09.502882 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:05:09.502865    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5dcbdf4b-5aba-4987-b808-a45bf7117b4f-metrics-certs\") pod \"maas-api-e2e-shared-a-w4-5c45e5-f8fc47765-x5c9d\" (UID: \"5dcbdf4b-5aba-4987-b808-a45bf7117b4f\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w4-5c45e5-f8fc47765-x5c9d"
Oct 30 21:05:09.503020 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:05:09.502995    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5dcbdf4b-5aba-4987-b808-a45bf7117b4f-maas-api-tls\") pod \"maas-api-e2e-shared-a-w4-5c45e5-f8fc47765-x5c9d\" (UID: \"5dcbdf4b-5aba-4987-b808-a45bf7117b4f\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w4-5c45e5-f8fc47765-x5c9d"
Oct 30 21:05:09.604399 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:05:09.604366    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5dcbdf4b-5aba-4987-b808-a45bf7117b4f-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w4-5c45e5-f8fc47765-x5c9d\" (UID: \"5dcbdf4b-5aba-4987-b808-a45bf7117b4f\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w4-5c45e5-f8fc47765-x5c9d"
Oct 30 21:05:09.604572 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:05:09.604502    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4jv8p\" (UniqueName: \"kubernetes.io/projected/5dcbdf4b-5aba-4987-b808-a45bf7117b4f-kube-api-access-4jv8p\") pod \"maas-api-e2e-shared-a-w4-5c45e5-f8fc47765-x5c9d\" (UID: \"5dcbdf4b-5aba-4987-b808-a45bf7117b4f\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w4-5c45e5-f8fc47765-x5c9d"
Oct 30 21:05:09.604638 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:05:09.604603    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5dcbdf4b-5aba-4987-b808-a45bf7117b4f-metrics-certs\") pod \"maas-api-e2e-shared-a-w4-5c45e5-f8fc47765-x5c9d\" (UID: \"5dcbdf4b-5aba-4987-b808-a45bf7117b4f\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w4-5c45e5-f8fc47765-x5c9d"
Oct 30 21:05:09.604716 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:05:09.604695    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5dcbdf4b-5aba-4987-b808-a45bf7117b4f-maas-api-tls\") pod \"maas-api-e2e-shared-a-w4-5c45e5-f8fc47765-x5c9d\" (UID: \"5dcbdf4b-5aba-4987-b808-a45bf7117b4f\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w4-5c45e5-f8fc47765-x5c9d"
Oct 30 21:05:09.604954 ip-10-0-138-85 kubenswrapper[6004]: E1030 21:05:09.604924    6004 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-a-w4-5c45e5-serving-cert: secret "maas-api-e2e-shared-a-w4-5c45e5-serving-cert" not found
Oct 30 21:05:09.605111 ip-10-0-138-85 kubenswrapper[6004]: E1030 21:05:09.605000    6004 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5dcbdf4b-5aba-4987-b808-a45bf7117b4f-maas-api-tls podName:5dcbdf4b-5aba-4987-b808-a45bf7117b4f nodeName:}" failed. No retries permitted until 2026-10-30 21:05:10.104981069 +0000 UTC m=+1616.024767170 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/5dcbdf4b-5aba-4987-b808-a45bf7117b4f-maas-api-tls") pod "maas-api-e2e-shared-a-w4-5c45e5-f8fc47765-x5c9d" (UID: "5dcbdf4b-5aba-4987-b808-a45bf7117b4f") : secret "maas-api-e2e-shared-a-w4-5c45e5-serving-cert" not found
Oct 30 21:05:09.605239 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:05:09.605213    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5dcbdf4b-5aba-4987-b808-a45bf7117b4f-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w4-5c45e5-f8fc47765-x5c9d\" (UID: \"5dcbdf4b-5aba-4987-b808-a45bf7117b4f\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w4-5c45e5-f8fc47765-x5c9d"
Oct 30 21:05:09.607213 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:05:09.607191    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5dcbdf4b-5aba-4987-b808-a45bf7117b4f-metrics-certs\") pod \"maas-api-e2e-shared-a-w4-5c45e5-f8fc47765-x5c9d\" (UID: \"5dcbdf4b-5aba-4987-b808-a45bf7117b4f\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w4-5c45e5-f8fc47765-x5c9d"
Oct 30 21:05:09.669121 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:05:09.668461    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4jv8p\" (UniqueName: \"kubernetes.io/projected/5dcbdf4b-5aba-4987-b808-a45bf7117b4f-kube-api-access-4jv8p\") pod \"maas-api-e2e-shared-a-w4-5c45e5-f8fc47765-x5c9d\" (UID: \"5dcbdf4b-5aba-4987-b808-a45bf7117b4f\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w4-5c45e5-f8fc47765-x5c9d"
Oct 30 21:05:10.114087 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:05:10.114031    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5dcbdf4b-5aba-4987-b808-a45bf7117b4f-maas-api-tls\") pod \"maas-api-e2e-shared-a-w4-5c45e5-f8fc47765-x5c9d\" (UID: \"5dcbdf4b-5aba-4987-b808-a45bf7117b4f\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w4-5c45e5-f8fc47765-x5c9d"
Oct 30 21:05:10.116637 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:05:10.116611    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5dcbdf4b-5aba-4987-b808-a45bf7117b4f-maas-api-tls\") pod \"maas-api-e2e-shared-a-w4-5c45e5-f8fc47765-x5c9d\" (UID: \"5dcbdf4b-5aba-4987-b808-a45bf7117b4f\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w4-5c45e5-f8fc47765-x5c9d"
Oct 30 21:05:10.241797 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:05:10.241753    6004 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="c1a9de29-3987-4405-b4e0-c9c2586c4f96" path="/var/lib/kubelet/pods/c1a9de29-3987-4405-b4e0-c9c2586c4f96/volumes"
Oct 30 21:05:10.333515 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:05:10.333482    6004 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w4-5c45e5-f8fc47765-x5c9d"
Oct 30 21:05:10.715188 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:05:10.715146    6004 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w4-5c45e5-f8fc47765-x5c9d"]
Oct 30 21:05:10.715580 ip-10-0-138-85 kubenswrapper[6004]: W1030 21:05:10.715559    6004 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5dcbdf4b_5aba_4987_b808_a45bf7117b4f.slice/crio-e9ccd95e2291726df4597e9a7f4aebad258c8fba06b931a69d6520a82e76d066 WatchSource:0}: Error finding container e9ccd95e2291726df4597e9a7f4aebad258c8fba06b931a69d6520a82e76d066: Status 404 returned error can't find the container with id e9ccd95e2291726df4597e9a7f4aebad258c8fba06b931a69d6520a82e76d066
Oct 30 21:05:10.730959 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:05:10.730931    6004 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w4-5c45e5-f8fc47765-x5c9d" event={"ID":"5dcbdf4b-5aba-4987-b808-a45bf7117b4f","Type":"ContainerStarted","Data":"e9ccd95e2291726df4597e9a7f4aebad258c8fba06b931a69d6520a82e76d066"}
Oct 30 21:05:11.742309 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:05:11.742274    6004 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w4-5c45e5-f8fc47765-x5c9d" event={"ID":"5dcbdf4b-5aba-4987-b808-a45bf7117b4f","Type":"ContainerStarted","Data":"4a78fa01407e2441675f867bad740282c269f1be9ab9ea942d4b935124cbdee9"}
Oct 30 21:05:11.742730 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:05:11.742424    6004 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w4-5c45e5-f8fc47765-x5c9d"
Oct 30 21:05:11.908072 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:05:11.907955    6004 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w4-5c45e5-f8fc47765-x5c9d" podStartSLOduration=2.035469079 podStartE2EDuration="2.907941595s" totalImagesPullingTime="872.472516ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:05:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:05:11.90610229 +0000 UTC m=+1617.825888408" watchObservedRunningTime="2026-10-30 21:05:11.907941595 +0000 UTC m=+1617.827727714"
Oct 30 21:05:14.288536 ip-10-0-138-85 kubenswrapper[6004]: E1030 21:05:14.288492    6004 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-zz4wr" containerName="extractor"
Oct 30 21:05:17.755319 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:05:17.755280    6004 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w4-5c45e5-f8fc47765-x5c9d"
Oct 30 21:05:42.083529 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:05:42.083493    6004 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-derive-bf9c0727-openshift-default-7fb479dd89-nkkk2"]
Oct 30 21:05:42.088444 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:05:42.088421    6004 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-bf9c0727-openshift-default-7fb479dd89-nkkk2"
Oct 30 21:05:42.173723 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:05:42.173689    6004 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-bf9c0727-openshift-default-7fb479dd89-nkkk2"]
Oct 30 21:05:42.218972 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:05:42.218939    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7d16ac0c-fddc-4ea4-9f2f-0b485a109bef-istio-envoy\") pod \"e2e-derive-bf9c0727-openshift-default-7fb479dd89-nkkk2\" (UID: \"7d16ac0c-fddc-4ea4-9f2f-0b485a109bef\") " pod="openshift-ingress/e2e-derive-bf9c0727-openshift-default-7fb479dd89-nkkk2"
Oct 30 21:05:42.219162 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:05:42.219000    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7d16ac0c-fddc-4ea4-9f2f-0b485a109bef-istio-podinfo\") pod \"e2e-derive-bf9c0727-openshift-default-7fb479dd89-nkkk2\" (UID: \"7d16ac0c-fddc-4ea4-9f2f-0b485a109bef\") " pod="openshift-ingress/e2e-derive-bf9c0727-openshift-default-7fb479dd89-nkkk2"
Oct 30 21:05:42.219207 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:05:42.219167    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7d16ac0c-fddc-4ea4-9f2f-0b485a109bef-istio-data\") pod \"e2e-derive-bf9c0727-openshift-default-7fb479dd89-nkkk2\" (UID: \"7d16ac0c-fddc-4ea4-9f2f-0b485a109bef\") " pod="openshift-ingress/e2e-derive-bf9c0727-openshift-default-7fb479dd89-nkkk2"
Oct 30 21:05:42.219290 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:05:42.219269    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5f25f\" (UniqueName: \"kubernetes.io/projected/7d16ac0c-fddc-4ea4-9f2f-0b485a109bef-kube-api-access-5f25f\") pod \"e2e-derive-bf9c0727-openshift-default-7fb479dd89-nkkk2\" (UID: \"7d16ac0c-fddc-4ea4-9f2f-0b485a109bef\") " pod="openshift-ingress/e2e-derive-bf9c0727-openshift-default-7fb479dd89-nkkk2"
Oct 30 21:05:42.219352 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:05:42.219339    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7d16ac0c-fddc-4ea4-9f2f-0b485a109bef-istiod-ca-cert\") pod \"e2e-derive-bf9c0727-openshift-default-7fb479dd89-nkkk2\" (UID: \"7d16ac0c-fddc-4ea4-9f2f-0b485a109bef\") " pod="openshift-ingress/e2e-derive-bf9c0727-openshift-default-7fb479dd89-nkkk2"
Oct 30 21:05:42.219442 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:05:42.219430    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7d16ac0c-fddc-4ea4-9f2f-0b485a109bef-istio-token\") pod \"e2e-derive-bf9c0727-openshift-default-7fb479dd89-nkkk2\" (UID: \"7d16ac0c-fddc-4ea4-9f2f-0b485a109bef\") " pod="openshift-ingress/e2e-derive-bf9c0727-openshift-default-7fb479dd89-nkkk2"
Oct 30 21:05:42.219508 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:05:42.219491    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7d16ac0c-fddc-4ea4-9f2f-0b485a109bef-credential-socket\") pod \"e2e-derive-bf9c0727-openshift-default-7fb479dd89-nkkk2\" (UID: \"7d16ac0c-fddc-4ea4-9f2f-0b485a109bef\") " pod="openshift-ingress/e2e-derive-bf9c0727-openshift-default-7fb479dd89-nkkk2"
Oct 30 21:05:42.219548 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:05:42.219524    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7d16ac0c-fddc-4ea4-9f2f-0b485a109bef-workload-socket\") pod \"e2e-derive-bf9c0727-openshift-default-7fb479dd89-nkkk2\" (UID: \"7d16ac0c-fddc-4ea4-9f2f-0b485a109bef\") " pod="openshift-ingress/e2e-derive-bf9c0727-openshift-default-7fb479dd89-nkkk2"
Oct 30 21:05:42.219641 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:05:42.219625    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7d16ac0c-fddc-4ea4-9f2f-0b485a109bef-workload-certs\") pod \"e2e-derive-bf9c0727-openshift-default-7fb479dd89-nkkk2\" (UID: \"7d16ac0c-fddc-4ea4-9f2f-0b485a109bef\") " pod="openshift-ingress/e2e-derive-bf9c0727-openshift-default-7fb479dd89-nkkk2"
Oct 30 21:05:42.321475 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:05:42.321443    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7d16ac0c-fddc-4ea4-9f2f-0b485a109bef-istio-envoy\") pod \"e2e-derive-bf9c0727-openshift-default-7fb479dd89-nkkk2\" (UID: \"7d16ac0c-fddc-4ea4-9f2f-0b485a109bef\") " pod="openshift-ingress/e2e-derive-bf9c0727-openshift-default-7fb479dd89-nkkk2"
Oct 30 21:05:42.321662 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:05:42.321495    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7d16ac0c-fddc-4ea4-9f2f-0b485a109bef-istio-podinfo\") pod \"e2e-derive-bf9c0727-openshift-default-7fb479dd89-nkkk2\" (UID: \"7d16ac0c-fddc-4ea4-9f2f-0b485a109bef\") " pod="openshift-ingress/e2e-derive-bf9c0727-openshift-default-7fb479dd89-nkkk2"
Oct 30 21:05:42.321662 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:05:42.321543    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7d16ac0c-fddc-4ea4-9f2f-0b485a109bef-istio-data\") pod \"e2e-derive-bf9c0727-openshift-default-7fb479dd89-nkkk2\" (UID: \"7d16ac0c-fddc-4ea4-9f2f-0b485a109bef\") " pod="openshift-ingress/e2e-derive-bf9c0727-openshift-default-7fb479dd89-nkkk2"
Oct 30 21:05:42.321662 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:05:42.321600    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5f25f\" (UniqueName: \"kubernetes.io/projected/7d16ac0c-fddc-4ea4-9f2f-0b485a109bef-kube-api-access-5f25f\") pod \"e2e-derive-bf9c0727-openshift-default-7fb479dd89-nkkk2\" (UID: \"7d16ac0c-fddc-4ea4-9f2f-0b485a109bef\") " pod="openshift-ingress/e2e-derive-bf9c0727-openshift-default-7fb479dd89-nkkk2"
Oct 30 21:05:42.321880 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:05:42.321666    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7d16ac0c-fddc-4ea4-9f2f-0b485a109bef-istiod-ca-cert\") pod \"e2e-derive-bf9c0727-openshift-default-7fb479dd89-nkkk2\" (UID: \"7d16ac0c-fddc-4ea4-9f2f-0b485a109bef\") " pod="openshift-ingress/e2e-derive-bf9c0727-openshift-default-7fb479dd89-nkkk2"
Oct 30 21:05:42.321880 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:05:42.321744    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7d16ac0c-fddc-4ea4-9f2f-0b485a109bef-istio-token\") pod \"e2e-derive-bf9c0727-openshift-default-7fb479dd89-nkkk2\" (UID: \"7d16ac0c-fddc-4ea4-9f2f-0b485a109bef\") " pod="openshift-ingress/e2e-derive-bf9c0727-openshift-default-7fb479dd89-nkkk2"
Oct 30 21:05:42.321880 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:05:42.321797    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7d16ac0c-fddc-4ea4-9f2f-0b485a109bef-credential-socket\") pod \"e2e-derive-bf9c0727-openshift-default-7fb479dd89-nkkk2\" (UID: \"7d16ac0c-fddc-4ea4-9f2f-0b485a109bef\") " pod="openshift-ingress/e2e-derive-bf9c0727-openshift-default-7fb479dd89-nkkk2"
Oct 30 21:05:42.321880 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:05:42.321823    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7d16ac0c-fddc-4ea4-9f2f-0b485a109bef-workload-socket\") pod \"e2e-derive-bf9c0727-openshift-default-7fb479dd89-nkkk2\" (UID: \"7d16ac0c-fddc-4ea4-9f2f-0b485a109bef\") " pod="openshift-ingress/e2e-derive-bf9c0727-openshift-default-7fb479dd89-nkkk2"
Oct 30 21:05:42.321880 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:05:42.321872    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7d16ac0c-fddc-4ea4-9f2f-0b485a109bef-workload-certs\") pod \"e2e-derive-bf9c0727-openshift-default-7fb479dd89-nkkk2\" (UID: \"7d16ac0c-fddc-4ea4-9f2f-0b485a109bef\") " pod="openshift-ingress/e2e-derive-bf9c0727-openshift-default-7fb479dd89-nkkk2"
Oct 30 21:05:42.322142 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:05:42.321945    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7d16ac0c-fddc-4ea4-9f2f-0b485a109bef-istio-data\") pod \"e2e-derive-bf9c0727-openshift-default-7fb479dd89-nkkk2\" (UID: \"7d16ac0c-fddc-4ea4-9f2f-0b485a109bef\") " pod="openshift-ingress/e2e-derive-bf9c0727-openshift-default-7fb479dd89-nkkk2"
Oct 30 21:05:42.322202 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:05:42.322174    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7d16ac0c-fddc-4ea4-9f2f-0b485a109bef-credential-socket\") pod \"e2e-derive-bf9c0727-openshift-default-7fb479dd89-nkkk2\" (UID: \"7d16ac0c-fddc-4ea4-9f2f-0b485a109bef\") " pod="openshift-ingress/e2e-derive-bf9c0727-openshift-default-7fb479dd89-nkkk2"
Oct 30 21:05:42.322321 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:05:42.322300    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7d16ac0c-fddc-4ea4-9f2f-0b485a109bef-workload-socket\") pod \"e2e-derive-bf9c0727-openshift-default-7fb479dd89-nkkk2\" (UID: \"7d16ac0c-fddc-4ea4-9f2f-0b485a109bef\") " pod="openshift-ingress/e2e-derive-bf9c0727-openshift-default-7fb479dd89-nkkk2"
Oct 30 21:05:42.322381 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:05:42.322309    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7d16ac0c-fddc-4ea4-9f2f-0b485a109bef-workload-certs\") pod \"e2e-derive-bf9c0727-openshift-default-7fb479dd89-nkkk2\" (UID: \"7d16ac0c-fddc-4ea4-9f2f-0b485a109bef\") " pod="openshift-ingress/e2e-derive-bf9c0727-openshift-default-7fb479dd89-nkkk2"
Oct 30 21:05:42.322572 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:05:42.322549    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7d16ac0c-fddc-4ea4-9f2f-0b485a109bef-istiod-ca-cert\") pod \"e2e-derive-bf9c0727-openshift-default-7fb479dd89-nkkk2\" (UID: \"7d16ac0c-fddc-4ea4-9f2f-0b485a109bef\") " pod="openshift-ingress/e2e-derive-bf9c0727-openshift-default-7fb479dd89-nkkk2"
Oct 30 21:05:42.324145 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:05:42.324118    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7d16ac0c-fddc-4ea4-9f2f-0b485a109bef-istio-envoy\") pod \"e2e-derive-bf9c0727-openshift-default-7fb479dd89-nkkk2\" (UID: \"7d16ac0c-fddc-4ea4-9f2f-0b485a109bef\") " pod="openshift-ingress/e2e-derive-bf9c0727-openshift-default-7fb479dd89-nkkk2"
Oct 30 21:05:42.324779 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:05:42.324759    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7d16ac0c-fddc-4ea4-9f2f-0b485a109bef-istio-podinfo\") pod \"e2e-derive-bf9c0727-openshift-default-7fb479dd89-nkkk2\" (UID: \"7d16ac0c-fddc-4ea4-9f2f-0b485a109bef\") " pod="openshift-ingress/e2e-derive-bf9c0727-openshift-default-7fb479dd89-nkkk2"
Oct 30 21:05:42.379801 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:05:42.379731    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7d16ac0c-fddc-4ea4-9f2f-0b485a109bef-istio-token\") pod \"e2e-derive-bf9c0727-openshift-default-7fb479dd89-nkkk2\" (UID: \"7d16ac0c-fddc-4ea4-9f2f-0b485a109bef\") " pod="openshift-ingress/e2e-derive-bf9c0727-openshift-default-7fb479dd89-nkkk2"
Oct 30 21:05:42.379956 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:05:42.379861    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5f25f\" (UniqueName: \"kubernetes.io/projected/7d16ac0c-fddc-4ea4-9f2f-0b485a109bef-kube-api-access-5f25f\") pod \"e2e-derive-bf9c0727-openshift-default-7fb479dd89-nkkk2\" (UID: \"7d16ac0c-fddc-4ea4-9f2f-0b485a109bef\") " pod="openshift-ingress/e2e-derive-bf9c0727-openshift-default-7fb479dd89-nkkk2"
Oct 30 21:05:42.402731 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:05:42.402694    6004 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-bf9c0727-openshift-default-7fb479dd89-nkkk2"
Oct 30 21:05:42.840977 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:05:42.840940    6004 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-bf9c0727-openshift-default-7fb479dd89-nkkk2"]
Oct 30 21:05:42.879832 ip-10-0-138-85 kubenswrapper[6004]: W1030 21:05:42.879751    6004 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7d16ac0c_fddc_4ea4_9f2f_0b485a109bef.slice/crio-50c916454fd1e057ebbb0b10c2f52987b7991387e7d85d0f711296e4662e1ea4 WatchSource:0}: Error finding container 50c916454fd1e057ebbb0b10c2f52987b7991387e7d85d0f711296e4662e1ea4: Status 404 returned error can't find the container with id 50c916454fd1e057ebbb0b10c2f52987b7991387e7d85d0f711296e4662e1ea4
Oct 30 21:05:42.882586 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:05:42.882552    6004 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 21:05:42.882704 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:05:42.882624    6004 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 21:05:42.882704 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:05:42.882654    6004 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 21:05:42.991533 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:05:42.991465    6004 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-bf9c0727-openshift-default-7fb479dd89-nkkk2" event={"ID":"7d16ac0c-fddc-4ea4-9f2f-0b485a109bef","Type":"ContainerStarted","Data":"94c0b8a64709c0ef933e0a22d1ebe7cb338734ad06fe83844dc58b9fdd7f05c1"}
Oct 30 21:05:42.991714 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:05:42.991563    6004 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-bf9c0727-openshift-default-7fb479dd89-nkkk2" event={"ID":"7d16ac0c-fddc-4ea4-9f2f-0b485a109bef","Type":"ContainerStarted","Data":"50c916454fd1e057ebbb0b10c2f52987b7991387e7d85d0f711296e4662e1ea4"}
Oct 30 21:05:43.112457 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:05:43.112344    6004 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-derive-bf9c0727-openshift-default-7fb479dd89-nkkk2" podStartSLOduration=1.112324468 podStartE2EDuration="1.112324468s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:05:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:05:43.108923304 +0000 UTC m=+1649.028709423" watchObservedRunningTime="2026-10-30 21:05:43.112324468 +0000 UTC m=+1649.032110591"
Oct 30 21:05:43.405528 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:05:43.404975    6004 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-bf9c0727-openshift-default-7fb479dd89-nkkk2"
Oct 30 21:05:43.405528 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:05:43.405133    6004 patch_prober.go:29] interesting pod/e2e-derive-bf9c0727-openshift-default-7fb479dd89-nkkk2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.95:15021/healthz/ready\": dial tcp 10.132.0.95:15021: connect: connection refused" start-of-body=
Oct 30 21:05:43.405528 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:05:43.405195    6004 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-bf9c0727-openshift-default-7fb479dd89-nkkk2" podUID="7d16ac0c-fddc-4ea4-9f2f-0b485a109bef" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.95:15021/healthz/ready\": dial tcp 10.132.0.95:15021: connect: connection refused"
Oct 30 21:05:44.298390 ip-10-0-138-85 kubenswrapper[6004]: E1030 21:05:44.298351    6004 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-zz4wr" containerName="extractor"
Oct 30 21:05:44.404085 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:05:44.404021    6004 patch_prober.go:29] interesting pod/e2e-derive-bf9c0727-openshift-default-7fb479dd89-nkkk2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.95:15021/healthz/ready\": dial tcp 10.132.0.95:15021: connect: connection refused" start-of-body=
Oct 30 21:05:44.404267 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:05:44.404112    6004 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-bf9c0727-openshift-default-7fb479dd89-nkkk2" podUID="7d16ac0c-fddc-4ea4-9f2f-0b485a109bef" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.95:15021/healthz/ready\": dial tcp 10.132.0.95:15021: connect: connection refused"
Oct 30 21:05:45.403665 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:05:45.403630    6004 patch_prober.go:29] interesting pod/e2e-derive-bf9c0727-openshift-default-7fb479dd89-nkkk2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.95:15021/healthz/ready\": dial tcp 10.132.0.95:15021: connect: connection refused" start-of-body=
Oct 30 21:05:45.404093 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:05:45.403679    6004 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-bf9c0727-openshift-default-7fb479dd89-nkkk2" podUID="7d16ac0c-fddc-4ea4-9f2f-0b485a109bef" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.95:15021/healthz/ready\": dial tcp 10.132.0.95:15021: connect: connection refused"
Oct 30 21:05:46.403351 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:05:46.403318    6004 patch_prober.go:29] interesting pod/e2e-derive-bf9c0727-openshift-default-7fb479dd89-nkkk2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.95:15021/healthz/ready\": dial tcp 10.132.0.95:15021: connect: connection refused" start-of-body=
Oct 30 21:05:46.403535 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:05:46.403374    6004 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-bf9c0727-openshift-default-7fb479dd89-nkkk2" podUID="7d16ac0c-fddc-4ea4-9f2f-0b485a109bef" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.95:15021/healthz/ready\": dial tcp 10.132.0.95:15021: connect: connection refused"
Oct 30 21:05:47.403330 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:05:47.403290    6004 patch_prober.go:29] interesting pod/e2e-derive-bf9c0727-openshift-default-7fb479dd89-nkkk2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.95:15021/healthz/ready\": dial tcp 10.132.0.95:15021: connect: connection refused" start-of-body=
Oct 30 21:05:47.403725 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:05:47.403350    6004 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-bf9c0727-openshift-default-7fb479dd89-nkkk2" podUID="7d16ac0c-fddc-4ea4-9f2f-0b485a109bef" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.95:15021/healthz/ready\": dial tcp 10.132.0.95:15021: connect: connection refused"
Oct 30 21:05:48.403753 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:05:48.403713    6004 patch_prober.go:29] interesting pod/e2e-derive-bf9c0727-openshift-default-7fb479dd89-nkkk2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.95:15021/healthz/ready\": dial tcp 10.132.0.95:15021: connect: connection refused" start-of-body=
Oct 30 21:05:48.404277 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:05:48.403774    6004 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-bf9c0727-openshift-default-7fb479dd89-nkkk2" podUID="7d16ac0c-fddc-4ea4-9f2f-0b485a109bef" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.95:15021/healthz/ready\": dial tcp 10.132.0.95:15021: connect: connection refused"
Oct 30 21:05:49.407979 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:05:49.407943    6004 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-bf9c0727-openshift-default-7fb479dd89-nkkk2"
Oct 30 21:05:49.408428 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:05:49.408246    6004 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-bf9c0727-openshift-default-7fb479dd89-nkkk2"
Oct 30 21:05:49.409083 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:05:49.409033    6004 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-bf9c0727-openshift-default-7fb479dd89-nkkk2"
Oct 30 21:06:14.287206 ip-10-0-138-85 kubenswrapper[6004]: E1030 21:06:14.287165    6004 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-zz4wr" containerName="extractor"
Oct 30 21:06:33.745921 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:06:33.745883    6004 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-bf9c0727-5ff4c44c4b-vvckc"]
Oct 30 21:06:33.746365 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:06:33.746165    6004 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-derive-bf9c0727-5ff4c44c4b-vvckc" podUID="bfc98489-f90d-4a7a-b85c-5d258cbed4c0" containerName="maas-api" containerID="cri-o://5fbefa319c4263398be79c52d1d5130e46e42411a9ebea8d833ea72fc4fe96af" gracePeriod=30
Oct 30 21:06:34.291078 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:06:34.290757    6004 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-bf9c0727-5ff4c44c4b-vvckc"
Oct 30 21:06:34.386075 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:06:34.385537    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/bfc98489-f90d-4a7a-b85c-5d258cbed4c0-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bfc98489-f90d-4a7a-b85c-5d258cbed4c0-openshift-service-ca\") pod \"bfc98489-f90d-4a7a-b85c-5d258cbed4c0\" (UID: \"bfc98489-f90d-4a7a-b85c-5d258cbed4c0\") "
Oct 30 21:06:34.386075 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:06:34.385657    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/bfc98489-f90d-4a7a-b85c-5d258cbed4c0-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bfc98489-f90d-4a7a-b85c-5d258cbed4c0-maas-api-tls\") pod \"bfc98489-f90d-4a7a-b85c-5d258cbed4c0\" (UID: \"bfc98489-f90d-4a7a-b85c-5d258cbed4c0\") "
Oct 30 21:06:34.386075 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:06:34.385940    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/bfc98489-f90d-4a7a-b85c-5d258cbed4c0-metrics-certs\" (UniqueName: \"kubernetes.io/secret/bfc98489-f90d-4a7a-b85c-5d258cbed4c0-metrics-certs\") pod \"bfc98489-f90d-4a7a-b85c-5d258cbed4c0\" (UID: \"bfc98489-f90d-4a7a-b85c-5d258cbed4c0\") "
Oct 30 21:06:34.386075 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:06:34.386003    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/bfc98489-f90d-4a7a-b85c-5d258cbed4c0-kube-api-access-4x8fw\" (UniqueName: \"kubernetes.io/projected/bfc98489-f90d-4a7a-b85c-5d258cbed4c0-kube-api-access-4x8fw\") pod \"bfc98489-f90d-4a7a-b85c-5d258cbed4c0\" (UID: \"bfc98489-f90d-4a7a-b85c-5d258cbed4c0\") "
Oct 30 21:06:34.403076 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:06:34.387576    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bfc98489-f90d-4a7a-b85c-5d258cbed4c0-openshift-service-ca" pod "bfc98489-f90d-4a7a-b85c-5d258cbed4c0" (UID: "bfc98489-f90d-4a7a-b85c-5d258cbed4c0"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:06:34.418284 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:06:34.414277    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bfc98489-f90d-4a7a-b85c-5d258cbed4c0-metrics-certs" pod "bfc98489-f90d-4a7a-b85c-5d258cbed4c0" (UID: "bfc98489-f90d-4a7a-b85c-5d258cbed4c0"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:06:34.435955 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:06:34.435896    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bfc98489-f90d-4a7a-b85c-5d258cbed4c0-maas-api-tls" pod "bfc98489-f90d-4a7a-b85c-5d258cbed4c0" (UID: "bfc98489-f90d-4a7a-b85c-5d258cbed4c0"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:06:34.435955 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:06:34.435933    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bfc98489-f90d-4a7a-b85c-5d258cbed4c0-kube-api-access-4x8fw" pod "bfc98489-f90d-4a7a-b85c-5d258cbed4c0" (UID: "bfc98489-f90d-4a7a-b85c-5d258cbed4c0"). InnerVolumeSpecName "kube-api-access-4x8fw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:06:34.488280 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:06:34.488236    6004 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bfc98489-f90d-4a7a-b85c-5d258cbed4c0-metrics-certs\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:06:34.488280 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:06:34.488280    6004 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4x8fw\" (UniqueName: \"kubernetes.io/projected/bfc98489-f90d-4a7a-b85c-5d258cbed4c0-kube-api-access-4x8fw\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:06:34.488547 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:06:34.488299    6004 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bfc98489-f90d-4a7a-b85c-5d258cbed4c0-openshift-service-ca\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:06:34.488547 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:06:34.488313    6004 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bfc98489-f90d-4a7a-b85c-5d258cbed4c0-maas-api-tls\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:06:34.672894 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:06:34.671373    6004 generic.go:356] "Generic (PLEG): container finished" podID="bfc98489-f90d-4a7a-b85c-5d258cbed4c0" containerID="5fbefa319c4263398be79c52d1d5130e46e42411a9ebea8d833ea72fc4fe96af" exitCode=0
Oct 30 21:06:34.672894 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:06:34.671716    6004 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-bf9c0727-5ff4c44c4b-vvckc" event={"ID":"bfc98489-f90d-4a7a-b85c-5d258cbed4c0","Type":"ContainerDied","Data":"5fbefa319c4263398be79c52d1d5130e46e42411a9ebea8d833ea72fc4fe96af"}
Oct 30 21:06:34.672894 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:06:34.671767    6004 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-bf9c0727-5ff4c44c4b-vvckc"
Oct 30 21:06:34.672894 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:06:34.671791    6004 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-bf9c0727-5ff4c44c4b-vvckc" event={"ID":"bfc98489-f90d-4a7a-b85c-5d258cbed4c0","Type":"ContainerDied","Data":"267642a6f801615f41455a578a69c6ca581406377463b759949f44348224465d"}
Oct 30 21:06:34.672894 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:06:34.671823    6004 scope.go:122] "RemoveContainer" containerID="5fbefa319c4263398be79c52d1d5130e46e42411a9ebea8d833ea72fc4fe96af"
Oct 30 21:06:34.693543 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:06:34.693522    6004 scope.go:122] "RemoveContainer" containerID="5fbefa319c4263398be79c52d1d5130e46e42411a9ebea8d833ea72fc4fe96af"
Oct 30 21:06:34.693934 ip-10-0-138-85 kubenswrapper[6004]: E1030 21:06:34.693910    6004 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5fbefa319c4263398be79c52d1d5130e46e42411a9ebea8d833ea72fc4fe96af\": container with ID starting with 5fbefa319c4263398be79c52d1d5130e46e42411a9ebea8d833ea72fc4fe96af not found: ID does not exist" containerID="5fbefa319c4263398be79c52d1d5130e46e42411a9ebea8d833ea72fc4fe96af"
Oct 30 21:06:34.694026 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:06:34.693946    6004 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5fbefa319c4263398be79c52d1d5130e46e42411a9ebea8d833ea72fc4fe96af"} err="failed to get container status \"5fbefa319c4263398be79c52d1d5130e46e42411a9ebea8d833ea72fc4fe96af\": rpc error: code = NotFound desc = could not find container \"5fbefa319c4263398be79c52d1d5130e46e42411a9ebea8d833ea72fc4fe96af\": container with ID starting with 5fbefa319c4263398be79c52d1d5130e46e42411a9ebea8d833ea72fc4fe96af not found: ID does not exist"
Oct 30 21:06:34.839559 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:06:34.839527    6004 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-bf9c0727-5ff4c44c4b-vvckc"]
Oct 30 21:06:34.889994 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:06:34.889964    6004 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-bf9c0727-5ff4c44c4b-vvckc"]
Oct 30 21:06:36.235084 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:06:36.234933    6004 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="bfc98489-f90d-4a7a-b85c-5d258cbed4c0" path="/var/lib/kubelet/pods/bfc98489-f90d-4a7a-b85c-5d258cbed4c0/volumes"
Oct 30 21:06:37.604719 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:06:37.604692    6004 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-bf9c0727-openshift-default-7fb479dd89-f7bw8"]
Oct 30 21:06:37.605657 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:06:37.605344    6004 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-derive-bf9c0727-openshift-default-7fb479dd89-f7bw8" podUID="20463dad-83a0-4ba2-9de8-824d5e46bdec" containerName="istio-proxy" containerID="cri-o://580794f81ed2655b3d30828e14cd4643a5bc457b6ef411fa06d4a212acdc4ea1" gracePeriod=30
Oct 30 21:06:37.610224 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:06:37.610200    6004 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-bf9c0727-openshift-default-7fb479dd89-nkkk2"]
Oct 30 21:06:37.610700 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:06:37.610413    6004 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-derive-bf9c0727-openshift-default-7fb479dd89-nkkk2" podUID="7d16ac0c-fddc-4ea4-9f2f-0b485a109bef" containerName="istio-proxy" containerID="cri-o://94c0b8a64709c0ef933e0a22d1ebe7cb338734ad06fe83844dc58b9fdd7f05c1" gracePeriod=30
Oct 30 21:06:42.762655 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:06:42.762468    6004 generic.go:356] "Generic (PLEG): container finished" podID="20463dad-83a0-4ba2-9de8-824d5e46bdec" containerID="580794f81ed2655b3d30828e14cd4643a5bc457b6ef411fa06d4a212acdc4ea1" exitCode=0
Oct 30 21:06:42.762655 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:06:42.762581    6004 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-bf9c0727-openshift-default-7fb479dd89-f7bw8" event={"ID":"20463dad-83a0-4ba2-9de8-824d5e46bdec","Type":"ContainerDied","Data":"580794f81ed2655b3d30828e14cd4643a5bc457b6ef411fa06d4a212acdc4ea1"}
Oct 30 21:06:42.765191 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:06:42.765163    6004 generic.go:356] "Generic (PLEG): container finished" podID="7d16ac0c-fddc-4ea4-9f2f-0b485a109bef" containerID="94c0b8a64709c0ef933e0a22d1ebe7cb338734ad06fe83844dc58b9fdd7f05c1" exitCode=0
Oct 30 21:06:42.765367 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:06:42.765351    6004 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-bf9c0727-openshift-default-7fb479dd89-nkkk2" event={"ID":"7d16ac0c-fddc-4ea4-9f2f-0b485a109bef","Type":"ContainerDied","Data":"94c0b8a64709c0ef933e0a22d1ebe7cb338734ad06fe83844dc58b9fdd7f05c1"}
Oct 30 21:06:43.081635 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:06:43.076270    6004 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-bf9c0727-openshift-default-7fb479dd89-nkkk2"
Oct 30 21:06:43.156172 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:06:43.138774    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/7d16ac0c-fddc-4ea4-9f2f-0b485a109bef-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7d16ac0c-fddc-4ea4-9f2f-0b485a109bef-credential-socket\") pod \"7d16ac0c-fddc-4ea4-9f2f-0b485a109bef\" (UID: \"7d16ac0c-fddc-4ea4-9f2f-0b485a109bef\") "
Oct 30 21:06:43.156172 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:06:43.138865    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/7d16ac0c-fddc-4ea4-9f2f-0b485a109bef-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7d16ac0c-fddc-4ea4-9f2f-0b485a109bef-istio-envoy\") pod \"7d16ac0c-fddc-4ea4-9f2f-0b485a109bef\" (UID: \"7d16ac0c-fddc-4ea4-9f2f-0b485a109bef\") "
Oct 30 21:06:43.156172 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:06:43.138897    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/7d16ac0c-fddc-4ea4-9f2f-0b485a109bef-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7d16ac0c-fddc-4ea4-9f2f-0b485a109bef-istiod-ca-cert\") pod \"7d16ac0c-fddc-4ea4-9f2f-0b485a109bef\" (UID: \"7d16ac0c-fddc-4ea4-9f2f-0b485a109bef\") "
Oct 30 21:06:43.157224 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:06:43.157160    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7d16ac0c-fddc-4ea4-9f2f-0b485a109bef-workload-socket" pod "7d16ac0c-fddc-4ea4-9f2f-0b485a109bef" (UID: "7d16ac0c-fddc-4ea4-9f2f-0b485a109bef"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:06:43.157633 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:06:43.157593    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7d16ac0c-fddc-4ea4-9f2f-0b485a109bef-credential-socket" pod "7d16ac0c-fddc-4ea4-9f2f-0b485a109bef" (UID: "7d16ac0c-fddc-4ea4-9f2f-0b485a109bef"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:06:43.157930 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:06:43.157907    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7d16ac0c-fddc-4ea4-9f2f-0b485a109bef-istiod-ca-cert" pod "7d16ac0c-fddc-4ea4-9f2f-0b485a109bef" (UID: "7d16ac0c-fddc-4ea4-9f2f-0b485a109bef"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:06:43.158166 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:06:43.139044    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/7d16ac0c-fddc-4ea4-9f2f-0b485a109bef-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7d16ac0c-fddc-4ea4-9f2f-0b485a109bef-workload-socket\") pod \"7d16ac0c-fddc-4ea4-9f2f-0b485a109bef\" (UID: \"7d16ac0c-fddc-4ea4-9f2f-0b485a109bef\") "
Oct 30 21:06:43.158340 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:06:43.158324    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/7d16ac0c-fddc-4ea4-9f2f-0b485a109bef-istio-token\" (UniqueName: \"kubernetes.io/projected/7d16ac0c-fddc-4ea4-9f2f-0b485a109bef-istio-token\") pod \"7d16ac0c-fddc-4ea4-9f2f-0b485a109bef\" (UID: \"7d16ac0c-fddc-4ea4-9f2f-0b485a109bef\") "
Oct 30 21:06:43.162520 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:06:43.162498    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/7d16ac0c-fddc-4ea4-9f2f-0b485a109bef-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7d16ac0c-fddc-4ea4-9f2f-0b485a109bef-istio-podinfo\") pod \"7d16ac0c-fddc-4ea4-9f2f-0b485a109bef\" (UID: \"7d16ac0c-fddc-4ea4-9f2f-0b485a109bef\") "
Oct 30 21:06:43.163031 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:06:43.163010    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/7d16ac0c-fddc-4ea4-9f2f-0b485a109bef-kube-api-access-5f25f\" (UniqueName: \"kubernetes.io/projected/7d16ac0c-fddc-4ea4-9f2f-0b485a109bef-kube-api-access-5f25f\") pod \"7d16ac0c-fddc-4ea4-9f2f-0b485a109bef\" (UID: \"7d16ac0c-fddc-4ea4-9f2f-0b485a109bef\") "
Oct 30 21:06:43.163515 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:06:43.163497    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/7d16ac0c-fddc-4ea4-9f2f-0b485a109bef-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7d16ac0c-fddc-4ea4-9f2f-0b485a109bef-istio-data\") pod \"7d16ac0c-fddc-4ea4-9f2f-0b485a109bef\" (UID: \"7d16ac0c-fddc-4ea4-9f2f-0b485a109bef\") "
Oct 30 21:06:43.165341 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:06:43.165225    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7d16ac0c-fddc-4ea4-9f2f-0b485a109bef-istio-data" pod "7d16ac0c-fddc-4ea4-9f2f-0b485a109bef" (UID: "7d16ac0c-fddc-4ea4-9f2f-0b485a109bef"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:06:43.165569 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:06:43.165553    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/7d16ac0c-fddc-4ea4-9f2f-0b485a109bef-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7d16ac0c-fddc-4ea4-9f2f-0b485a109bef-workload-certs\") pod \"7d16ac0c-fddc-4ea4-9f2f-0b485a109bef\" (UID: \"7d16ac0c-fddc-4ea4-9f2f-0b485a109bef\") "
Oct 30 21:06:43.170401 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:06:43.169127    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7d16ac0c-fddc-4ea4-9f2f-0b485a109bef-workload-certs" pod "7d16ac0c-fddc-4ea4-9f2f-0b485a109bef" (UID: "7d16ac0c-fddc-4ea4-9f2f-0b485a109bef"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:06:43.173854 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:06:43.173829    6004 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7d16ac0c-fddc-4ea4-9f2f-0b485a109bef-workload-certs\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:06:43.244124 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:06:43.226018    6004 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7d16ac0c-fddc-4ea4-9f2f-0b485a109bef-credential-socket\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:06:43.244124 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:06:43.226078    6004 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7d16ac0c-fddc-4ea4-9f2f-0b485a109bef-istiod-ca-cert\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:06:43.244124 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:06:43.226094    6004 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7d16ac0c-fddc-4ea4-9f2f-0b485a109bef-workload-socket\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:06:43.244124 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:06:43.226108    6004 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7d16ac0c-fddc-4ea4-9f2f-0b485a109bef-istio-data\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:06:43.244124 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:06:43.233538    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7d16ac0c-fddc-4ea4-9f2f-0b485a109bef-istio-envoy" pod "7d16ac0c-fddc-4ea4-9f2f-0b485a109bef" (UID: "7d16ac0c-fddc-4ea4-9f2f-0b485a109bef"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:06:43.250945 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:06:43.250904    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7d16ac0c-fddc-4ea4-9f2f-0b485a109bef-kube-api-access-5f25f" pod "7d16ac0c-fddc-4ea4-9f2f-0b485a109bef" (UID: "7d16ac0c-fddc-4ea4-9f2f-0b485a109bef"). InnerVolumeSpecName "kube-api-access-5f25f". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:06:43.251110 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:06:43.250980    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/7d16ac0c-fddc-4ea4-9f2f-0b485a109bef-istio-podinfo" pod "7d16ac0c-fddc-4ea4-9f2f-0b485a109bef" (UID: "7d16ac0c-fddc-4ea4-9f2f-0b485a109bef"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 21:06:43.251110 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:06:43.251015    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7d16ac0c-fddc-4ea4-9f2f-0b485a109bef-istio-token" pod "7d16ac0c-fddc-4ea4-9f2f-0b485a109bef" (UID: "7d16ac0c-fddc-4ea4-9f2f-0b485a109bef"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:06:43.263696 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:06:43.263659    6004 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-bf9c0727-openshift-default-7fb479dd89-f7bw8"
Oct 30 21:06:43.328879 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:06:43.328832    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/20463dad-83a0-4ba2-9de8-824d5e46bdec-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/20463dad-83a0-4ba2-9de8-824d5e46bdec-credential-socket\") pod \"20463dad-83a0-4ba2-9de8-824d5e46bdec\" (UID: \"20463dad-83a0-4ba2-9de8-824d5e46bdec\") "
Oct 30 21:06:43.331842 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:06:43.331702    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/20463dad-83a0-4ba2-9de8-824d5e46bdec-credential-socket" pod "20463dad-83a0-4ba2-9de8-824d5e46bdec" (UID: "20463dad-83a0-4ba2-9de8-824d5e46bdec"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:06:43.332376 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:06:43.332342    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/20463dad-83a0-4ba2-9de8-824d5e46bdec-workload-socket" pod "20463dad-83a0-4ba2-9de8-824d5e46bdec" (UID: "20463dad-83a0-4ba2-9de8-824d5e46bdec"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:06:43.332516 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:06:43.332499    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/20463dad-83a0-4ba2-9de8-824d5e46bdec-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/20463dad-83a0-4ba2-9de8-824d5e46bdec-workload-socket\") pod \"20463dad-83a0-4ba2-9de8-824d5e46bdec\" (UID: \"20463dad-83a0-4ba2-9de8-824d5e46bdec\") "
Oct 30 21:06:43.332654 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:06:43.332640    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/20463dad-83a0-4ba2-9de8-824d5e46bdec-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/20463dad-83a0-4ba2-9de8-824d5e46bdec-istio-data\") pod \"20463dad-83a0-4ba2-9de8-824d5e46bdec\" (UID: \"20463dad-83a0-4ba2-9de8-824d5e46bdec\") "
Oct 30 21:06:43.333040 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:06:43.332929    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/20463dad-83a0-4ba2-9de8-824d5e46bdec-istio-data" pod "20463dad-83a0-4ba2-9de8-824d5e46bdec" (UID: "20463dad-83a0-4ba2-9de8-824d5e46bdec"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:06:43.333231 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:06:43.333215    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/20463dad-83a0-4ba2-9de8-824d5e46bdec-istio-token\" (UniqueName: \"kubernetes.io/projected/20463dad-83a0-4ba2-9de8-824d5e46bdec-istio-token\") pod \"20463dad-83a0-4ba2-9de8-824d5e46bdec\" (UID: \"20463dad-83a0-4ba2-9de8-824d5e46bdec\") "
Oct 30 21:06:43.333743 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:06:43.333725    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/20463dad-83a0-4ba2-9de8-824d5e46bdec-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/20463dad-83a0-4ba2-9de8-824d5e46bdec-workload-certs\") pod \"20463dad-83a0-4ba2-9de8-824d5e46bdec\" (UID: \"20463dad-83a0-4ba2-9de8-824d5e46bdec\") "
Oct 30 21:06:43.334212 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:06:43.334089    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/20463dad-83a0-4ba2-9de8-824d5e46bdec-workload-certs" pod "20463dad-83a0-4ba2-9de8-824d5e46bdec" (UID: "20463dad-83a0-4ba2-9de8-824d5e46bdec"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:06:43.383892 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:06:43.367206    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/20463dad-83a0-4ba2-9de8-824d5e46bdec-kube-api-access-mtprl\" (UniqueName: \"kubernetes.io/projected/20463dad-83a0-4ba2-9de8-824d5e46bdec-kube-api-access-mtprl\") pod \"20463dad-83a0-4ba2-9de8-824d5e46bdec\" (UID: \"20463dad-83a0-4ba2-9de8-824d5e46bdec\") "
Oct 30 21:06:43.383892 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:06:43.367394    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/20463dad-83a0-4ba2-9de8-824d5e46bdec-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/20463dad-83a0-4ba2-9de8-824d5e46bdec-istio-envoy\") pod \"20463dad-83a0-4ba2-9de8-824d5e46bdec\" (UID: \"20463dad-83a0-4ba2-9de8-824d5e46bdec\") "
Oct 30 21:06:43.383892 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:06:43.367469    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/20463dad-83a0-4ba2-9de8-824d5e46bdec-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/20463dad-83a0-4ba2-9de8-824d5e46bdec-istio-podinfo\") pod \"20463dad-83a0-4ba2-9de8-824d5e46bdec\" (UID: \"20463dad-83a0-4ba2-9de8-824d5e46bdec\") "
Oct 30 21:06:43.383892 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:06:43.367523    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/20463dad-83a0-4ba2-9de8-824d5e46bdec-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/20463dad-83a0-4ba2-9de8-824d5e46bdec-istiod-ca-cert\") pod \"20463dad-83a0-4ba2-9de8-824d5e46bdec\" (UID: \"20463dad-83a0-4ba2-9de8-824d5e46bdec\") "
Oct 30 21:06:43.383892 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:06:43.368446    6004 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/20463dad-83a0-4ba2-9de8-824d5e46bdec-credential-socket\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:06:43.383892 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:06:43.368473    6004 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7d16ac0c-fddc-4ea4-9f2f-0b485a109bef-istio-token\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:06:43.383892 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:06:43.368507    6004 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/20463dad-83a0-4ba2-9de8-824d5e46bdec-workload-socket\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:06:43.383892 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:06:43.368525    6004 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/20463dad-83a0-4ba2-9de8-824d5e46bdec-istio-data\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:06:43.383892 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:06:43.368539    6004 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7d16ac0c-fddc-4ea4-9f2f-0b485a109bef-istio-podinfo\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:06:43.383892 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:06:43.368554    6004 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5f25f\" (UniqueName: \"kubernetes.io/projected/7d16ac0c-fddc-4ea4-9f2f-0b485a109bef-kube-api-access-5f25f\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:06:43.383892 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:06:43.368569    6004 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/20463dad-83a0-4ba2-9de8-824d5e46bdec-workload-certs\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:06:43.383892 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:06:43.368585    6004 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7d16ac0c-fddc-4ea4-9f2f-0b485a109bef-istio-envoy\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:06:43.383892 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:06:43.383845    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/20463dad-83a0-4ba2-9de8-824d5e46bdec-istiod-ca-cert" pod "20463dad-83a0-4ba2-9de8-824d5e46bdec" (UID: "20463dad-83a0-4ba2-9de8-824d5e46bdec"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:06:43.471879 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:06:43.471844    6004 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/20463dad-83a0-4ba2-9de8-824d5e46bdec-istiod-ca-cert\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:06:43.506624 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:06:43.506540    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/20463dad-83a0-4ba2-9de8-824d5e46bdec-istio-token" pod "20463dad-83a0-4ba2-9de8-824d5e46bdec" (UID: "20463dad-83a0-4ba2-9de8-824d5e46bdec"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:06:43.507572 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:06:43.507531    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/20463dad-83a0-4ba2-9de8-824d5e46bdec-istio-envoy" pod "20463dad-83a0-4ba2-9de8-824d5e46bdec" (UID: "20463dad-83a0-4ba2-9de8-824d5e46bdec"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:06:43.510219 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:06:43.510167    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/20463dad-83a0-4ba2-9de8-824d5e46bdec-istio-podinfo" pod "20463dad-83a0-4ba2-9de8-824d5e46bdec" (UID: "20463dad-83a0-4ba2-9de8-824d5e46bdec"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 21:06:43.510539 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:06:43.510496    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/20463dad-83a0-4ba2-9de8-824d5e46bdec-kube-api-access-mtprl" pod "20463dad-83a0-4ba2-9de8-824d5e46bdec" (UID: "20463dad-83a0-4ba2-9de8-824d5e46bdec"). InnerVolumeSpecName "kube-api-access-mtprl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:06:43.574072 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:06:43.574022    6004 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/20463dad-83a0-4ba2-9de8-824d5e46bdec-istio-envoy\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:06:43.574072 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:06:43.574074    6004 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/20463dad-83a0-4ba2-9de8-824d5e46bdec-istio-podinfo\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:06:43.574327 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:06:43.574091    6004 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/20463dad-83a0-4ba2-9de8-824d5e46bdec-istio-token\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:06:43.574327 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:06:43.574106    6004 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mtprl\" (UniqueName: \"kubernetes.io/projected/20463dad-83a0-4ba2-9de8-824d5e46bdec-kube-api-access-mtprl\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:06:43.774115 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:06:43.773990    6004 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-bf9c0727-openshift-default-7fb479dd89-f7bw8"
Oct 30 21:06:43.774115 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:06:43.774011    6004 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-bf9c0727-openshift-default-7fb479dd89-f7bw8" event={"ID":"20463dad-83a0-4ba2-9de8-824d5e46bdec","Type":"ContainerDied","Data":"ac8870eaf14762da77bd5bd80078484424f73f66bfc810993750aa59d21e485f"}
Oct 30 21:06:43.774655 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:06:43.774126    6004 scope.go:122] "RemoveContainer" containerID="580794f81ed2655b3d30828e14cd4643a5bc457b6ef411fa06d4a212acdc4ea1"
Oct 30 21:06:43.775776 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:06:43.775750    6004 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-bf9c0727-openshift-default-7fb479dd89-nkkk2" event={"ID":"7d16ac0c-fddc-4ea4-9f2f-0b485a109bef","Type":"ContainerDied","Data":"50c916454fd1e057ebbb0b10c2f52987b7991387e7d85d0f711296e4662e1ea4"}
Oct 30 21:06:43.775922 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:06:43.775849    6004 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-bf9c0727-openshift-default-7fb479dd89-nkkk2"
Oct 30 21:06:43.787689 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:06:43.787661    6004 scope.go:122] "RemoveContainer" containerID="94c0b8a64709c0ef933e0a22d1ebe7cb338734ad06fe83844dc58b9fdd7f05c1"
Oct 30 21:06:43.941469 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:06:43.941435    6004 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-bf9c0727-openshift-default-7fb479dd89-nkkk2"]
Oct 30 21:06:43.947513 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:06:43.947487    6004 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-derive-bf9c0727-openshift-default-7fb479dd89-nkkk2"]
Oct 30 21:06:44.058774 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:06:44.058635    6004 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-bf9c0727-openshift-default-7fb479dd89-f7bw8"]
Oct 30 21:06:44.063062 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:06:44.063019    6004 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-derive-bf9c0727-openshift-default-7fb479dd89-f7bw8"]
Oct 30 21:06:44.236967 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:06:44.236934    6004 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="20463dad-83a0-4ba2-9de8-824d5e46bdec" path="/var/lib/kubelet/pods/20463dad-83a0-4ba2-9de8-824d5e46bdec/volumes"
Oct 30 21:06:44.237509 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:06:44.237489    6004 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="7d16ac0c-fddc-4ea4-9f2f-0b485a109bef" path="/var/lib/kubelet/pods/7d16ac0c-fddc-4ea4-9f2f-0b485a109bef/volumes"
Oct 30 21:06:44.296183 ip-10-0-138-85 kubenswrapper[6004]: E1030 21:06:44.296122    6004 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-zz4wr" containerName="extractor"
Oct 30 21:07:14.288464 ip-10-0-138-85 kubenswrapper[6004]: E1030 21:07:14.288419    6004 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-zz4wr" containerName="extractor"
Oct 30 21:07:35.086605 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:07:35.086567    6004 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w4-1fdaa7-openshift-default-84586db7d5-46jqd"]
Oct 30 21:07:35.087191 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:07:35.086760    6004 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w4-1fdaa7-openshift-default-84586db7d5-46jqd" podUID="4f353b43-913f-4043-bac3-50b745209bf2" containerName="istio-proxy" containerID="cri-o://cf3448e334adddf7d3aa20cee5f1c6cc044d1c9a52ed324dd015bffc0a00b4a9" gracePeriod=30
Oct 30 21:07:35.137344 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:07:35.136888    6004 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w4-1fdaa7-openshift-default-84586db7d5-gt5hd"]
Oct 30 21:07:35.137344 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:07:35.137160    6004 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w4-1fdaa7-openshift-default-84586db7d5-gt5hd" podUID="21525b82-87c7-4c9e-91fc-6070f3973861" containerName="istio-proxy" containerID="cri-o://0d48ae75b253bef0001280b4808a7399171e1a43a3ac0e09c725ac34fffdb652" gracePeriod=30
Oct 30 21:07:35.140516 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:07:35.140488    6004 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w4-1fdaa7-openshift-default-84586db7d5-vf7tj"]
Oct 30 21:07:35.140760 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:07:35.140713    6004 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w4-1fdaa7-openshift-default-84586db7d5-vf7tj" podUID="4b9cc2c7-4e42-4ab3-90a8-5fda80c79f2f" containerName="istio-proxy" containerID="cri-o://0c0498ab75bea1b822fe80050b889299b3b474a7e5c4d362f2e99a6bedd5655a" gracePeriod=30
Oct 30 21:07:35.189674 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:07:35.189636    6004 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w2-d061d0-openshift-default-86b87f495-rwjhc"]
Oct 30 21:07:35.189894 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:07:35.189864    6004 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w2-d061d0-openshift-default-86b87f495-rwjhc" podUID="60c708c3-7aec-4c49-bbe2-dfacf5f1895a" containerName="istio-proxy" containerID="cri-o://54e98ba3626de69388f6b92c5d278ede213c4496bf69b5fc798adb3e7247a31e" gracePeriod=30
Oct 30 21:07:35.194774 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:07:35.194744    6004 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w2-d061d0-openshift-default-86b87f495-d8j6q"]
Oct 30 21:07:35.195000 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:07:35.194976    6004 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w2-d061d0-openshift-default-86b87f495-d8j6q" podUID="54f45743-f6cf-4d8b-b3a5-e1064334eebc" containerName="istio-proxy" containerID="cri-o://d14fecce2a74e1a19a298a9521a85723ec961a4c917fa4ca9a17a419eb39d653" gracePeriod=30
Oct 30 21:07:40.380551 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:07:40.380237    6004 generic.go:356] "Generic (PLEG): container finished" podID="21525b82-87c7-4c9e-91fc-6070f3973861" containerID="0d48ae75b253bef0001280b4808a7399171e1a43a3ac0e09c725ac34fffdb652" exitCode=0
Oct 30 21:07:40.380551 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:07:40.380454    6004 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-1fdaa7-openshift-default-84586db7d5-gt5hd" event={"ID":"21525b82-87c7-4c9e-91fc-6070f3973861","Type":"ContainerDied","Data":"0d48ae75b253bef0001280b4808a7399171e1a43a3ac0e09c725ac34fffdb652"}
Oct 30 21:07:40.505491 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:07:40.504838    6004 generic.go:356] "Generic (PLEG): container finished" podID="60c708c3-7aec-4c49-bbe2-dfacf5f1895a" containerID="54e98ba3626de69388f6b92c5d278ede213c4496bf69b5fc798adb3e7247a31e" exitCode=0
Oct 30 21:07:40.505491 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:07:40.504976    6004 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-d061d0-openshift-default-86b87f495-rwjhc" event={"ID":"60c708c3-7aec-4c49-bbe2-dfacf5f1895a","Type":"ContainerDied","Data":"54e98ba3626de69388f6b92c5d278ede213c4496bf69b5fc798adb3e7247a31e"}
Oct 30 21:07:40.559186 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:07:40.549219    6004 generic.go:356] "Generic (PLEG): container finished" podID="54f45743-f6cf-4d8b-b3a5-e1064334eebc" containerID="d14fecce2a74e1a19a298a9521a85723ec961a4c917fa4ca9a17a419eb39d653" exitCode=0
Oct 30 21:07:40.559186 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:07:40.549323    6004 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-d061d0-openshift-default-86b87f495-d8j6q" event={"ID":"54f45743-f6cf-4d8b-b3a5-e1064334eebc","Type":"ContainerDied","Data":"d14fecce2a74e1a19a298a9521a85723ec961a4c917fa4ca9a17a419eb39d653"}
Oct 30 21:07:40.559186 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:07:40.557941    6004 generic.go:356] "Generic (PLEG): container finished" podID="4b9cc2c7-4e42-4ab3-90a8-5fda80c79f2f" containerID="0c0498ab75bea1b822fe80050b889299b3b474a7e5c4d362f2e99a6bedd5655a" exitCode=0
Oct 30 21:07:40.559186 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:07:40.558033    6004 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-1fdaa7-openshift-default-84586db7d5-vf7tj" event={"ID":"4b9cc2c7-4e42-4ab3-90a8-5fda80c79f2f","Type":"ContainerDied","Data":"0c0498ab75bea1b822fe80050b889299b3b474a7e5c4d362f2e99a6bedd5655a"}
Oct 30 21:07:40.561562 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:07:40.561413    6004 generic.go:356] "Generic (PLEG): container finished" podID="4f353b43-913f-4043-bac3-50b745209bf2" containerID="cf3448e334adddf7d3aa20cee5f1c6cc044d1c9a52ed324dd015bffc0a00b4a9" exitCode=0
Oct 30 21:07:40.561562 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:07:40.561497    6004 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-1fdaa7-openshift-default-84586db7d5-46jqd" event={"ID":"4f353b43-913f-4043-bac3-50b745209bf2","Type":"ContainerDied","Data":"cf3448e334adddf7d3aa20cee5f1c6cc044d1c9a52ed324dd015bffc0a00b4a9"}
Oct 30 21:07:40.865175 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:07:40.863747    6004 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-1fdaa7-openshift-default-84586db7d5-46jqd"
Oct 30 21:07:40.927012 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:07:40.926979    6004 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-d061d0-openshift-default-86b87f495-rwjhc"
Oct 30 21:07:40.974258 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:07:40.974177    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/4f353b43-913f-4043-bac3-50b745209bf2-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4f353b43-913f-4043-bac3-50b745209bf2-workload-certs\") pod \"4f353b43-913f-4043-bac3-50b745209bf2\" (UID: \"4f353b43-913f-4043-bac3-50b745209bf2\") "
Oct 30 21:07:40.974258 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:07:40.974227    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/4f353b43-913f-4043-bac3-50b745209bf2-istio-token\" (UniqueName: \"kubernetes.io/projected/4f353b43-913f-4043-bac3-50b745209bf2-istio-token\") pod \"4f353b43-913f-4043-bac3-50b745209bf2\" (UID: \"4f353b43-913f-4043-bac3-50b745209bf2\") "
Oct 30 21:07:40.974466 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:07:40.974291    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/4f353b43-913f-4043-bac3-50b745209bf2-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4f353b43-913f-4043-bac3-50b745209bf2-istio-envoy\") pod \"4f353b43-913f-4043-bac3-50b745209bf2\" (UID: \"4f353b43-913f-4043-bac3-50b745209bf2\") "
Oct 30 21:07:40.974466 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:07:40.974363    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/4f353b43-913f-4043-bac3-50b745209bf2-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4f353b43-913f-4043-bac3-50b745209bf2-istio-data\") pod \"4f353b43-913f-4043-bac3-50b745209bf2\" (UID: \"4f353b43-913f-4043-bac3-50b745209bf2\") "
Oct 30 21:07:40.974570 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:07:40.974535    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/4f353b43-913f-4043-bac3-50b745209bf2-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4f353b43-913f-4043-bac3-50b745209bf2-istiod-ca-cert\") pod \"4f353b43-913f-4043-bac3-50b745209bf2\" (UID: \"4f353b43-913f-4043-bac3-50b745209bf2\") "
Oct 30 21:07:40.974623 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:07:40.974595    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/4f353b43-913f-4043-bac3-50b745209bf2-kube-api-access-cs8kl\" (UniqueName: \"kubernetes.io/projected/4f353b43-913f-4043-bac3-50b745209bf2-kube-api-access-cs8kl\") pod \"4f353b43-913f-4043-bac3-50b745209bf2\" (UID: \"4f353b43-913f-4043-bac3-50b745209bf2\") "
Oct 30 21:07:40.974676 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:07:40.974661    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/4f353b43-913f-4043-bac3-50b745209bf2-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4f353b43-913f-4043-bac3-50b745209bf2-istio-podinfo\") pod \"4f353b43-913f-4043-bac3-50b745209bf2\" (UID: \"4f353b43-913f-4043-bac3-50b745209bf2\") "
Oct 30 21:07:40.974796 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:07:40.974777    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/4f353b43-913f-4043-bac3-50b745209bf2-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4f353b43-913f-4043-bac3-50b745209bf2-workload-socket\") pod \"4f353b43-913f-4043-bac3-50b745209bf2\" (UID: \"4f353b43-913f-4043-bac3-50b745209bf2\") "
Oct 30 21:07:40.974861 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:07:40.974827    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/4f353b43-913f-4043-bac3-50b745209bf2-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4f353b43-913f-4043-bac3-50b745209bf2-credential-socket\") pod \"4f353b43-913f-4043-bac3-50b745209bf2\" (UID: \"4f353b43-913f-4043-bac3-50b745209bf2\") "
Oct 30 21:07:40.976083 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:07:40.976037    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4f353b43-913f-4043-bac3-50b745209bf2-workload-certs" pod "4f353b43-913f-4043-bac3-50b745209bf2" (UID: "4f353b43-913f-4043-bac3-50b745209bf2"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:07:40.979718 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:07:40.979690    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4f353b43-913f-4043-bac3-50b745209bf2-istio-token" pod "4f353b43-913f-4043-bac3-50b745209bf2" (UID: "4f353b43-913f-4043-bac3-50b745209bf2"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:07:40.980200 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:07:40.980174    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4f353b43-913f-4043-bac3-50b745209bf2-istio-data" pod "4f353b43-913f-4043-bac3-50b745209bf2" (UID: "4f353b43-913f-4043-bac3-50b745209bf2"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:07:40.980342 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:07:40.980318    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4f353b43-913f-4043-bac3-50b745209bf2-credential-socket" pod "4f353b43-913f-4043-bac3-50b745209bf2" (UID: "4f353b43-913f-4043-bac3-50b745209bf2"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:07:40.980467 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:07:40.980448    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4f353b43-913f-4043-bac3-50b745209bf2-workload-socket" pod "4f353b43-913f-4043-bac3-50b745209bf2" (UID: "4f353b43-913f-4043-bac3-50b745209bf2"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:07:40.980792 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:07:40.980772    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4f353b43-913f-4043-bac3-50b745209bf2-istiod-ca-cert" pod "4f353b43-913f-4043-bac3-50b745209bf2" (UID: "4f353b43-913f-4043-bac3-50b745209bf2"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:07:40.983092 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:07:40.983028    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/4f353b43-913f-4043-bac3-50b745209bf2-istio-podinfo" pod "4f353b43-913f-4043-bac3-50b745209bf2" (UID: "4f353b43-913f-4043-bac3-50b745209bf2"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 21:07:40.999475 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:07:40.999353    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4f353b43-913f-4043-bac3-50b745209bf2-kube-api-access-cs8kl" pod "4f353b43-913f-4043-bac3-50b745209bf2" (UID: "4f353b43-913f-4043-bac3-50b745209bf2"). InnerVolumeSpecName "kube-api-access-cs8kl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:07:41.013224 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:07:41.013177    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4f353b43-913f-4043-bac3-50b745209bf2-istio-envoy" pod "4f353b43-913f-4043-bac3-50b745209bf2" (UID: "4f353b43-913f-4043-bac3-50b745209bf2"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:07:41.026992 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:07:41.026968    6004 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-1fdaa7-openshift-default-84586db7d5-vf7tj"
Oct 30 21:07:41.065349 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:07:41.065315    6004 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-1fdaa7-openshift-default-84586db7d5-gt5hd"
Oct 30 21:07:41.076936 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:07:41.076907    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/60c708c3-7aec-4c49-bbe2-dfacf5f1895a-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/60c708c3-7aec-4c49-bbe2-dfacf5f1895a-istiod-ca-cert\") pod \"60c708c3-7aec-4c49-bbe2-dfacf5f1895a\" (UID: \"60c708c3-7aec-4c49-bbe2-dfacf5f1895a\") "
Oct 30 21:07:41.077112 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:07:41.076984    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/60c708c3-7aec-4c49-bbe2-dfacf5f1895a-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/60c708c3-7aec-4c49-bbe2-dfacf5f1895a-istio-data\") pod \"60c708c3-7aec-4c49-bbe2-dfacf5f1895a\" (UID: \"60c708c3-7aec-4c49-bbe2-dfacf5f1895a\") "
Oct 30 21:07:41.077112 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:07:41.077041    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/60c708c3-7aec-4c49-bbe2-dfacf5f1895a-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/60c708c3-7aec-4c49-bbe2-dfacf5f1895a-credential-socket\") pod \"60c708c3-7aec-4c49-bbe2-dfacf5f1895a\" (UID: \"60c708c3-7aec-4c49-bbe2-dfacf5f1895a\") "
Oct 30 21:07:41.077112 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:07:41.077095    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/60c708c3-7aec-4c49-bbe2-dfacf5f1895a-istio-token\" (UniqueName: \"kubernetes.io/projected/60c708c3-7aec-4c49-bbe2-dfacf5f1895a-istio-token\") pod \"60c708c3-7aec-4c49-bbe2-dfacf5f1895a\" (UID: \"60c708c3-7aec-4c49-bbe2-dfacf5f1895a\") "
Oct 30 21:07:41.077287 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:07:41.077161    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/60c708c3-7aec-4c49-bbe2-dfacf5f1895a-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/60c708c3-7aec-4c49-bbe2-dfacf5f1895a-workload-socket\") pod \"60c708c3-7aec-4c49-bbe2-dfacf5f1895a\" (UID: \"60c708c3-7aec-4c49-bbe2-dfacf5f1895a\") "
Oct 30 21:07:41.077287 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:07:41.077232    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/60c708c3-7aec-4c49-bbe2-dfacf5f1895a-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/60c708c3-7aec-4c49-bbe2-dfacf5f1895a-workload-certs\") pod \"60c708c3-7aec-4c49-bbe2-dfacf5f1895a\" (UID: \"60c708c3-7aec-4c49-bbe2-dfacf5f1895a\") "
Oct 30 21:07:41.077287 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:07:41.077275    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/60c708c3-7aec-4c49-bbe2-dfacf5f1895a-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/60c708c3-7aec-4c49-bbe2-dfacf5f1895a-istio-podinfo\") pod \"60c708c3-7aec-4c49-bbe2-dfacf5f1895a\" (UID: \"60c708c3-7aec-4c49-bbe2-dfacf5f1895a\") "
Oct 30 21:07:41.077436 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:07:41.077358    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/60c708c3-7aec-4c49-bbe2-dfacf5f1895a-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/60c708c3-7aec-4c49-bbe2-dfacf5f1895a-istio-envoy\") pod \"60c708c3-7aec-4c49-bbe2-dfacf5f1895a\" (UID: \"60c708c3-7aec-4c49-bbe2-dfacf5f1895a\") "
Oct 30 21:07:41.077436 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:07:41.077423    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/60c708c3-7aec-4c49-bbe2-dfacf5f1895a-kube-api-access-4jx7h\" (UniqueName: \"kubernetes.io/projected/60c708c3-7aec-4c49-bbe2-dfacf5f1895a-kube-api-access-4jx7h\") pod \"60c708c3-7aec-4c49-bbe2-dfacf5f1895a\" (UID: \"60c708c3-7aec-4c49-bbe2-dfacf5f1895a\") "
Oct 30 21:07:41.077899 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:07:41.077878    6004 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cs8kl\" (UniqueName: \"kubernetes.io/projected/4f353b43-913f-4043-bac3-50b745209bf2-kube-api-access-cs8kl\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:07:41.077992 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:07:41.077904    6004 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4f353b43-913f-4043-bac3-50b745209bf2-istio-podinfo\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:07:41.077992 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:07:41.077919    6004 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4f353b43-913f-4043-bac3-50b745209bf2-workload-socket\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:07:41.077992 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:07:41.077931    6004 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4f353b43-913f-4043-bac3-50b745209bf2-credential-socket\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:07:41.077992 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:07:41.077944    6004 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4f353b43-913f-4043-bac3-50b745209bf2-workload-certs\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:07:41.077992 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:07:41.077957    6004 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4f353b43-913f-4043-bac3-50b745209bf2-istio-token\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:07:41.077992 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:07:41.077970    6004 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4f353b43-913f-4043-bac3-50b745209bf2-istio-envoy\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:07:41.077992 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:07:41.077983    6004 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4f353b43-913f-4043-bac3-50b745209bf2-istio-data\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:07:41.078353 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:07:41.077997    6004 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4f353b43-913f-4043-bac3-50b745209bf2-istiod-ca-cert\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:07:41.078940 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:07:41.078876    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/60c708c3-7aec-4c49-bbe2-dfacf5f1895a-workload-certs" pod "60c708c3-7aec-4c49-bbe2-dfacf5f1895a" (UID: "60c708c3-7aec-4c49-bbe2-dfacf5f1895a"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:07:41.078940 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:07:41.078893    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/60c708c3-7aec-4c49-bbe2-dfacf5f1895a-istio-data" pod "60c708c3-7aec-4c49-bbe2-dfacf5f1895a" (UID: "60c708c3-7aec-4c49-bbe2-dfacf5f1895a"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:07:41.079585 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:07:41.079540    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/60c708c3-7aec-4c49-bbe2-dfacf5f1895a-credential-socket" pod "60c708c3-7aec-4c49-bbe2-dfacf5f1895a" (UID: "60c708c3-7aec-4c49-bbe2-dfacf5f1895a"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:07:41.080464 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:07:41.080438    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/60c708c3-7aec-4c49-bbe2-dfacf5f1895a-workload-socket" pod "60c708c3-7aec-4c49-bbe2-dfacf5f1895a" (UID: "60c708c3-7aec-4c49-bbe2-dfacf5f1895a"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:07:41.080814 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:07:41.080784    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/60c708c3-7aec-4c49-bbe2-dfacf5f1895a-istiod-ca-cert" pod "60c708c3-7aec-4c49-bbe2-dfacf5f1895a" (UID: "60c708c3-7aec-4c49-bbe2-dfacf5f1895a"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:07:41.083371 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:07:41.082641    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/60c708c3-7aec-4c49-bbe2-dfacf5f1895a-kube-api-access-4jx7h" pod "60c708c3-7aec-4c49-bbe2-dfacf5f1895a" (UID: "60c708c3-7aec-4c49-bbe2-dfacf5f1895a"). InnerVolumeSpecName "kube-api-access-4jx7h". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:07:41.083371 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:07:41.082671    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/60c708c3-7aec-4c49-bbe2-dfacf5f1895a-istio-token" pod "60c708c3-7aec-4c49-bbe2-dfacf5f1895a" (UID: "60c708c3-7aec-4c49-bbe2-dfacf5f1895a"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:07:41.083371 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:07:41.082711    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/60c708c3-7aec-4c49-bbe2-dfacf5f1895a-istio-envoy" pod "60c708c3-7aec-4c49-bbe2-dfacf5f1895a" (UID: "60c708c3-7aec-4c49-bbe2-dfacf5f1895a"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:07:41.084521 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:07:41.084470    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/60c708c3-7aec-4c49-bbe2-dfacf5f1895a-istio-podinfo" pod "60c708c3-7aec-4c49-bbe2-dfacf5f1895a" (UID: "60c708c3-7aec-4c49-bbe2-dfacf5f1895a"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 21:07:41.097600 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:07:41.097572    6004 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-d061d0-openshift-default-86b87f495-d8j6q"
Oct 30 21:07:41.179454 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:07:41.178746    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/21525b82-87c7-4c9e-91fc-6070f3973861-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/21525b82-87c7-4c9e-91fc-6070f3973861-credential-socket\") pod \"21525b82-87c7-4c9e-91fc-6070f3973861\" (UID: \"21525b82-87c7-4c9e-91fc-6070f3973861\") "
Oct 30 21:07:41.179454 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:07:41.178831    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/4b9cc2c7-4e42-4ab3-90a8-5fda80c79f2f-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4b9cc2c7-4e42-4ab3-90a8-5fda80c79f2f-workload-socket\") pod \"4b9cc2c7-4e42-4ab3-90a8-5fda80c79f2f\" (UID: \"4b9cc2c7-4e42-4ab3-90a8-5fda80c79f2f\") "
Oct 30 21:07:41.179707 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:07:41.179564    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/21525b82-87c7-4c9e-91fc-6070f3973861-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/21525b82-87c7-4c9e-91fc-6070f3973861-workload-socket\") pod \"21525b82-87c7-4c9e-91fc-6070f3973861\" (UID: \"21525b82-87c7-4c9e-91fc-6070f3973861\") "
Oct 30 21:07:41.179707 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:07:41.179607    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/54f45743-f6cf-4d8b-b3a5-e1064334eebc-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/54f45743-f6cf-4d8b-b3a5-e1064334eebc-istio-podinfo\") pod \"54f45743-f6cf-4d8b-b3a5-e1064334eebc\" (UID: \"54f45743-f6cf-4d8b-b3a5-e1064334eebc\") "
Oct 30 21:07:41.179707 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:07:41.179650    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/54f45743-f6cf-4d8b-b3a5-e1064334eebc-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/54f45743-f6cf-4d8b-b3a5-e1064334eebc-istio-data\") pod \"54f45743-f6cf-4d8b-b3a5-e1064334eebc\" (UID: \"54f45743-f6cf-4d8b-b3a5-e1064334eebc\") "
Oct 30 21:07:41.179707 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:07:41.179683    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/21525b82-87c7-4c9e-91fc-6070f3973861-kube-api-access-4vpx9\" (UniqueName: \"kubernetes.io/projected/21525b82-87c7-4c9e-91fc-6070f3973861-kube-api-access-4vpx9\") pod \"21525b82-87c7-4c9e-91fc-6070f3973861\" (UID: \"21525b82-87c7-4c9e-91fc-6070f3973861\") "
Oct 30 21:07:41.179970 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:07:41.179744    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/21525b82-87c7-4c9e-91fc-6070f3973861-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/21525b82-87c7-4c9e-91fc-6070f3973861-workload-certs\") pod \"21525b82-87c7-4c9e-91fc-6070f3973861\" (UID: \"21525b82-87c7-4c9e-91fc-6070f3973861\") "
Oct 30 21:07:41.179970 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:07:41.179843    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/21525b82-87c7-4c9e-91fc-6070f3973861-istio-token\" (UniqueName: \"kubernetes.io/projected/21525b82-87c7-4c9e-91fc-6070f3973861-istio-token\") pod \"21525b82-87c7-4c9e-91fc-6070f3973861\" (UID: \"21525b82-87c7-4c9e-91fc-6070f3973861\") "
Oct 30 21:07:41.179970 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:07:41.179889    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/4b9cc2c7-4e42-4ab3-90a8-5fda80c79f2f-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4b9cc2c7-4e42-4ab3-90a8-5fda80c79f2f-credential-socket\") pod \"4b9cc2c7-4e42-4ab3-90a8-5fda80c79f2f\" (UID: \"4b9cc2c7-4e42-4ab3-90a8-5fda80c79f2f\") "
Oct 30 21:07:41.179970 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:07:41.179945    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/4b9cc2c7-4e42-4ab3-90a8-5fda80c79f2f-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4b9cc2c7-4e42-4ab3-90a8-5fda80c79f2f-istiod-ca-cert\") pod \"4b9cc2c7-4e42-4ab3-90a8-5fda80c79f2f\" (UID: \"4b9cc2c7-4e42-4ab3-90a8-5fda80c79f2f\") "
Oct 30 21:07:41.180195 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:07:41.179987    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/4b9cc2c7-4e42-4ab3-90a8-5fda80c79f2f-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4b9cc2c7-4e42-4ab3-90a8-5fda80c79f2f-workload-certs\") pod \"4b9cc2c7-4e42-4ab3-90a8-5fda80c79f2f\" (UID: \"4b9cc2c7-4e42-4ab3-90a8-5fda80c79f2f\") "
Oct 30 21:07:41.180195 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:07:41.180040    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/21525b82-87c7-4c9e-91fc-6070f3973861-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/21525b82-87c7-4c9e-91fc-6070f3973861-istio-data\") pod \"21525b82-87c7-4c9e-91fc-6070f3973861\" (UID: \"21525b82-87c7-4c9e-91fc-6070f3973861\") "
Oct 30 21:07:41.180195 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:07:41.180147    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/21525b82-87c7-4c9e-91fc-6070f3973861-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/21525b82-87c7-4c9e-91fc-6070f3973861-istio-podinfo\") pod \"21525b82-87c7-4c9e-91fc-6070f3973861\" (UID: \"21525b82-87c7-4c9e-91fc-6070f3973861\") "
Oct 30 21:07:41.180346 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:07:41.180247    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/4b9cc2c7-4e42-4ab3-90a8-5fda80c79f2f-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4b9cc2c7-4e42-4ab3-90a8-5fda80c79f2f-istio-podinfo\") pod \"4b9cc2c7-4e42-4ab3-90a8-5fda80c79f2f\" (UID: \"4b9cc2c7-4e42-4ab3-90a8-5fda80c79f2f\") "
Oct 30 21:07:41.180346 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:07:41.180329    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/21525b82-87c7-4c9e-91fc-6070f3973861-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/21525b82-87c7-4c9e-91fc-6070f3973861-istiod-ca-cert\") pod \"21525b82-87c7-4c9e-91fc-6070f3973861\" (UID: \"21525b82-87c7-4c9e-91fc-6070f3973861\") "
Oct 30 21:07:41.180447 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:07:41.180420    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/54f45743-f6cf-4d8b-b3a5-e1064334eebc-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/54f45743-f6cf-4d8b-b3a5-e1064334eebc-istiod-ca-cert\") pod \"54f45743-f6cf-4d8b-b3a5-e1064334eebc\" (UID: \"54f45743-f6cf-4d8b-b3a5-e1064334eebc\") "
Oct 30 21:07:41.180506 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:07:41.180460    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/54f45743-f6cf-4d8b-b3a5-e1064334eebc-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/54f45743-f6cf-4d8b-b3a5-e1064334eebc-workload-socket\") pod \"54f45743-f6cf-4d8b-b3a5-e1064334eebc\" (UID: \"54f45743-f6cf-4d8b-b3a5-e1064334eebc\") "
Oct 30 21:07:41.180561 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:07:41.180525    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/4b9cc2c7-4e42-4ab3-90a8-5fda80c79f2f-kube-api-access-956hx\" (UniqueName: \"kubernetes.io/projected/4b9cc2c7-4e42-4ab3-90a8-5fda80c79f2f-kube-api-access-956hx\") pod \"4b9cc2c7-4e42-4ab3-90a8-5fda80c79f2f\" (UID: \"4b9cc2c7-4e42-4ab3-90a8-5fda80c79f2f\") "
Oct 30 21:07:41.180617 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:07:41.180594    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/4b9cc2c7-4e42-4ab3-90a8-5fda80c79f2f-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4b9cc2c7-4e42-4ab3-90a8-5fda80c79f2f-istio-data\") pod \"4b9cc2c7-4e42-4ab3-90a8-5fda80c79f2f\" (UID: \"4b9cc2c7-4e42-4ab3-90a8-5fda80c79f2f\") "
Oct 30 21:07:41.180672 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:07:41.180642    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/54f45743-f6cf-4d8b-b3a5-e1064334eebc-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/54f45743-f6cf-4d8b-b3a5-e1064334eebc-istio-envoy\") pod \"54f45743-f6cf-4d8b-b3a5-e1064334eebc\" (UID: \"54f45743-f6cf-4d8b-b3a5-e1064334eebc\") "
Oct 30 21:07:41.180731 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:07:41.180681    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/54f45743-f6cf-4d8b-b3a5-e1064334eebc-istio-token\" (UniqueName: \"kubernetes.io/projected/54f45743-f6cf-4d8b-b3a5-e1064334eebc-istio-token\") pod \"54f45743-f6cf-4d8b-b3a5-e1064334eebc\" (UID: \"54f45743-f6cf-4d8b-b3a5-e1064334eebc\") "
Oct 30 21:07:41.180782 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:07:41.180736    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/54f45743-f6cf-4d8b-b3a5-e1064334eebc-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/54f45743-f6cf-4d8b-b3a5-e1064334eebc-credential-socket\") pod \"54f45743-f6cf-4d8b-b3a5-e1064334eebc\" (UID: \"54f45743-f6cf-4d8b-b3a5-e1064334eebc\") "
Oct 30 21:07:41.180836 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:07:41.180819    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/54f45743-f6cf-4d8b-b3a5-e1064334eebc-kube-api-access-gbn7b\" (UniqueName: \"kubernetes.io/projected/54f45743-f6cf-4d8b-b3a5-e1064334eebc-kube-api-access-gbn7b\") pod \"54f45743-f6cf-4d8b-b3a5-e1064334eebc\" (UID: \"54f45743-f6cf-4d8b-b3a5-e1064334eebc\") "
Oct 30 21:07:41.180891 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:07:41.180876    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/54f45743-f6cf-4d8b-b3a5-e1064334eebc-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/54f45743-f6cf-4d8b-b3a5-e1064334eebc-workload-certs\") pod \"54f45743-f6cf-4d8b-b3a5-e1064334eebc\" (UID: \"54f45743-f6cf-4d8b-b3a5-e1064334eebc\") "
Oct 30 21:07:41.180946 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:07:41.180920    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/4b9cc2c7-4e42-4ab3-90a8-5fda80c79f2f-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4b9cc2c7-4e42-4ab3-90a8-5fda80c79f2f-istio-envoy\") pod \"4b9cc2c7-4e42-4ab3-90a8-5fda80c79f2f\" (UID: \"4b9cc2c7-4e42-4ab3-90a8-5fda80c79f2f\") "
Oct 30 21:07:41.180998 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:07:41.179217    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/21525b82-87c7-4c9e-91fc-6070f3973861-credential-socket" pod "21525b82-87c7-4c9e-91fc-6070f3973861" (UID: "21525b82-87c7-4c9e-91fc-6070f3973861"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:07:41.180998 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:07:41.179480    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4b9cc2c7-4e42-4ab3-90a8-5fda80c79f2f-workload-socket" pod "4b9cc2c7-4e42-4ab3-90a8-5fda80c79f2f" (UID: "4b9cc2c7-4e42-4ab3-90a8-5fda80c79f2f"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:07:41.180998 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:07:41.180936    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/21525b82-87c7-4c9e-91fc-6070f3973861-workload-socket" pod "21525b82-87c7-4c9e-91fc-6070f3973861" (UID: "21525b82-87c7-4c9e-91fc-6070f3973861"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:07:41.180998 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:07:41.180991    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/21525b82-87c7-4c9e-91fc-6070f3973861-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/21525b82-87c7-4c9e-91fc-6070f3973861-istio-envoy\") pod \"21525b82-87c7-4c9e-91fc-6070f3973861\" (UID: \"21525b82-87c7-4c9e-91fc-6070f3973861\") "
Oct 30 21:07:41.182341 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:07:41.181075    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/4b9cc2c7-4e42-4ab3-90a8-5fda80c79f2f-istio-token\" (UniqueName: \"kubernetes.io/projected/4b9cc2c7-4e42-4ab3-90a8-5fda80c79f2f-istio-token\") pod \"4b9cc2c7-4e42-4ab3-90a8-5fda80c79f2f\" (UID: \"4b9cc2c7-4e42-4ab3-90a8-5fda80c79f2f\") "
Oct 30 21:07:41.182341 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:07:41.181328    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/21525b82-87c7-4c9e-91fc-6070f3973861-istiod-ca-cert" pod "21525b82-87c7-4c9e-91fc-6070f3973861" (UID: "21525b82-87c7-4c9e-91fc-6070f3973861"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:07:41.182341 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:07:41.181432    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4b9cc2c7-4e42-4ab3-90a8-5fda80c79f2f-credential-socket" pod "4b9cc2c7-4e42-4ab3-90a8-5fda80c79f2f" (UID: "4b9cc2c7-4e42-4ab3-90a8-5fda80c79f2f"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:07:41.182341 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:07:41.181724    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4b9cc2c7-4e42-4ab3-90a8-5fda80c79f2f-istiod-ca-cert" pod "4b9cc2c7-4e42-4ab3-90a8-5fda80c79f2f" (UID: "4b9cc2c7-4e42-4ab3-90a8-5fda80c79f2f"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:07:41.182341 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:07:41.181903    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/54f45743-f6cf-4d8b-b3a5-e1064334eebc-istio-data" pod "54f45743-f6cf-4d8b-b3a5-e1064334eebc" (UID: "54f45743-f6cf-4d8b-b3a5-e1064334eebc"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:07:41.182341 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:07:41.182082    6004 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/60c708c3-7aec-4c49-bbe2-dfacf5f1895a-workload-certs\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:07:41.182341 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:07:41.182103    6004 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/60c708c3-7aec-4c49-bbe2-dfacf5f1895a-istio-podinfo\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:07:41.182341 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:07:41.182117    6004 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/60c708c3-7aec-4c49-bbe2-dfacf5f1895a-istio-envoy\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:07:41.182341 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:07:41.182131    6004 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4jx7h\" (UniqueName: \"kubernetes.io/projected/60c708c3-7aec-4c49-bbe2-dfacf5f1895a-kube-api-access-4jx7h\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:07:41.182341 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:07:41.182147    6004 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/21525b82-87c7-4c9e-91fc-6070f3973861-credential-socket\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:07:41.182341 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:07:41.182162    6004 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4b9cc2c7-4e42-4ab3-90a8-5fda80c79f2f-workload-socket\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:07:41.182341 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:07:41.182176    6004 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/21525b82-87c7-4c9e-91fc-6070f3973861-workload-socket\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:07:41.182341 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:07:41.182204    6004 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/54f45743-f6cf-4d8b-b3a5-e1064334eebc-istio-data\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:07:41.182341 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:07:41.182218    6004 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4b9cc2c7-4e42-4ab3-90a8-5fda80c79f2f-credential-socket\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:07:41.182341 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:07:41.182232    6004 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4b9cc2c7-4e42-4ab3-90a8-5fda80c79f2f-istiod-ca-cert\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:07:41.182341 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:07:41.182247    6004 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/60c708c3-7aec-4c49-bbe2-dfacf5f1895a-istiod-ca-cert\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:07:41.182341 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:07:41.182260    6004 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/60c708c3-7aec-4c49-bbe2-dfacf5f1895a-istio-data\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:07:41.182341 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:07:41.182274    6004 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/60c708c3-7aec-4c49-bbe2-dfacf5f1895a-credential-socket\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:07:41.182341 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:07:41.182288    6004 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/60c708c3-7aec-4c49-bbe2-dfacf5f1895a-istio-token\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:07:41.182341 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:07:41.182303    6004 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/21525b82-87c7-4c9e-91fc-6070f3973861-istiod-ca-cert\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:07:41.182341 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:07:41.182317    6004 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/60c708c3-7aec-4c49-bbe2-dfacf5f1895a-workload-socket\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:07:41.184102 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:07:41.182534    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4b9cc2c7-4e42-4ab3-90a8-5fda80c79f2f-workload-certs" pod "4b9cc2c7-4e42-4ab3-90a8-5fda80c79f2f" (UID: "4b9cc2c7-4e42-4ab3-90a8-5fda80c79f2f"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:07:41.184102 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:07:41.182715    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/21525b82-87c7-4c9e-91fc-6070f3973861-istio-data" pod "21525b82-87c7-4c9e-91fc-6070f3973861" (UID: "21525b82-87c7-4c9e-91fc-6070f3973861"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:07:41.184102 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:07:41.182861    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/21525b82-87c7-4c9e-91fc-6070f3973861-workload-certs" pod "21525b82-87c7-4c9e-91fc-6070f3973861" (UID: "21525b82-87c7-4c9e-91fc-6070f3973861"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:07:41.184700 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:07:41.184672    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/54f45743-f6cf-4d8b-b3a5-e1064334eebc-istiod-ca-cert" pod "54f45743-f6cf-4d8b-b3a5-e1064334eebc" (UID: "54f45743-f6cf-4d8b-b3a5-e1064334eebc"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:07:41.188072 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:07:41.187886    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/21525b82-87c7-4c9e-91fc-6070f3973861-kube-api-access-4vpx9" pod "21525b82-87c7-4c9e-91fc-6070f3973861" (UID: "21525b82-87c7-4c9e-91fc-6070f3973861"). InnerVolumeSpecName "kube-api-access-4vpx9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:07:41.188194 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:07:41.188138    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/54f45743-f6cf-4d8b-b3a5-e1064334eebc-workload-socket" pod "54f45743-f6cf-4d8b-b3a5-e1064334eebc" (UID: "54f45743-f6cf-4d8b-b3a5-e1064334eebc"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:07:41.188551 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:07:41.188295    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4b9cc2c7-4e42-4ab3-90a8-5fda80c79f2f-istio-data" pod "4b9cc2c7-4e42-4ab3-90a8-5fda80c79f2f" (UID: "4b9cc2c7-4e42-4ab3-90a8-5fda80c79f2f"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:07:41.189630 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:07:41.189606    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/54f45743-f6cf-4d8b-b3a5-e1064334eebc-workload-certs" pod "54f45743-f6cf-4d8b-b3a5-e1064334eebc" (UID: "54f45743-f6cf-4d8b-b3a5-e1064334eebc"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:07:41.189829 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:07:41.189808    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/54f45743-f6cf-4d8b-b3a5-e1064334eebc-credential-socket" pod "54f45743-f6cf-4d8b-b3a5-e1064334eebc" (UID: "54f45743-f6cf-4d8b-b3a5-e1064334eebc"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:07:41.190829 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:07:41.190560    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/54f45743-f6cf-4d8b-b3a5-e1064334eebc-istio-envoy" pod "54f45743-f6cf-4d8b-b3a5-e1064334eebc" (UID: "54f45743-f6cf-4d8b-b3a5-e1064334eebc"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:07:41.192234 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:07:41.192212    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/54f45743-f6cf-4d8b-b3a5-e1064334eebc-kube-api-access-gbn7b" pod "54f45743-f6cf-4d8b-b3a5-e1064334eebc" (UID: "54f45743-f6cf-4d8b-b3a5-e1064334eebc"). InnerVolumeSpecName "kube-api-access-gbn7b". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:07:41.193392 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:07:41.193363    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/21525b82-87c7-4c9e-91fc-6070f3973861-istio-envoy" pod "21525b82-87c7-4c9e-91fc-6070f3973861" (UID: "21525b82-87c7-4c9e-91fc-6070f3973861"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:07:41.201687 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:07:41.201653    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/54f45743-f6cf-4d8b-b3a5-e1064334eebc-istio-token" pod "54f45743-f6cf-4d8b-b3a5-e1064334eebc" (UID: "54f45743-f6cf-4d8b-b3a5-e1064334eebc"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:07:41.201940 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:07:41.201908    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/4b9cc2c7-4e42-4ab3-90a8-5fda80c79f2f-istio-podinfo" pod "4b9cc2c7-4e42-4ab3-90a8-5fda80c79f2f" (UID: "4b9cc2c7-4e42-4ab3-90a8-5fda80c79f2f"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 21:07:41.203386 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:07:41.203256    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4b9cc2c7-4e42-4ab3-90a8-5fda80c79f2f-istio-token" pod "4b9cc2c7-4e42-4ab3-90a8-5fda80c79f2f" (UID: "4b9cc2c7-4e42-4ab3-90a8-5fda80c79f2f"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:07:41.203386 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:07:41.203350    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4b9cc2c7-4e42-4ab3-90a8-5fda80c79f2f-kube-api-access-956hx" pod "4b9cc2c7-4e42-4ab3-90a8-5fda80c79f2f" (UID: "4b9cc2c7-4e42-4ab3-90a8-5fda80c79f2f"). InnerVolumeSpecName "kube-api-access-956hx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:07:41.203533 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:07:41.203390    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/54f45743-f6cf-4d8b-b3a5-e1064334eebc-istio-podinfo" pod "54f45743-f6cf-4d8b-b3a5-e1064334eebc" (UID: "54f45743-f6cf-4d8b-b3a5-e1064334eebc"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 21:07:41.204792 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:07:41.204764    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/21525b82-87c7-4c9e-91fc-6070f3973861-istio-podinfo" pod "21525b82-87c7-4c9e-91fc-6070f3973861" (UID: "21525b82-87c7-4c9e-91fc-6070f3973861"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 21:07:41.204959 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:07:41.204932    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/21525b82-87c7-4c9e-91fc-6070f3973861-istio-token" pod "21525b82-87c7-4c9e-91fc-6070f3973861" (UID: "21525b82-87c7-4c9e-91fc-6070f3973861"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:07:41.205328 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:07:41.205307    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4b9cc2c7-4e42-4ab3-90a8-5fda80c79f2f-istio-envoy" pod "4b9cc2c7-4e42-4ab3-90a8-5fda80c79f2f" (UID: "4b9cc2c7-4e42-4ab3-90a8-5fda80c79f2f"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:07:41.288088 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:07:41.287961    6004 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4b9cc2c7-4e42-4ab3-90a8-5fda80c79f2f-istio-podinfo\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:07:41.288088 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:07:41.287997    6004 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/54f45743-f6cf-4d8b-b3a5-e1064334eebc-istiod-ca-cert\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:07:41.288088 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:07:41.288012    6004 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/54f45743-f6cf-4d8b-b3a5-e1064334eebc-workload-socket\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:07:41.288088 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:07:41.288029    6004 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-956hx\" (UniqueName: \"kubernetes.io/projected/4b9cc2c7-4e42-4ab3-90a8-5fda80c79f2f-kube-api-access-956hx\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:07:41.288784 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:07:41.288044    6004 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4b9cc2c7-4e42-4ab3-90a8-5fda80c79f2f-istio-data\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:07:41.300096 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:07:41.294770    6004 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/54f45743-f6cf-4d8b-b3a5-e1064334eebc-istio-envoy\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:07:41.300096 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:07:41.294805    6004 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/54f45743-f6cf-4d8b-b3a5-e1064334eebc-istio-token\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:07:41.300096 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:07:41.294823    6004 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/54f45743-f6cf-4d8b-b3a5-e1064334eebc-credential-socket\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:07:41.300096 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:07:41.294849    6004 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gbn7b\" (UniqueName: \"kubernetes.io/projected/54f45743-f6cf-4d8b-b3a5-e1064334eebc-kube-api-access-gbn7b\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:07:41.300096 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:07:41.294866    6004 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/54f45743-f6cf-4d8b-b3a5-e1064334eebc-workload-certs\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:07:41.300096 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:07:41.294882    6004 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4b9cc2c7-4e42-4ab3-90a8-5fda80c79f2f-istio-envoy\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:07:41.300096 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:07:41.294899    6004 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/21525b82-87c7-4c9e-91fc-6070f3973861-istio-envoy\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:07:41.300096 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:07:41.294920    6004 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4b9cc2c7-4e42-4ab3-90a8-5fda80c79f2f-istio-token\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:07:41.300096 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:07:41.294937    6004 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/54f45743-f6cf-4d8b-b3a5-e1064334eebc-istio-podinfo\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:07:41.300096 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:07:41.294952    6004 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4vpx9\" (UniqueName: \"kubernetes.io/projected/21525b82-87c7-4c9e-91fc-6070f3973861-kube-api-access-4vpx9\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:07:41.300096 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:07:41.294972    6004 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/21525b82-87c7-4c9e-91fc-6070f3973861-workload-certs\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:07:41.300096 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:07:41.294986    6004 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/21525b82-87c7-4c9e-91fc-6070f3973861-istio-token\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:07:41.300096 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:07:41.295004    6004 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4b9cc2c7-4e42-4ab3-90a8-5fda80c79f2f-workload-certs\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:07:41.300096 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:07:41.295018    6004 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/21525b82-87c7-4c9e-91fc-6070f3973861-istio-data\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:07:41.300096 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:07:41.295038    6004 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/21525b82-87c7-4c9e-91fc-6070f3973861-istio-podinfo\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:07:41.588722 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:07:41.578896    6004 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-d061d0-openshift-default-86b87f495-rwjhc" event={"ID":"60c708c3-7aec-4c49-bbe2-dfacf5f1895a","Type":"ContainerDied","Data":"2fa524ae216b21d963cca1c6b48d00b88e3b341b2f83582b5aa859605ee91a62"}
Oct 30 21:07:41.588722 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:07:41.579007    6004 scope.go:122] "RemoveContainer" containerID="54e98ba3626de69388f6b92c5d278ede213c4496bf69b5fc798adb3e7247a31e"
Oct 30 21:07:41.588722 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:07:41.579193    6004 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-d061d0-openshift-default-86b87f495-rwjhc"
Oct 30 21:07:41.599263 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:07:41.597807    6004 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-d061d0-openshift-default-86b87f495-d8j6q" event={"ID":"54f45743-f6cf-4d8b-b3a5-e1064334eebc","Type":"ContainerDied","Data":"75e0fd4daf1e8022e48b969bd3d94462070ccd31b888a78d986bd5ed204bd1f6"}
Oct 30 21:07:41.599263 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:07:41.597932    6004 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-d061d0-openshift-default-86b87f495-d8j6q"
Oct 30 21:07:41.603365 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:07:41.603235    6004 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-1fdaa7-openshift-default-84586db7d5-vf7tj" event={"ID":"4b9cc2c7-4e42-4ab3-90a8-5fda80c79f2f","Type":"ContainerDied","Data":"32010f01df7c367bcf6f8b9de47a696de8b90df1680c0b6fc418b1d50c6910ed"}
Oct 30 21:07:41.603365 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:07:41.603277    6004 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-1fdaa7-openshift-default-84586db7d5-vf7tj"
Oct 30 21:07:41.624752 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:07:41.622889    6004 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-1fdaa7-openshift-default-84586db7d5-46jqd" event={"ID":"4f353b43-913f-4043-bac3-50b745209bf2","Type":"ContainerDied","Data":"e54b676a863055c5e2f2f9f6b89212b36d4f89198a11f54ecc8269a5d3fb7e47"}
Oct 30 21:07:41.624752 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:07:41.623037    6004 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-1fdaa7-openshift-default-84586db7d5-46jqd"
Oct 30 21:07:41.633678 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:07:41.632908    6004 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-1fdaa7-openshift-default-84586db7d5-gt5hd" event={"ID":"21525b82-87c7-4c9e-91fc-6070f3973861","Type":"ContainerDied","Data":"70f346032d4c2fb286ad7553b1c12cb3b304582dea335aa85c107a02e91b0c81"}
Oct 30 21:07:41.633678 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:07:41.633072    6004 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-1fdaa7-openshift-default-84586db7d5-gt5hd"
Oct 30 21:07:41.647256 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:07:41.647190    6004 scope.go:122] "RemoveContainer" containerID="d14fecce2a74e1a19a298a9521a85723ec961a4c917fa4ca9a17a419eb39d653"
Oct 30 21:07:41.669884 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:07:41.669489    6004 scope.go:122] "RemoveContainer" containerID="0c0498ab75bea1b822fe80050b889299b3b474a7e5c4d362f2e99a6bedd5655a"
Oct 30 21:07:41.691796 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:07:41.691773    6004 scope.go:122] "RemoveContainer" containerID="cf3448e334adddf7d3aa20cee5f1c6cc044d1c9a52ed324dd015bffc0a00b4a9"
Oct 30 21:07:41.706999 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:07:41.706973    6004 scope.go:122] "RemoveContainer" containerID="0d48ae75b253bef0001280b4808a7399171e1a43a3ac0e09c725ac34fffdb652"
Oct 30 21:07:41.763562 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:07:41.763528    6004 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w4-1fdaa7-openshift-default-84586db7d5-46jqd"]
Oct 30 21:07:41.768684 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:07:41.768659    6004 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w4-1fdaa7-openshift-default-84586db7d5-46jqd"]
Oct 30 21:07:41.876617 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:07:41.876526    6004 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w4-1fdaa7-openshift-default-84586db7d5-vf7tj"]
Oct 30 21:07:41.879676 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:07:41.879647    6004 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w4-1fdaa7-openshift-default-84586db7d5-vf7tj"]
Oct 30 21:07:41.991163 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:07:41.991126    6004 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w2-d061d0-openshift-default-86b87f495-rwjhc"]
Oct 30 21:07:41.995652 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:07:41.995625    6004 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w2-d061d0-openshift-default-86b87f495-rwjhc"]
Oct 30 21:07:42.265957 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:07:42.265916    6004 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="4b9cc2c7-4e42-4ab3-90a8-5fda80c79f2f" path="/var/lib/kubelet/pods/4b9cc2c7-4e42-4ab3-90a8-5fda80c79f2f/volumes"
Oct 30 21:07:42.266742 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:07:42.266720    6004 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="4f353b43-913f-4043-bac3-50b745209bf2" path="/var/lib/kubelet/pods/4f353b43-913f-4043-bac3-50b745209bf2/volumes"
Oct 30 21:07:42.267250 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:07:42.267235    6004 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="60c708c3-7aec-4c49-bbe2-dfacf5f1895a" path="/var/lib/kubelet/pods/60c708c3-7aec-4c49-bbe2-dfacf5f1895a/volumes"
Oct 30 21:07:42.267992 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:07:42.267974    6004 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w4-1fdaa7-openshift-default-84586db7d5-gt5hd"]
Oct 30 21:07:42.268074 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:07:42.268013    6004 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w4-1fdaa7-openshift-default-84586db7d5-gt5hd"]
Oct 30 21:07:42.371531 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:07:42.371497    6004 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w2-d061d0-openshift-default-86b87f495-d8j6q"]
Oct 30 21:07:42.375788 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:07:42.375752    6004 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w2-d061d0-openshift-default-86b87f495-d8j6q"]
Oct 30 21:07:44.234192 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:07:44.234161    6004 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="21525b82-87c7-4c9e-91fc-6070f3973861" path="/var/lib/kubelet/pods/21525b82-87c7-4c9e-91fc-6070f3973861/volumes"
Oct 30 21:07:44.234658 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:07:44.234643    6004 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="54f45743-f6cf-4d8b-b3a5-e1064334eebc" path="/var/lib/kubelet/pods/54f45743-f6cf-4d8b-b3a5-e1064334eebc/volumes"
Oct 30 21:07:44.287830 ip-10-0-138-85 kubenswrapper[6004]: E1030 21:07:44.287791    6004 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-zz4wr" containerName="extractor"
Oct 30 21:07:51.912248 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:07:51.912211    6004 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w1-4d1110-6868947598-j228b"]
Oct 30 21:07:51.914840 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:07:51.912948    6004 cpu_manager.go:414] "containerMap: removing container" podUID="20463dad-83a0-4ba2-9de8-824d5e46bdec" containerName="istio-proxy"
Oct 30 21:07:51.914840 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:07:51.912965    6004 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="20463dad-83a0-4ba2-9de8-824d5e46bdec" containerName="istio-proxy"
Oct 30 21:07:51.914840 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:07:51.912989    6004 cpu_manager.go:414] "containerMap: removing container" podUID="4f353b43-913f-4043-bac3-50b745209bf2" containerName="istio-proxy"
Oct 30 21:07:51.914840 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:07:51.912994    6004 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="4f353b43-913f-4043-bac3-50b745209bf2" containerName="istio-proxy"
Oct 30 21:07:51.914840 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:07:51.913004    6004 cpu_manager.go:414] "containerMap: removing container" podUID="54f45743-f6cf-4d8b-b3a5-e1064334eebc" containerName="istio-proxy"
Oct 30 21:07:51.914840 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:07:51.913010    6004 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="54f45743-f6cf-4d8b-b3a5-e1064334eebc" containerName="istio-proxy"
Oct 30 21:07:51.914840 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:07:51.913018    6004 cpu_manager.go:414] "containerMap: removing container" podUID="4b9cc2c7-4e42-4ab3-90a8-5fda80c79f2f" containerName="istio-proxy"
Oct 30 21:07:51.914840 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:07:51.913023    6004 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="4b9cc2c7-4e42-4ab3-90a8-5fda80c79f2f" containerName="istio-proxy"
Oct 30 21:07:51.914840 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:07:51.913037    6004 cpu_manager.go:414] "containerMap: removing container" podUID="21525b82-87c7-4c9e-91fc-6070f3973861" containerName="istio-proxy"
Oct 30 21:07:51.914840 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:07:51.913041    6004 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="21525b82-87c7-4c9e-91fc-6070f3973861" containerName="istio-proxy"
Oct 30 21:07:51.914840 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:07:51.913075    6004 cpu_manager.go:414] "containerMap: removing container" podUID="7d16ac0c-fddc-4ea4-9f2f-0b485a109bef" containerName="istio-proxy"
Oct 30 21:07:51.914840 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:07:51.913080    6004 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="7d16ac0c-fddc-4ea4-9f2f-0b485a109bef" containerName="istio-proxy"
Oct 30 21:07:51.914840 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:07:51.913088    6004 cpu_manager.go:414] "containerMap: removing container" podUID="bfc98489-f90d-4a7a-b85c-5d258cbed4c0" containerName="maas-api"
Oct 30 21:07:51.914840 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:07:51.913092    6004 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="bfc98489-f90d-4a7a-b85c-5d258cbed4c0" containerName="maas-api"
Oct 30 21:07:51.914840 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:07:51.913098    6004 cpu_manager.go:414] "containerMap: removing container" podUID="60c708c3-7aec-4c49-bbe2-dfacf5f1895a" containerName="istio-proxy"
Oct 30 21:07:51.914840 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:07:51.913103    6004 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="60c708c3-7aec-4c49-bbe2-dfacf5f1895a" containerName="istio-proxy"
Oct 30 21:07:51.914840 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:07:51.913196    6004 memory_manager.go:365] "RemoveStaleState removing state" podUID="20463dad-83a0-4ba2-9de8-824d5e46bdec" containerName="istio-proxy"
Oct 30 21:07:51.914840 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:07:51.913206    6004 memory_manager.go:365] "RemoveStaleState removing state" podUID="4f353b43-913f-4043-bac3-50b745209bf2" containerName="istio-proxy"
Oct 30 21:07:51.914840 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:07:51.913215    6004 memory_manager.go:365] "RemoveStaleState removing state" podUID="54f45743-f6cf-4d8b-b3a5-e1064334eebc" containerName="istio-proxy"
Oct 30 21:07:51.914840 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:07:51.913222    6004 memory_manager.go:365] "RemoveStaleState removing state" podUID="4b9cc2c7-4e42-4ab3-90a8-5fda80c79f2f" containerName="istio-proxy"
Oct 30 21:07:51.914840 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:07:51.913229    6004 memory_manager.go:365] "RemoveStaleState removing state" podUID="21525b82-87c7-4c9e-91fc-6070f3973861" containerName="istio-proxy"
Oct 30 21:07:51.914840 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:07:51.913237    6004 memory_manager.go:365] "RemoveStaleState removing state" podUID="7d16ac0c-fddc-4ea4-9f2f-0b485a109bef" containerName="istio-proxy"
Oct 30 21:07:51.914840 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:07:51.913243    6004 memory_manager.go:365] "RemoveStaleState removing state" podUID="bfc98489-f90d-4a7a-b85c-5d258cbed4c0" containerName="maas-api"
Oct 30 21:07:51.914840 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:07:51.913249    6004 memory_manager.go:365] "RemoveStaleState removing state" podUID="60c708c3-7aec-4c49-bbe2-dfacf5f1895a" containerName="istio-proxy"
Oct 30 21:07:51.916756 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:07:51.916735    6004 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w1-4d1110-6868947598-j228b"
Oct 30 21:07:51.966542 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:07:51.966508    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f2d38836-68af-4498-a047-ae6e99704b53-maas-api-tls\") pod \"maas-api-e2e-shared-a-w1-4d1110-6868947598-j228b\" (UID: \"f2d38836-68af-4498-a047-ae6e99704b53\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w1-4d1110-6868947598-j228b"
Oct 30 21:07:51.966682 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:07:51.966566    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f2d38836-68af-4498-a047-ae6e99704b53-metrics-certs\") pod \"maas-api-e2e-shared-a-w1-4d1110-6868947598-j228b\" (UID: \"f2d38836-68af-4498-a047-ae6e99704b53\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w1-4d1110-6868947598-j228b"
Oct 30 21:07:51.966955 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:07:51.966680    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nkw9v\" (UniqueName: \"kubernetes.io/projected/f2d38836-68af-4498-a047-ae6e99704b53-kube-api-access-nkw9v\") pod \"maas-api-e2e-shared-a-w1-4d1110-6868947598-j228b\" (UID: \"f2d38836-68af-4498-a047-ae6e99704b53\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w1-4d1110-6868947598-j228b"
Oct 30 21:07:51.966955 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:07:51.966713    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f2d38836-68af-4498-a047-ae6e99704b53-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w1-4d1110-6868947598-j228b\" (UID: \"f2d38836-68af-4498-a047-ae6e99704b53\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w1-4d1110-6868947598-j228b"
Oct 30 21:07:51.972250 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:07:51.972221    6004 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-a-w1-4d1110-serving-cert\""
Oct 30 21:07:52.025803 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:07:52.025771    6004 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w1-4d1110-6868947598-j228b"]
Oct 30 21:07:52.068909 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:07:52.068871    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nkw9v\" (UniqueName: \"kubernetes.io/projected/f2d38836-68af-4498-a047-ae6e99704b53-kube-api-access-nkw9v\") pod \"maas-api-e2e-shared-a-w1-4d1110-6868947598-j228b\" (UID: \"f2d38836-68af-4498-a047-ae6e99704b53\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w1-4d1110-6868947598-j228b"
Oct 30 21:07:52.069116 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:07:52.068929    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f2d38836-68af-4498-a047-ae6e99704b53-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w1-4d1110-6868947598-j228b\" (UID: \"f2d38836-68af-4498-a047-ae6e99704b53\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w1-4d1110-6868947598-j228b"
Oct 30 21:07:52.069180 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:07:52.069164    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f2d38836-68af-4498-a047-ae6e99704b53-maas-api-tls\") pod \"maas-api-e2e-shared-a-w1-4d1110-6868947598-j228b\" (UID: \"f2d38836-68af-4498-a047-ae6e99704b53\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w1-4d1110-6868947598-j228b"
Oct 30 21:07:52.069269 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:07:52.069253    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f2d38836-68af-4498-a047-ae6e99704b53-metrics-certs\") pod \"maas-api-e2e-shared-a-w1-4d1110-6868947598-j228b\" (UID: \"f2d38836-68af-4498-a047-ae6e99704b53\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w1-4d1110-6868947598-j228b"
Oct 30 21:07:52.070416 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:07:52.070389    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f2d38836-68af-4498-a047-ae6e99704b53-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w1-4d1110-6868947598-j228b\" (UID: \"f2d38836-68af-4498-a047-ae6e99704b53\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w1-4d1110-6868947598-j228b"
Oct 30 21:07:52.070854 ip-10-0-138-85 kubenswrapper[6004]: E1030 21:07:52.070833    6004 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-a-w1-4d1110-serving-cert: secret "maas-api-e2e-shared-a-w1-4d1110-serving-cert" not found
Oct 30 21:07:52.070978 ip-10-0-138-85 kubenswrapper[6004]: E1030 21:07:52.070910    6004 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f2d38836-68af-4498-a047-ae6e99704b53-maas-api-tls podName:f2d38836-68af-4498-a047-ae6e99704b53 nodeName:}" failed. No retries permitted until 2026-10-30 21:07:52.570891727 +0000 UTC m=+1778.490677822 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/f2d38836-68af-4498-a047-ae6e99704b53-maas-api-tls") pod "maas-api-e2e-shared-a-w1-4d1110-6868947598-j228b" (UID: "f2d38836-68af-4498-a047-ae6e99704b53") : secret "maas-api-e2e-shared-a-w1-4d1110-serving-cert" not found
Oct 30 21:07:52.075801 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:07:52.073734    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f2d38836-68af-4498-a047-ae6e99704b53-metrics-certs\") pod \"maas-api-e2e-shared-a-w1-4d1110-6868947598-j228b\" (UID: \"f2d38836-68af-4498-a047-ae6e99704b53\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w1-4d1110-6868947598-j228b"
Oct 30 21:07:52.129436 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:07:52.129410    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nkw9v\" (UniqueName: \"kubernetes.io/projected/f2d38836-68af-4498-a047-ae6e99704b53-kube-api-access-nkw9v\") pod \"maas-api-e2e-shared-a-w1-4d1110-6868947598-j228b\" (UID: \"f2d38836-68af-4498-a047-ae6e99704b53\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w1-4d1110-6868947598-j228b"
Oct 30 21:07:52.582920 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:07:52.582881    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f2d38836-68af-4498-a047-ae6e99704b53-maas-api-tls\") pod \"maas-api-e2e-shared-a-w1-4d1110-6868947598-j228b\" (UID: \"f2d38836-68af-4498-a047-ae6e99704b53\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w1-4d1110-6868947598-j228b"
Oct 30 21:07:52.585606 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:07:52.585576    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f2d38836-68af-4498-a047-ae6e99704b53-maas-api-tls\") pod \"maas-api-e2e-shared-a-w1-4d1110-6868947598-j228b\" (UID: \"f2d38836-68af-4498-a047-ae6e99704b53\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w1-4d1110-6868947598-j228b"
Oct 30 21:07:52.830292 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:07:52.830264    6004 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w1-4d1110-6868947598-j228b"
Oct 30 21:07:53.218148 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:07:53.218114    6004 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w1-4d1110-6868947598-j228b"]
Oct 30 21:07:53.218487 ip-10-0-138-85 kubenswrapper[6004]: W1030 21:07:53.218194    6004 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf2d38836_68af_4498_a047_ae6e99704b53.slice/crio-991178163a0a315398faaf04773e9631bc0c7e40be43dfaa55b62859b56f4d3d WatchSource:0}: Error finding container 991178163a0a315398faaf04773e9631bc0c7e40be43dfaa55b62859b56f4d3d: Status 404 returned error can't find the container with id 991178163a0a315398faaf04773e9631bc0c7e40be43dfaa55b62859b56f4d3d
Oct 30 21:07:53.219634 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:07:53.219612    6004 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Oct 30 21:07:53.735777 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:07:53.735740    6004 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w1-4d1110-6868947598-j228b" event={"ID":"f2d38836-68af-4498-a047-ae6e99704b53","Type":"ContainerStarted","Data":"991178163a0a315398faaf04773e9631bc0c7e40be43dfaa55b62859b56f4d3d"}
Oct 30 21:07:54.744902 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:07:54.744867    6004 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w1-4d1110-6868947598-j228b" event={"ID":"f2d38836-68af-4498-a047-ae6e99704b53","Type":"ContainerStarted","Data":"59ad4b4b4cd461b9d7aee642ed6e07676f3445d8b818c60e9f303d29895ff7a6"}
Oct 30 21:07:54.745352 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:07:54.745082    6004 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w1-4d1110-6868947598-j228b"
Oct 30 21:07:54.862531 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:07:54.862468    6004 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w1-4d1110-6868947598-j228b" podStartSLOduration=3.067939581 podStartE2EDuration="3.862449349s" totalImagesPullingTime="794.509768ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:07:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:07:54.860547428 +0000 UTC m=+1780.780333545" watchObservedRunningTime="2026-10-30 21:07:54.862449349 +0000 UTC m=+1780.782235470"
Oct 30 21:08:00.759959 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:08:00.759927    6004 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w1-4d1110-6868947598-j228b"
Oct 30 21:08:04.014640 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:08:04.014608    6004 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-255f05-7cb4855d94-kqj22"]
Oct 30 21:08:04.018960 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:08:04.018938    6004 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-255f05-7cb4855d94-kqj22"
Oct 30 21:08:04.131809 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:08:04.131770    6004 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-b-w2-255f05-serving-cert\""
Oct 30 21:08:04.137102 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:08:04.137068    6004 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-255f05-7cb4855d94-kqj22"]
Oct 30 21:08:04.192135 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:08:04.192086    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/79165cd4-9579-48e3-99e3-8b6a63c9379c-maas-api-tls\") pod \"maas-api-e2e-shared-b-w2-255f05-7cb4855d94-kqj22\" (UID: \"79165cd4-9579-48e3-99e3-8b6a63c9379c\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-255f05-7cb4855d94-kqj22"
Oct 30 21:08:04.192135 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:08:04.192137    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/79165cd4-9579-48e3-99e3-8b6a63c9379c-metrics-certs\") pod \"maas-api-e2e-shared-b-w2-255f05-7cb4855d94-kqj22\" (UID: \"79165cd4-9579-48e3-99e3-8b6a63c9379c\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-255f05-7cb4855d94-kqj22"
Oct 30 21:08:04.192382 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:08:04.192265    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4wqc7\" (UniqueName: \"kubernetes.io/projected/79165cd4-9579-48e3-99e3-8b6a63c9379c-kube-api-access-4wqc7\") pod \"maas-api-e2e-shared-b-w2-255f05-7cb4855d94-kqj22\" (UID: \"79165cd4-9579-48e3-99e3-8b6a63c9379c\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-255f05-7cb4855d94-kqj22"
Oct 30 21:08:04.192382 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:08:04.192310    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/79165cd4-9579-48e3-99e3-8b6a63c9379c-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w2-255f05-7cb4855d94-kqj22\" (UID: \"79165cd4-9579-48e3-99e3-8b6a63c9379c\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-255f05-7cb4855d94-kqj22"
Oct 30 21:08:04.294932 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:08:04.293983    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/79165cd4-9579-48e3-99e3-8b6a63c9379c-maas-api-tls\") pod \"maas-api-e2e-shared-b-w2-255f05-7cb4855d94-kqj22\" (UID: \"79165cd4-9579-48e3-99e3-8b6a63c9379c\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-255f05-7cb4855d94-kqj22"
Oct 30 21:08:04.295350 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:08:04.295325    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/79165cd4-9579-48e3-99e3-8b6a63c9379c-metrics-certs\") pod \"maas-api-e2e-shared-b-w2-255f05-7cb4855d94-kqj22\" (UID: \"79165cd4-9579-48e3-99e3-8b6a63c9379c\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-255f05-7cb4855d94-kqj22"
Oct 30 21:08:04.295628 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:08:04.295609    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4wqc7\" (UniqueName: \"kubernetes.io/projected/79165cd4-9579-48e3-99e3-8b6a63c9379c-kube-api-access-4wqc7\") pod \"maas-api-e2e-shared-b-w2-255f05-7cb4855d94-kqj22\" (UID: \"79165cd4-9579-48e3-99e3-8b6a63c9379c\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-255f05-7cb4855d94-kqj22"
Oct 30 21:08:04.295757 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:08:04.295739    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/79165cd4-9579-48e3-99e3-8b6a63c9379c-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w2-255f05-7cb4855d94-kqj22\" (UID: \"79165cd4-9579-48e3-99e3-8b6a63c9379c\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-255f05-7cb4855d94-kqj22"
Oct 30 21:08:04.296947 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:08:04.296849    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/79165cd4-9579-48e3-99e3-8b6a63c9379c-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w2-255f05-7cb4855d94-kqj22\" (UID: \"79165cd4-9579-48e3-99e3-8b6a63c9379c\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-255f05-7cb4855d94-kqj22"
Oct 30 21:08:04.297535 ip-10-0-138-85 kubenswrapper[6004]: E1030 21:08:04.297510    6004 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-255f05-serving-cert: secret "maas-api-e2e-shared-b-w2-255f05-serving-cert" not found
Oct 30 21:08:04.297672 ip-10-0-138-85 kubenswrapper[6004]: E1030 21:08:04.297596    6004 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/79165cd4-9579-48e3-99e3-8b6a63c9379c-maas-api-tls podName:79165cd4-9579-48e3-99e3-8b6a63c9379c nodeName:}" failed. No retries permitted until 2026-10-30 21:08:04.797575848 +0000 UTC m=+1790.717361955 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/79165cd4-9579-48e3-99e3-8b6a63c9379c-maas-api-tls") pod "maas-api-e2e-shared-b-w2-255f05-7cb4855d94-kqj22" (UID: "79165cd4-9579-48e3-99e3-8b6a63c9379c") : secret "maas-api-e2e-shared-b-w2-255f05-serving-cert" not found
Oct 30 21:08:04.345617 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:08:04.341936    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/79165cd4-9579-48e3-99e3-8b6a63c9379c-metrics-certs\") pod \"maas-api-e2e-shared-b-w2-255f05-7cb4855d94-kqj22\" (UID: \"79165cd4-9579-48e3-99e3-8b6a63c9379c\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-255f05-7cb4855d94-kqj22"
Oct 30 21:08:04.373189 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:08:04.372980    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4wqc7\" (UniqueName: \"kubernetes.io/projected/79165cd4-9579-48e3-99e3-8b6a63c9379c-kube-api-access-4wqc7\") pod \"maas-api-e2e-shared-b-w2-255f05-7cb4855d94-kqj22\" (UID: \"79165cd4-9579-48e3-99e3-8b6a63c9379c\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-255f05-7cb4855d94-kqj22"
Oct 30 21:08:04.804008 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:08:04.803966    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/79165cd4-9579-48e3-99e3-8b6a63c9379c-maas-api-tls\") pod \"maas-api-e2e-shared-b-w2-255f05-7cb4855d94-kqj22\" (UID: \"79165cd4-9579-48e3-99e3-8b6a63c9379c\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-255f05-7cb4855d94-kqj22"
Oct 30 21:08:04.806439 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:08:04.806407    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/79165cd4-9579-48e3-99e3-8b6a63c9379c-maas-api-tls\") pod \"maas-api-e2e-shared-b-w2-255f05-7cb4855d94-kqj22\" (UID: \"79165cd4-9579-48e3-99e3-8b6a63c9379c\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-255f05-7cb4855d94-kqj22"
Oct 30 21:08:04.936214 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:08:04.936177    6004 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-255f05-7cb4855d94-kqj22"
Oct 30 21:08:05.315232 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:08:05.315198    6004 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-255f05-7cb4855d94-kqj22"]
Oct 30 21:08:05.316405 ip-10-0-138-85 kubenswrapper[6004]: W1030 21:08:05.316377    6004 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod79165cd4_9579_48e3_99e3_8b6a63c9379c.slice/crio-c0a7c77d2c81d0a5841927379427b3adbade6dd67d06bb1f4eb4be564a170368 WatchSource:0}: Error finding container c0a7c77d2c81d0a5841927379427b3adbade6dd67d06bb1f4eb4be564a170368: Status 404 returned error can't find the container with id c0a7c77d2c81d0a5841927379427b3adbade6dd67d06bb1f4eb4be564a170368
Oct 30 21:08:05.876565 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:08:05.876519    6004 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-255f05-7cb4855d94-kqj22" event={"ID":"79165cd4-9579-48e3-99e3-8b6a63c9379c","Type":"ContainerStarted","Data":"c0a7c77d2c81d0a5841927379427b3adbade6dd67d06bb1f4eb4be564a170368"}
Oct 30 21:08:06.962073 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:08:06.939811    6004 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-255f05-7cb4855d94-kqj22" event={"ID":"79165cd4-9579-48e3-99e3-8b6a63c9379c","Type":"ContainerStarted","Data":"6d9031099353eb2960873b873cacbf46de0a470818164c5688ad385844fc4e9a"}
Oct 30 21:08:06.962073 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:08:06.941123    6004 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-255f05-7cb4855d94-kqj22"
Oct 30 21:08:07.079085 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:08:07.075290    6004 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-255f05-7cb4855d94-kqj22" podStartSLOduration=3.263702032 podStartE2EDuration="4.075269178s" totalImagesPullingTime="811.567146ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:08:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:08:07.072566983 +0000 UTC m=+1792.992353102" watchObservedRunningTime="2026-10-30 21:08:07.075269178 +0000 UTC m=+1792.995055297"
Oct 30 21:08:13.962908 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:08:13.962874    6004 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-255f05-7cb4855d94-kqj22"
Oct 30 21:08:14.288202 ip-10-0-138-85 kubenswrapper[6004]: E1030 21:08:14.288120    6004 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-zz4wr" containerName="extractor"
Oct 30 21:08:14.515028 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:08:14.514996    6004 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-sb7ds_90cd3de0-c573-41c2-bf3e-cf0e46a41d50/console-operator/2.log"
Oct 30 21:08:14.525257 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:08:14.525231    6004 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-sb7ds_90cd3de0-c573-41c2-bf3e-cf0e46a41d50/console-operator/2.log"
Oct 30 21:08:44.287681 ip-10-0-138-85 kubenswrapper[6004]: E1030 21:08:44.287645    6004 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-zz4wr" containerName="extractor"
Oct 30 21:09:00.734660 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:09:00.734612    6004 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-b888d0-7c4bb7ffc9-l6dd9"]
Oct 30 21:09:00.739378 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:09:00.739350    6004 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-b888d0-7c4bb7ffc9-l6dd9"
Oct 30 21:09:00.795120 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:09:00.795091    6004 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-b888d0-7c4bb7ffc9-l6dd9"]
Oct 30 21:09:00.841606 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:09:00.841577    6004 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-a-b888d0-serving-cert\""
Oct 30 21:09:00.894860 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:09:00.894824    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/67b159b6-480b-4764-ac2d-5c97a8fee67b-metrics-certs\") pod \"maas-api-e2e-api-a-b888d0-7c4bb7ffc9-l6dd9\" (UID: \"67b159b6-480b-4764-ac2d-5c97a8fee67b\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-b888d0-7c4bb7ffc9-l6dd9"
Oct 30 21:09:00.895081 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:09:00.894887    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/67b159b6-480b-4764-ac2d-5c97a8fee67b-openshift-service-ca\") pod \"maas-api-e2e-api-a-b888d0-7c4bb7ffc9-l6dd9\" (UID: \"67b159b6-480b-4764-ac2d-5c97a8fee67b\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-b888d0-7c4bb7ffc9-l6dd9"
Oct 30 21:09:00.895081 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:09:00.894993    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/67b159b6-480b-4764-ac2d-5c97a8fee67b-maas-api-tls\") pod \"maas-api-e2e-api-a-b888d0-7c4bb7ffc9-l6dd9\" (UID: \"67b159b6-480b-4764-ac2d-5c97a8fee67b\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-b888d0-7c4bb7ffc9-l6dd9"
Oct 30 21:09:00.895081 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:09:00.895022    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4l6j2\" (UniqueName: \"kubernetes.io/projected/67b159b6-480b-4764-ac2d-5c97a8fee67b-kube-api-access-4l6j2\") pod \"maas-api-e2e-api-a-b888d0-7c4bb7ffc9-l6dd9\" (UID: \"67b159b6-480b-4764-ac2d-5c97a8fee67b\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-b888d0-7c4bb7ffc9-l6dd9"
Oct 30 21:09:00.998132 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:09:00.997772    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/67b159b6-480b-4764-ac2d-5c97a8fee67b-metrics-certs\") pod \"maas-api-e2e-api-a-b888d0-7c4bb7ffc9-l6dd9\" (UID: \"67b159b6-480b-4764-ac2d-5c97a8fee67b\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-b888d0-7c4bb7ffc9-l6dd9"
Oct 30 21:09:00.998132 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:09:00.997852    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/67b159b6-480b-4764-ac2d-5c97a8fee67b-openshift-service-ca\") pod \"maas-api-e2e-api-a-b888d0-7c4bb7ffc9-l6dd9\" (UID: \"67b159b6-480b-4764-ac2d-5c97a8fee67b\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-b888d0-7c4bb7ffc9-l6dd9"
Oct 30 21:09:00.998132 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:09:00.997925    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/67b159b6-480b-4764-ac2d-5c97a8fee67b-maas-api-tls\") pod \"maas-api-e2e-api-a-b888d0-7c4bb7ffc9-l6dd9\" (UID: \"67b159b6-480b-4764-ac2d-5c97a8fee67b\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-b888d0-7c4bb7ffc9-l6dd9"
Oct 30 21:09:00.998132 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:09:00.997972    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4l6j2\" (UniqueName: \"kubernetes.io/projected/67b159b6-480b-4764-ac2d-5c97a8fee67b-kube-api-access-4l6j2\") pod \"maas-api-e2e-api-a-b888d0-7c4bb7ffc9-l6dd9\" (UID: \"67b159b6-480b-4764-ac2d-5c97a8fee67b\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-b888d0-7c4bb7ffc9-l6dd9"
Oct 30 21:09:00.999662 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:09:00.999630    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/67b159b6-480b-4764-ac2d-5c97a8fee67b-openshift-service-ca\") pod \"maas-api-e2e-api-a-b888d0-7c4bb7ffc9-l6dd9\" (UID: \"67b159b6-480b-4764-ac2d-5c97a8fee67b\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-b888d0-7c4bb7ffc9-l6dd9"
Oct 30 21:09:01.003752 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:09:01.003725    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/67b159b6-480b-4764-ac2d-5c97a8fee67b-metrics-certs\") pod \"maas-api-e2e-api-a-b888d0-7c4bb7ffc9-l6dd9\" (UID: \"67b159b6-480b-4764-ac2d-5c97a8fee67b\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-b888d0-7c4bb7ffc9-l6dd9"
Oct 30 21:09:01.013069 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:09:01.013020    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/67b159b6-480b-4764-ac2d-5c97a8fee67b-maas-api-tls\") pod \"maas-api-e2e-api-a-b888d0-7c4bb7ffc9-l6dd9\" (UID: \"67b159b6-480b-4764-ac2d-5c97a8fee67b\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-b888d0-7c4bb7ffc9-l6dd9"
Oct 30 21:09:01.068928 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:09:01.068897    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4l6j2\" (UniqueName: \"kubernetes.io/projected/67b159b6-480b-4764-ac2d-5c97a8fee67b-kube-api-access-4l6j2\") pod \"maas-api-e2e-api-a-b888d0-7c4bb7ffc9-l6dd9\" (UID: \"67b159b6-480b-4764-ac2d-5c97a8fee67b\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-b888d0-7c4bb7ffc9-l6dd9"
Oct 30 21:09:01.357536 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:09:01.357427    6004 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-b888d0-7c4bb7ffc9-l6dd9"
Oct 30 21:09:01.739167 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:09:01.739140    6004 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-b888d0-7c4bb7ffc9-l6dd9"]
Oct 30 21:09:01.740511 ip-10-0-138-85 kubenswrapper[6004]: W1030 21:09:01.740483    6004 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod67b159b6_480b_4764_ac2d_5c97a8fee67b.slice/crio-66f3aef80d6fac31dcb6418a213121c51b4b47ba9494bf74137e5bcd86021199 WatchSource:0}: Error finding container 66f3aef80d6fac31dcb6418a213121c51b4b47ba9494bf74137e5bcd86021199: Status 404 returned error can't find the container with id 66f3aef80d6fac31dcb6418a213121c51b4b47ba9494bf74137e5bcd86021199
Oct 30 21:09:02.394078 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:09:02.393316    6004 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-b888d0-7c4bb7ffc9-l6dd9" event={"ID":"67b159b6-480b-4764-ac2d-5c97a8fee67b","Type":"ContainerStarted","Data":"66f3aef80d6fac31dcb6418a213121c51b4b47ba9494bf74137e5bcd86021199"}
Oct 30 21:09:03.431255 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:09:03.431218    6004 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-b888d0-7c4bb7ffc9-l6dd9" event={"ID":"67b159b6-480b-4764-ac2d-5c97a8fee67b","Type":"ContainerStarted","Data":"1d9e9150d86749827aedfec3200362a8b5c6175f4b19da10b4babc86221fbaf3"}
Oct 30 21:09:03.445073 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:09:03.435205    6004 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-b888d0-7c4bb7ffc9-l6dd9"
Oct 30 21:09:09.445950 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:09:09.445915    6004 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-b888d0-7c4bb7ffc9-l6dd9"
Oct 30 21:09:09.565727 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:09:09.565663    6004 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-b888d0-7c4bb7ffc9-l6dd9" podStartSLOduration=8.67607979 podStartE2EDuration="9.565646211s" totalImagesPullingTime="889.566421ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:09:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:09:03.564297788 +0000 UTC m=+1849.484083909" watchObservedRunningTime="2026-10-30 21:09:09.565646211 +0000 UTC m=+1855.485432328"
Oct 30 21:09:14.287641 ip-10-0-138-85 kubenswrapper[6004]: E1030 21:09:14.287607    6004 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-zz4wr" containerName="extractor"
Oct 30 21:09:33.937160 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:09:33.937118    6004 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-9926f7-795755f5d8-p2slb"]
Oct 30 21:09:33.942665 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:09:33.942641    6004 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-9926f7-795755f5d8-p2slb"
Oct 30 21:09:33.999990 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:09:33.999956    6004 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-a-9926f7-serving-cert\""
Oct 30 21:09:34.054369 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:09:34.054276    6004 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-9926f7-795755f5d8-p2slb"]
Oct 30 21:09:34.056900 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:09:34.056873    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/552ce26c-3856-42d4-a079-0b9d2309a83c-maas-api-tls\") pod \"maas-api-e2e-api-a-9926f7-795755f5d8-p2slb\" (UID: \"552ce26c-3856-42d4-a079-0b9d2309a83c\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-9926f7-795755f5d8-p2slb"
Oct 30 21:09:34.057091 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:09:34.056939    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/552ce26c-3856-42d4-a079-0b9d2309a83c-openshift-service-ca\") pod \"maas-api-e2e-api-a-9926f7-795755f5d8-p2slb\" (UID: \"552ce26c-3856-42d4-a079-0b9d2309a83c\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-9926f7-795755f5d8-p2slb"
Oct 30 21:09:34.057091 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:09:34.057027    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qrfvn\" (UniqueName: \"kubernetes.io/projected/552ce26c-3856-42d4-a079-0b9d2309a83c-kube-api-access-qrfvn\") pod \"maas-api-e2e-api-a-9926f7-795755f5d8-p2slb\" (UID: \"552ce26c-3856-42d4-a079-0b9d2309a83c\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-9926f7-795755f5d8-p2slb"
Oct 30 21:09:34.057240 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:09:34.057208    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/552ce26c-3856-42d4-a079-0b9d2309a83c-metrics-certs\") pod \"maas-api-e2e-api-a-9926f7-795755f5d8-p2slb\" (UID: \"552ce26c-3856-42d4-a079-0b9d2309a83c\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-9926f7-795755f5d8-p2slb"
Oct 30 21:09:34.158383 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:09:34.158351    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/552ce26c-3856-42d4-a079-0b9d2309a83c-metrics-certs\") pod \"maas-api-e2e-api-a-9926f7-795755f5d8-p2slb\" (UID: \"552ce26c-3856-42d4-a079-0b9d2309a83c\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-9926f7-795755f5d8-p2slb"
Oct 30 21:09:34.158587 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:09:34.158444    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/552ce26c-3856-42d4-a079-0b9d2309a83c-maas-api-tls\") pod \"maas-api-e2e-api-a-9926f7-795755f5d8-p2slb\" (UID: \"552ce26c-3856-42d4-a079-0b9d2309a83c\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-9926f7-795755f5d8-p2slb"
Oct 30 21:09:34.158587 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:09:34.158496    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/552ce26c-3856-42d4-a079-0b9d2309a83c-openshift-service-ca\") pod \"maas-api-e2e-api-a-9926f7-795755f5d8-p2slb\" (UID: \"552ce26c-3856-42d4-a079-0b9d2309a83c\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-9926f7-795755f5d8-p2slb"
Oct 30 21:09:34.158587 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:09:34.158582    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qrfvn\" (UniqueName: \"kubernetes.io/projected/552ce26c-3856-42d4-a079-0b9d2309a83c-kube-api-access-qrfvn\") pod \"maas-api-e2e-api-a-9926f7-795755f5d8-p2slb\" (UID: \"552ce26c-3856-42d4-a079-0b9d2309a83c\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-9926f7-795755f5d8-p2slb"
Oct 30 21:09:34.159098 ip-10-0-138-85 kubenswrapper[6004]: E1030 21:09:34.159071    6004 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-api-a-9926f7-serving-cert: secret "maas-api-e2e-api-a-9926f7-serving-cert" not found
Oct 30 21:09:34.159239 ip-10-0-138-85 kubenswrapper[6004]: E1030 21:09:34.159174    6004 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/552ce26c-3856-42d4-a079-0b9d2309a83c-maas-api-tls podName:552ce26c-3856-42d4-a079-0b9d2309a83c nodeName:}" failed. No retries permitted until 2026-10-30 21:09:34.659152907 +0000 UTC m=+1880.578939017 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/552ce26c-3856-42d4-a079-0b9d2309a83c-maas-api-tls") pod "maas-api-e2e-api-a-9926f7-795755f5d8-p2slb" (UID: "552ce26c-3856-42d4-a079-0b9d2309a83c") : secret "maas-api-e2e-api-a-9926f7-serving-cert" not found
Oct 30 21:09:34.159865 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:09:34.159838    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/552ce26c-3856-42d4-a079-0b9d2309a83c-openshift-service-ca\") pod \"maas-api-e2e-api-a-9926f7-795755f5d8-p2slb\" (UID: \"552ce26c-3856-42d4-a079-0b9d2309a83c\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-9926f7-795755f5d8-p2slb"
Oct 30 21:09:34.161277 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:09:34.161252    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/552ce26c-3856-42d4-a079-0b9d2309a83c-metrics-certs\") pod \"maas-api-e2e-api-a-9926f7-795755f5d8-p2slb\" (UID: \"552ce26c-3856-42d4-a079-0b9d2309a83c\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-9926f7-795755f5d8-p2slb"
Oct 30 21:09:34.218601 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:09:34.218531    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qrfvn\" (UniqueName: \"kubernetes.io/projected/552ce26c-3856-42d4-a079-0b9d2309a83c-kube-api-access-qrfvn\") pod \"maas-api-e2e-api-a-9926f7-795755f5d8-p2slb\" (UID: \"552ce26c-3856-42d4-a079-0b9d2309a83c\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-9926f7-795755f5d8-p2slb"
Oct 30 21:09:34.674729 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:09:34.674633    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/552ce26c-3856-42d4-a079-0b9d2309a83c-maas-api-tls\") pod \"maas-api-e2e-api-a-9926f7-795755f5d8-p2slb\" (UID: \"552ce26c-3856-42d4-a079-0b9d2309a83c\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-9926f7-795755f5d8-p2slb"
Oct 30 21:09:34.691973 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:09:34.691938    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/552ce26c-3856-42d4-a079-0b9d2309a83c-maas-api-tls\") pod \"maas-api-e2e-api-a-9926f7-795755f5d8-p2slb\" (UID: \"552ce26c-3856-42d4-a079-0b9d2309a83c\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-9926f7-795755f5d8-p2slb"
Oct 30 21:09:34.864119 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:09:34.859537    6004 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-9926f7-795755f5d8-p2slb"
Oct 30 21:09:35.417572 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:09:35.417541    6004 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-9926f7-795755f5d8-p2slb"]
Oct 30 21:09:35.703331 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:09:35.703277    6004 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-9926f7-795755f5d8-p2slb" event={"ID":"552ce26c-3856-42d4-a079-0b9d2309a83c","Type":"ContainerStarted","Data":"63140ec2acf185b0234878dae1a32c4b90834ce840255f9aebb754b589643388"}
Oct 30 21:09:36.712436 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:09:36.712392    6004 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-9926f7-795755f5d8-p2slb" event={"ID":"552ce26c-3856-42d4-a079-0b9d2309a83c","Type":"ContainerStarted","Data":"1aaf1c3912dad1fcbbda0b229363dc5ae5c82f6e71e61a383737f8a214679744"}
Oct 30 21:09:36.712904 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:09:36.712454    6004 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-9926f7-795755f5d8-p2slb"
Oct 30 21:09:36.832076 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:09:36.830993    6004 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-9926f7-795755f5d8-p2slb" podStartSLOduration=2.961782578 podStartE2EDuration="3.830975194s" totalImagesPullingTime="869.192616ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:09:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:09:36.829552914 +0000 UTC m=+1882.749339033" watchObservedRunningTime="2026-10-30 21:09:36.830975194 +0000 UTC m=+1882.750761313"
Oct 30 21:09:41.411575 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:09:41.411543    6004 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-a-b888d0-openshift-default-65d785fbfc-q2g4z"]
Oct 30 21:09:41.416086 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:09:41.416037    6004 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-b888d0-openshift-default-65d785fbfc-q2g4z"
Oct 30 21:09:41.527090 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:09:41.527021    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b3ca1b55-1094-43ae-851a-58441b3cbb66-istiod-ca-cert\") pod \"e2e-api-a-b888d0-openshift-default-65d785fbfc-q2g4z\" (UID: \"b3ca1b55-1094-43ae-851a-58441b3cbb66\") " pod="openshift-ingress/e2e-api-a-b888d0-openshift-default-65d785fbfc-q2g4z"
Oct 30 21:09:41.527281 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:09:41.527193    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b3ca1b55-1094-43ae-851a-58441b3cbb66-istio-data\") pod \"e2e-api-a-b888d0-openshift-default-65d785fbfc-q2g4z\" (UID: \"b3ca1b55-1094-43ae-851a-58441b3cbb66\") " pod="openshift-ingress/e2e-api-a-b888d0-openshift-default-65d785fbfc-q2g4z"
Oct 30 21:09:41.527281 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:09:41.527238    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b3ca1b55-1094-43ae-851a-58441b3cbb66-istio-podinfo\") pod \"e2e-api-a-b888d0-openshift-default-65d785fbfc-q2g4z\" (UID: \"b3ca1b55-1094-43ae-851a-58441b3cbb66\") " pod="openshift-ingress/e2e-api-a-b888d0-openshift-default-65d785fbfc-q2g4z"
Oct 30 21:09:41.527459 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:09:41.527368    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b3ca1b55-1094-43ae-851a-58441b3cbb66-istio-envoy\") pod \"e2e-api-a-b888d0-openshift-default-65d785fbfc-q2g4z\" (UID: \"b3ca1b55-1094-43ae-851a-58441b3cbb66\") " pod="openshift-ingress/e2e-api-a-b888d0-openshift-default-65d785fbfc-q2g4z"
Oct 30 21:09:41.527459 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:09:41.527396    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b3ca1b55-1094-43ae-851a-58441b3cbb66-credential-socket\") pod \"e2e-api-a-b888d0-openshift-default-65d785fbfc-q2g4z\" (UID: \"b3ca1b55-1094-43ae-851a-58441b3cbb66\") " pod="openshift-ingress/e2e-api-a-b888d0-openshift-default-65d785fbfc-q2g4z"
Oct 30 21:09:41.527575 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:09:41.527534    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mfmjc\" (UniqueName: \"kubernetes.io/projected/b3ca1b55-1094-43ae-851a-58441b3cbb66-kube-api-access-mfmjc\") pod \"e2e-api-a-b888d0-openshift-default-65d785fbfc-q2g4z\" (UID: \"b3ca1b55-1094-43ae-851a-58441b3cbb66\") " pod="openshift-ingress/e2e-api-a-b888d0-openshift-default-65d785fbfc-q2g4z"
Oct 30 21:09:41.527633 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:09:41.527614    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b3ca1b55-1094-43ae-851a-58441b3cbb66-istio-token\") pod \"e2e-api-a-b888d0-openshift-default-65d785fbfc-q2g4z\" (UID: \"b3ca1b55-1094-43ae-851a-58441b3cbb66\") " pod="openshift-ingress/e2e-api-a-b888d0-openshift-default-65d785fbfc-q2g4z"
Oct 30 21:09:41.527730 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:09:41.527713    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b3ca1b55-1094-43ae-851a-58441b3cbb66-workload-certs\") pod \"e2e-api-a-b888d0-openshift-default-65d785fbfc-q2g4z\" (UID: \"b3ca1b55-1094-43ae-851a-58441b3cbb66\") " pod="openshift-ingress/e2e-api-a-b888d0-openshift-default-65d785fbfc-q2g4z"
Oct 30 21:09:41.527800 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:09:41.527749    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b3ca1b55-1094-43ae-851a-58441b3cbb66-workload-socket\") pod \"e2e-api-a-b888d0-openshift-default-65d785fbfc-q2g4z\" (UID: \"b3ca1b55-1094-43ae-851a-58441b3cbb66\") " pod="openshift-ingress/e2e-api-a-b888d0-openshift-default-65d785fbfc-q2g4z"
Oct 30 21:09:41.560074 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:09:41.541647    6004 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-b888d0-openshift-default-65d785fbfc-q2g4z"]
Oct 30 21:09:41.564560 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:09:41.564530    6004 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-a-b888d0-openshift-default-dockercfg-rnlkd\""
Oct 30 21:09:41.628903 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:09:41.628870    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mfmjc\" (UniqueName: \"kubernetes.io/projected/b3ca1b55-1094-43ae-851a-58441b3cbb66-kube-api-access-mfmjc\") pod \"e2e-api-a-b888d0-openshift-default-65d785fbfc-q2g4z\" (UID: \"b3ca1b55-1094-43ae-851a-58441b3cbb66\") " pod="openshift-ingress/e2e-api-a-b888d0-openshift-default-65d785fbfc-q2g4z"
Oct 30 21:09:41.629095 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:09:41.629016    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b3ca1b55-1094-43ae-851a-58441b3cbb66-istio-token\") pod \"e2e-api-a-b888d0-openshift-default-65d785fbfc-q2g4z\" (UID: \"b3ca1b55-1094-43ae-851a-58441b3cbb66\") " pod="openshift-ingress/e2e-api-a-b888d0-openshift-default-65d785fbfc-q2g4z"
Oct 30 21:09:41.629095 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:09:41.629091    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b3ca1b55-1094-43ae-851a-58441b3cbb66-workload-certs\") pod \"e2e-api-a-b888d0-openshift-default-65d785fbfc-q2g4z\" (UID: \"b3ca1b55-1094-43ae-851a-58441b3cbb66\") " pod="openshift-ingress/e2e-api-a-b888d0-openshift-default-65d785fbfc-q2g4z"
Oct 30 21:09:41.629178 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:09:41.629121    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b3ca1b55-1094-43ae-851a-58441b3cbb66-workload-socket\") pod \"e2e-api-a-b888d0-openshift-default-65d785fbfc-q2g4z\" (UID: \"b3ca1b55-1094-43ae-851a-58441b3cbb66\") " pod="openshift-ingress/e2e-api-a-b888d0-openshift-default-65d785fbfc-q2g4z"
Oct 30 21:09:41.629227 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:09:41.629199    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b3ca1b55-1094-43ae-851a-58441b3cbb66-istiod-ca-cert\") pod \"e2e-api-a-b888d0-openshift-default-65d785fbfc-q2g4z\" (UID: \"b3ca1b55-1094-43ae-851a-58441b3cbb66\") " pod="openshift-ingress/e2e-api-a-b888d0-openshift-default-65d785fbfc-q2g4z"
Oct 30 21:09:41.629276 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:09:41.629259    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b3ca1b55-1094-43ae-851a-58441b3cbb66-istio-data\") pod \"e2e-api-a-b888d0-openshift-default-65d785fbfc-q2g4z\" (UID: \"b3ca1b55-1094-43ae-851a-58441b3cbb66\") " pod="openshift-ingress/e2e-api-a-b888d0-openshift-default-65d785fbfc-q2g4z"
Oct 30 21:09:41.629310 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:09:41.629291    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b3ca1b55-1094-43ae-851a-58441b3cbb66-istio-podinfo\") pod \"e2e-api-a-b888d0-openshift-default-65d785fbfc-q2g4z\" (UID: \"b3ca1b55-1094-43ae-851a-58441b3cbb66\") " pod="openshift-ingress/e2e-api-a-b888d0-openshift-default-65d785fbfc-q2g4z"
Oct 30 21:09:41.629372 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:09:41.629358    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b3ca1b55-1094-43ae-851a-58441b3cbb66-istio-envoy\") pod \"e2e-api-a-b888d0-openshift-default-65d785fbfc-q2g4z\" (UID: \"b3ca1b55-1094-43ae-851a-58441b3cbb66\") " pod="openshift-ingress/e2e-api-a-b888d0-openshift-default-65d785fbfc-q2g4z"
Oct 30 21:09:41.629412 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:09:41.629388    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b3ca1b55-1094-43ae-851a-58441b3cbb66-credential-socket\") pod \"e2e-api-a-b888d0-openshift-default-65d785fbfc-q2g4z\" (UID: \"b3ca1b55-1094-43ae-851a-58441b3cbb66\") " pod="openshift-ingress/e2e-api-a-b888d0-openshift-default-65d785fbfc-q2g4z"
Oct 30 21:09:41.629576 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:09:41.629558    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b3ca1b55-1094-43ae-851a-58441b3cbb66-workload-certs\") pod \"e2e-api-a-b888d0-openshift-default-65d785fbfc-q2g4z\" (UID: \"b3ca1b55-1094-43ae-851a-58441b3cbb66\") " pod="openshift-ingress/e2e-api-a-b888d0-openshift-default-65d785fbfc-q2g4z"
Oct 30 21:09:41.629661 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:09:41.629644    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b3ca1b55-1094-43ae-851a-58441b3cbb66-workload-socket\") pod \"e2e-api-a-b888d0-openshift-default-65d785fbfc-q2g4z\" (UID: \"b3ca1b55-1094-43ae-851a-58441b3cbb66\") " pod="openshift-ingress/e2e-api-a-b888d0-openshift-default-65d785fbfc-q2g4z"
Oct 30 21:09:41.629715 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:09:41.629697    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b3ca1b55-1094-43ae-851a-58441b3cbb66-istio-data\") pod \"e2e-api-a-b888d0-openshift-default-65d785fbfc-q2g4z\" (UID: \"b3ca1b55-1094-43ae-851a-58441b3cbb66\") " pod="openshift-ingress/e2e-api-a-b888d0-openshift-default-65d785fbfc-q2g4z"
Oct 30 21:09:41.629813 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:09:41.629785    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b3ca1b55-1094-43ae-851a-58441b3cbb66-credential-socket\") pod \"e2e-api-a-b888d0-openshift-default-65d785fbfc-q2g4z\" (UID: \"b3ca1b55-1094-43ae-851a-58441b3cbb66\") " pod="openshift-ingress/e2e-api-a-b888d0-openshift-default-65d785fbfc-q2g4z"
Oct 30 21:09:41.629975 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:09:41.629957    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b3ca1b55-1094-43ae-851a-58441b3cbb66-istiod-ca-cert\") pod \"e2e-api-a-b888d0-openshift-default-65d785fbfc-q2g4z\" (UID: \"b3ca1b55-1094-43ae-851a-58441b3cbb66\") " pod="openshift-ingress/e2e-api-a-b888d0-openshift-default-65d785fbfc-q2g4z"
Oct 30 21:09:41.631683 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:09:41.631654    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b3ca1b55-1094-43ae-851a-58441b3cbb66-istio-envoy\") pod \"e2e-api-a-b888d0-openshift-default-65d785fbfc-q2g4z\" (UID: \"b3ca1b55-1094-43ae-851a-58441b3cbb66\") " pod="openshift-ingress/e2e-api-a-b888d0-openshift-default-65d785fbfc-q2g4z"
Oct 30 21:09:41.631883 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:09:41.631865    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b3ca1b55-1094-43ae-851a-58441b3cbb66-istio-podinfo\") pod \"e2e-api-a-b888d0-openshift-default-65d785fbfc-q2g4z\" (UID: \"b3ca1b55-1094-43ae-851a-58441b3cbb66\") " pod="openshift-ingress/e2e-api-a-b888d0-openshift-default-65d785fbfc-q2g4z"
Oct 30 21:09:41.690843 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:09:41.690811    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b3ca1b55-1094-43ae-851a-58441b3cbb66-istio-token\") pod \"e2e-api-a-b888d0-openshift-default-65d785fbfc-q2g4z\" (UID: \"b3ca1b55-1094-43ae-851a-58441b3cbb66\") " pod="openshift-ingress/e2e-api-a-b888d0-openshift-default-65d785fbfc-q2g4z"
Oct 30 21:09:41.690994 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:09:41.690938    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mfmjc\" (UniqueName: \"kubernetes.io/projected/b3ca1b55-1094-43ae-851a-58441b3cbb66-kube-api-access-mfmjc\") pod \"e2e-api-a-b888d0-openshift-default-65d785fbfc-q2g4z\" (UID: \"b3ca1b55-1094-43ae-851a-58441b3cbb66\") " pod="openshift-ingress/e2e-api-a-b888d0-openshift-default-65d785fbfc-q2g4z"
Oct 30 21:09:41.729859 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:09:41.729829    6004 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-b888d0-openshift-default-65d785fbfc-q2g4z"
Oct 30 21:09:42.193347 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:09:42.193318    6004 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-b888d0-openshift-default-65d785fbfc-q2g4z"]
Oct 30 21:09:42.194236 ip-10-0-138-85 kubenswrapper[6004]: W1030 21:09:42.194213    6004 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb3ca1b55_1094_43ae_851a_58441b3cbb66.slice/crio-cd2f39189d39e7735de7773672eea3eef5e3662a844ec24c17c865c887a8b719 WatchSource:0}: Error finding container cd2f39189d39e7735de7773672eea3eef5e3662a844ec24c17c865c887a8b719: Status 404 returned error can't find the container with id cd2f39189d39e7735de7773672eea3eef5e3662a844ec24c17c865c887a8b719
Oct 30 21:09:42.196894 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:09:42.196859    6004 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 21:09:42.196974 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:09:42.196929    6004 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 21:09:42.196974 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:09:42.196956    6004 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 21:09:42.727491 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:09:42.727458    6004 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-9926f7-795755f5d8-p2slb"
Oct 30 21:09:42.766043 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:09:42.765997    6004 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-b888d0-openshift-default-65d785fbfc-q2g4z" event={"ID":"b3ca1b55-1094-43ae-851a-58441b3cbb66","Type":"ContainerStarted","Data":"d59ec281660ec50fa0597ca05f39d8c79f598b3fd7318b52d91a66b60dff6202"}
Oct 30 21:09:42.766254 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:09:42.766082    6004 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-b888d0-openshift-default-65d785fbfc-q2g4z" event={"ID":"b3ca1b55-1094-43ae-851a-58441b3cbb66","Type":"ContainerStarted","Data":"cd2f39189d39e7735de7773672eea3eef5e3662a844ec24c17c865c887a8b719"}
Oct 30 21:09:42.983667 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:09:42.983550    6004 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-api-a-b888d0-openshift-default-65d785fbfc-q2g4z" podStartSLOduration=1.983533844 podStartE2EDuration="1.983533844s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:09:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:09:42.980459961 +0000 UTC m=+1888.900246081" watchObservedRunningTime="2026-10-30 21:09:42.983533844 +0000 UTC m=+1888.903319967"
Oct 30 21:09:43.730342 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:09:43.730304    6004 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-b888d0-openshift-default-65d785fbfc-q2g4z"
Oct 30 21:09:43.732342 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:09:43.732312    6004 patch_prober.go:29] interesting pod/e2e-api-a-b888d0-openshift-default-65d785fbfc-q2g4z container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.100:15021/healthz/ready\": dial tcp 10.132.0.100:15021: connect: connection refused" start-of-body=
Oct 30 21:09:43.732457 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:09:43.732364    6004 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-b888d0-openshift-default-65d785fbfc-q2g4z" podUID="b3ca1b55-1094-43ae-851a-58441b3cbb66" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.100:15021/healthz/ready\": dial tcp 10.132.0.100:15021: connect: connection refused"
Oct 30 21:09:44.295624 ip-10-0-138-85 kubenswrapper[6004]: E1030 21:09:44.295589    6004 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-zz4wr" containerName="extractor"
Oct 30 21:09:44.730558 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:09:44.730521    6004 patch_prober.go:29] interesting pod/e2e-api-a-b888d0-openshift-default-65d785fbfc-q2g4z container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.100:15021/healthz/ready\": dial tcp 10.132.0.100:15021: connect: connection refused" start-of-body=
Oct 30 21:09:44.730961 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:09:44.730587    6004 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-b888d0-openshift-default-65d785fbfc-q2g4z" podUID="b3ca1b55-1094-43ae-851a-58441b3cbb66" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.100:15021/healthz/ready\": dial tcp 10.132.0.100:15021: connect: connection refused"
Oct 30 21:09:45.730381 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:09:45.730338    6004 patch_prober.go:29] interesting pod/e2e-api-a-b888d0-openshift-default-65d785fbfc-q2g4z container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.100:15021/healthz/ready\": dial tcp 10.132.0.100:15021: connect: connection refused" start-of-body=
Oct 30 21:09:45.730531 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:09:45.730408    6004 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-b888d0-openshift-default-65d785fbfc-q2g4z" podUID="b3ca1b55-1094-43ae-851a-58441b3cbb66" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.100:15021/healthz/ready\": dial tcp 10.132.0.100:15021: connect: connection refused"
Oct 30 21:09:46.730388 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:09:46.730351    6004 patch_prober.go:29] interesting pod/e2e-api-a-b888d0-openshift-default-65d785fbfc-q2g4z container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.100:15021/healthz/ready\": dial tcp 10.132.0.100:15021: connect: connection refused" start-of-body=
Oct 30 21:09:46.730981 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:09:46.730947    6004 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-b888d0-openshift-default-65d785fbfc-q2g4z" podUID="b3ca1b55-1094-43ae-851a-58441b3cbb66" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.100:15021/healthz/ready\": dial tcp 10.132.0.100:15021: connect: connection refused"
Oct 30 21:09:47.730807 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:09:47.730766    6004 patch_prober.go:29] interesting pod/e2e-api-a-b888d0-openshift-default-65d785fbfc-q2g4z container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.100:15021/healthz/ready\": dial tcp 10.132.0.100:15021: connect: connection refused" start-of-body=
Oct 30 21:09:47.731214 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:09:47.730832    6004 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-b888d0-openshift-default-65d785fbfc-q2g4z" podUID="b3ca1b55-1094-43ae-851a-58441b3cbb66" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.100:15021/healthz/ready\": dial tcp 10.132.0.100:15021: connect: connection refused"
Oct 30 21:09:48.735226 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:09:48.735194    6004 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-b888d0-openshift-default-65d785fbfc-q2g4z"
Oct 30 21:09:48.735684 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:09:48.735662    6004 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-b888d0-openshift-default-65d785fbfc-q2g4z"
Oct 30 21:09:48.736442 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:09:48.736421    6004 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-b888d0-openshift-default-65d785fbfc-q2g4z"
Oct 30 21:10:06.220766 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:10:06.220682    6004 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w5-2b425d-openshift-default-f547dbcbf-mjdrq"]
Oct 30 21:10:06.221240 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:10:06.220962    6004 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w5-2b425d-openshift-default-f547dbcbf-mjdrq" podUID="ebe091c6-036b-416b-9e66-a9f0cb3171a0" containerName="istio-proxy" containerID="cri-o://72d489b8ffaf76e28814caffac28b5964edf7054bc0021193df523600cdde783" gracePeriod=30
Oct 30 21:10:06.274666 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:10:06.274622    6004 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w0-781058-openshift-default-55fb495b7-4rkzd"]
Oct 30 21:10:06.274942 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:10:06.274890    6004 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w0-781058-openshift-default-55fb495b7-4rkzd" podUID="9b820c81-5ae6-459a-9510-72c234e98679" containerName="istio-proxy" containerID="cri-o://a19adf1687ca4090f6961a126e29f88f77d847c9cb4d358885128692cafd4c22" gracePeriod=30
Oct 30 21:10:06.371399 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:10:06.369495    6004 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w3-682999-openshift-default-54dcb797b5-n25td"]
Oct 30 21:10:06.371399 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:10:06.369745    6004 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w3-682999-openshift-default-54dcb797b5-n25td" podUID="a5e6ce52-9255-48ba-a723-2628da49fdd2" containerName="istio-proxy" containerID="cri-o://9738f5c5b5cff2375d615f2f91514e6f72e0508e01bacdbd184c5b5cb86b2e35" gracePeriod=30
Oct 30 21:10:07.679436 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:10:07.679395    6004 patch_prober.go:29] interesting pod/e2e-worker-w3-682999-openshift-default-54dcb797b5-n25td container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Oct 30 21:10:07.679841 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:10:07.679458    6004 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w3-682999-openshift-default-54dcb797b5-n25td" podUID="a5e6ce52-9255-48ba-a723-2628da49fdd2" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 30 21:10:11.377282 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:10:11.377247    6004 patch_prober.go:29] interesting pod/e2e-worker-w0-781058-openshift-default-55fb495b7-4rkzd container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.75:15021/healthz/ready\": dial tcp 10.132.0.75:15021: connect: connection refused" start-of-body=
Oct 30 21:10:11.377744 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:10:11.377320    6004 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w0-781058-openshift-default-55fb495b7-4rkzd" podUID="9b820c81-5ae6-459a-9510-72c234e98679" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.75:15021/healthz/ready\": dial tcp 10.132.0.75:15021: connect: connection refused"
Oct 30 21:10:11.539516 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:10:11.539493    6004 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-2b425d-openshift-default-f547dbcbf-mjdrq"
Oct 30 21:10:11.547276 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:10:11.547251    6004 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-781058-openshift-default-55fb495b7-4rkzd"
Oct 30 21:10:11.627322 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:10:11.627280    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/9b820c81-5ae6-459a-9510-72c234e98679-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9b820c81-5ae6-459a-9510-72c234e98679-istiod-ca-cert\") pod \"9b820c81-5ae6-459a-9510-72c234e98679\" (UID: \"9b820c81-5ae6-459a-9510-72c234e98679\") "
Oct 30 21:10:11.627522 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:10:11.627392    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/ebe091c6-036b-416b-9e66-a9f0cb3171a0-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ebe091c6-036b-416b-9e66-a9f0cb3171a0-workload-certs\") pod \"ebe091c6-036b-416b-9e66-a9f0cb3171a0\" (UID: \"ebe091c6-036b-416b-9e66-a9f0cb3171a0\") "
Oct 30 21:10:11.627522 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:10:11.627425    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/ebe091c6-036b-416b-9e66-a9f0cb3171a0-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ebe091c6-036b-416b-9e66-a9f0cb3171a0-credential-socket\") pod \"ebe091c6-036b-416b-9e66-a9f0cb3171a0\" (UID: \"ebe091c6-036b-416b-9e66-a9f0cb3171a0\") "
Oct 30 21:10:11.627522 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:10:11.627455    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/9b820c81-5ae6-459a-9510-72c234e98679-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9b820c81-5ae6-459a-9510-72c234e98679-istio-envoy\") pod \"9b820c81-5ae6-459a-9510-72c234e98679\" (UID: \"9b820c81-5ae6-459a-9510-72c234e98679\") "
Oct 30 21:10:11.627522 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:10:11.627512    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/ebe091c6-036b-416b-9e66-a9f0cb3171a0-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ebe091c6-036b-416b-9e66-a9f0cb3171a0-istio-envoy\") pod \"ebe091c6-036b-416b-9e66-a9f0cb3171a0\" (UID: \"ebe091c6-036b-416b-9e66-a9f0cb3171a0\") "
Oct 30 21:10:11.627746 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:10:11.627534    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/9b820c81-5ae6-459a-9510-72c234e98679-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9b820c81-5ae6-459a-9510-72c234e98679-workload-certs\") pod \"9b820c81-5ae6-459a-9510-72c234e98679\" (UID: \"9b820c81-5ae6-459a-9510-72c234e98679\") "
Oct 30 21:10:11.627746 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:10:11.627569    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/ebe091c6-036b-416b-9e66-a9f0cb3171a0-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ebe091c6-036b-416b-9e66-a9f0cb3171a0-workload-socket\") pod \"ebe091c6-036b-416b-9e66-a9f0cb3171a0\" (UID: \"ebe091c6-036b-416b-9e66-a9f0cb3171a0\") "
Oct 30 21:10:11.627746 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:10:11.627601    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/ebe091c6-036b-416b-9e66-a9f0cb3171a0-istio-token\" (UniqueName: \"kubernetes.io/projected/ebe091c6-036b-416b-9e66-a9f0cb3171a0-istio-token\") pod \"ebe091c6-036b-416b-9e66-a9f0cb3171a0\" (UID: \"ebe091c6-036b-416b-9e66-a9f0cb3171a0\") "
Oct 30 21:10:11.627746 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:10:11.627709    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/ebe091c6-036b-416b-9e66-a9f0cb3171a0-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ebe091c6-036b-416b-9e66-a9f0cb3171a0-istio-data\") pod \"ebe091c6-036b-416b-9e66-a9f0cb3171a0\" (UID: \"ebe091c6-036b-416b-9e66-a9f0cb3171a0\") "
Oct 30 21:10:11.627951 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:10:11.627713    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ebe091c6-036b-416b-9e66-a9f0cb3171a0-workload-certs" pod "ebe091c6-036b-416b-9e66-a9f0cb3171a0" (UID: "ebe091c6-036b-416b-9e66-a9f0cb3171a0"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:10:11.627951 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:10:11.627749    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/9b820c81-5ae6-459a-9510-72c234e98679-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9b820c81-5ae6-459a-9510-72c234e98679-istio-data\") pod \"9b820c81-5ae6-459a-9510-72c234e98679\" (UID: \"9b820c81-5ae6-459a-9510-72c234e98679\") "
Oct 30 21:10:11.627951 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:10:11.627790    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ebe091c6-036b-416b-9e66-a9f0cb3171a0-credential-socket" pod "ebe091c6-036b-416b-9e66-a9f0cb3171a0" (UID: "ebe091c6-036b-416b-9e66-a9f0cb3171a0"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:10:11.627951 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:10:11.627827    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9b820c81-5ae6-459a-9510-72c234e98679-istiod-ca-cert" pod "9b820c81-5ae6-459a-9510-72c234e98679" (UID: "9b820c81-5ae6-459a-9510-72c234e98679"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:10:11.627951 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:10:11.627840    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/9b820c81-5ae6-459a-9510-72c234e98679-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9b820c81-5ae6-459a-9510-72c234e98679-workload-socket\") pod \"9b820c81-5ae6-459a-9510-72c234e98679\" (UID: \"9b820c81-5ae6-459a-9510-72c234e98679\") "
Oct 30 21:10:11.627951 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:10:11.627893    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/9b820c81-5ae6-459a-9510-72c234e98679-kube-api-access-xs7sx\" (UniqueName: \"kubernetes.io/projected/9b820c81-5ae6-459a-9510-72c234e98679-kube-api-access-xs7sx\") pod \"9b820c81-5ae6-459a-9510-72c234e98679\" (UID: \"9b820c81-5ae6-459a-9510-72c234e98679\") "
Oct 30 21:10:11.627951 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:10:11.627922    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/9b820c81-5ae6-459a-9510-72c234e98679-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9b820c81-5ae6-459a-9510-72c234e98679-credential-socket\") pod \"9b820c81-5ae6-459a-9510-72c234e98679\" (UID: \"9b820c81-5ae6-459a-9510-72c234e98679\") "
Oct 30 21:10:11.628332 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:10:11.627955    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/ebe091c6-036b-416b-9e66-a9f0cb3171a0-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ebe091c6-036b-416b-9e66-a9f0cb3171a0-istiod-ca-cert\") pod \"ebe091c6-036b-416b-9e66-a9f0cb3171a0\" (UID: \"ebe091c6-036b-416b-9e66-a9f0cb3171a0\") "
Oct 30 21:10:11.628332 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:10:11.627954    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9b820c81-5ae6-459a-9510-72c234e98679-istio-data" pod "9b820c81-5ae6-459a-9510-72c234e98679" (UID: "9b820c81-5ae6-459a-9510-72c234e98679"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:10:11.628332 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:10:11.627995    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/ebe091c6-036b-416b-9e66-a9f0cb3171a0-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ebe091c6-036b-416b-9e66-a9f0cb3171a0-istio-podinfo\") pod \"ebe091c6-036b-416b-9e66-a9f0cb3171a0\" (UID: \"ebe091c6-036b-416b-9e66-a9f0cb3171a0\") "
Oct 30 21:10:11.628332 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:10:11.628009    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ebe091c6-036b-416b-9e66-a9f0cb3171a0-workload-socket" pod "ebe091c6-036b-416b-9e66-a9f0cb3171a0" (UID: "ebe091c6-036b-416b-9e66-a9f0cb3171a0"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:10:11.628332 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:10:11.628024    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/ebe091c6-036b-416b-9e66-a9f0cb3171a0-kube-api-access-dl56l\" (UniqueName: \"kubernetes.io/projected/ebe091c6-036b-416b-9e66-a9f0cb3171a0-kube-api-access-dl56l\") pod \"ebe091c6-036b-416b-9e66-a9f0cb3171a0\" (UID: \"ebe091c6-036b-416b-9e66-a9f0cb3171a0\") "
Oct 30 21:10:11.628332 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:10:11.628078    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/9b820c81-5ae6-459a-9510-72c234e98679-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9b820c81-5ae6-459a-9510-72c234e98679-istio-podinfo\") pod \"9b820c81-5ae6-459a-9510-72c234e98679\" (UID: \"9b820c81-5ae6-459a-9510-72c234e98679\") "
Oct 30 21:10:11.628332 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:10:11.628105    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ebe091c6-036b-416b-9e66-a9f0cb3171a0-istio-data" pod "ebe091c6-036b-416b-9e66-a9f0cb3171a0" (UID: "ebe091c6-036b-416b-9e66-a9f0cb3171a0"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:10:11.628332 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:10:11.628138    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/9b820c81-5ae6-459a-9510-72c234e98679-istio-token\" (UniqueName: \"kubernetes.io/projected/9b820c81-5ae6-459a-9510-72c234e98679-istio-token\") pod \"9b820c81-5ae6-459a-9510-72c234e98679\" (UID: \"9b820c81-5ae6-459a-9510-72c234e98679\") "
Oct 30 21:10:11.628332 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:10:11.628278    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9b820c81-5ae6-459a-9510-72c234e98679-workload-certs" pod "9b820c81-5ae6-459a-9510-72c234e98679" (UID: "9b820c81-5ae6-459a-9510-72c234e98679"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:10:11.628332 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:10:11.628318    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ebe091c6-036b-416b-9e66-a9f0cb3171a0-istiod-ca-cert" pod "ebe091c6-036b-416b-9e66-a9f0cb3171a0" (UID: "ebe091c6-036b-416b-9e66-a9f0cb3171a0"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:10:11.628835 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:10:11.628555    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9b820c81-5ae6-459a-9510-72c234e98679-credential-socket" pod "9b820c81-5ae6-459a-9510-72c234e98679" (UID: "9b820c81-5ae6-459a-9510-72c234e98679"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:10:11.628835 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:10:11.628826    6004 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9b820c81-5ae6-459a-9510-72c234e98679-credential-socket\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:10:11.628941 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:10:11.628846    6004 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ebe091c6-036b-416b-9e66-a9f0cb3171a0-istiod-ca-cert\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:10:11.628941 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:10:11.628860    6004 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9b820c81-5ae6-459a-9510-72c234e98679-istiod-ca-cert\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:10:11.628941 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:10:11.628877    6004 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ebe091c6-036b-416b-9e66-a9f0cb3171a0-workload-certs\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:10:11.628941 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:10:11.628891    6004 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ebe091c6-036b-416b-9e66-a9f0cb3171a0-credential-socket\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:10:11.628941 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:10:11.628905    6004 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9b820c81-5ae6-459a-9510-72c234e98679-workload-certs\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:10:11.628941 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:10:11.628919    6004 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ebe091c6-036b-416b-9e66-a9f0cb3171a0-workload-socket\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:10:11.628941 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:10:11.628933    6004 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ebe091c6-036b-416b-9e66-a9f0cb3171a0-istio-data\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:10:11.629322 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:10:11.628947    6004 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9b820c81-5ae6-459a-9510-72c234e98679-istio-data\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:10:11.629427 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:10:11.629401    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9b820c81-5ae6-459a-9510-72c234e98679-workload-socket" pod "9b820c81-5ae6-459a-9510-72c234e98679" (UID: "9b820c81-5ae6-459a-9510-72c234e98679"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:10:11.630532 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:10:11.630489    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9b820c81-5ae6-459a-9510-72c234e98679-istio-envoy" pod "9b820c81-5ae6-459a-9510-72c234e98679" (UID: "9b820c81-5ae6-459a-9510-72c234e98679"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:10:11.630793 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:10:11.630758    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/ebe091c6-036b-416b-9e66-a9f0cb3171a0-istio-podinfo" pod "ebe091c6-036b-416b-9e66-a9f0cb3171a0" (UID: "ebe091c6-036b-416b-9e66-a9f0cb3171a0"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 21:10:11.631230 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:10:11.631178    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9b820c81-5ae6-459a-9510-72c234e98679-kube-api-access-xs7sx" pod "9b820c81-5ae6-459a-9510-72c234e98679" (UID: "9b820c81-5ae6-459a-9510-72c234e98679"). InnerVolumeSpecName "kube-api-access-xs7sx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:10:11.631230 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:10:11.631189    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ebe091c6-036b-416b-9e66-a9f0cb3171a0-istio-token" pod "ebe091c6-036b-416b-9e66-a9f0cb3171a0" (UID: "ebe091c6-036b-416b-9e66-a9f0cb3171a0"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:10:11.631371 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:10:11.631307    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9b820c81-5ae6-459a-9510-72c234e98679-istio-token" pod "9b820c81-5ae6-459a-9510-72c234e98679" (UID: "9b820c81-5ae6-459a-9510-72c234e98679"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:10:11.631526 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:10:11.631497    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/9b820c81-5ae6-459a-9510-72c234e98679-istio-podinfo" pod "9b820c81-5ae6-459a-9510-72c234e98679" (UID: "9b820c81-5ae6-459a-9510-72c234e98679"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 21:10:11.631885 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:10:11.631868    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ebe091c6-036b-416b-9e66-a9f0cb3171a0-kube-api-access-dl56l" pod "ebe091c6-036b-416b-9e66-a9f0cb3171a0" (UID: "ebe091c6-036b-416b-9e66-a9f0cb3171a0"). InnerVolumeSpecName "kube-api-access-dl56l". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:10:11.632191 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:10:11.632170    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ebe091c6-036b-416b-9e66-a9f0cb3171a0-istio-envoy" pod "ebe091c6-036b-416b-9e66-a9f0cb3171a0" (UID: "ebe091c6-036b-416b-9e66-a9f0cb3171a0"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:10:11.730978 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:10:11.730941    6004 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9b820c81-5ae6-459a-9510-72c234e98679-istio-envoy\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:10:11.730978 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:10:11.730972    6004 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ebe091c6-036b-416b-9e66-a9f0cb3171a0-istio-envoy\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:10:11.730978 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:10:11.730985    6004 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ebe091c6-036b-416b-9e66-a9f0cb3171a0-istio-token\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:10:11.731226 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:10:11.730998    6004 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9b820c81-5ae6-459a-9510-72c234e98679-workload-socket\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:10:11.731226 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:10:11.731010    6004 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xs7sx\" (UniqueName: \"kubernetes.io/projected/9b820c81-5ae6-459a-9510-72c234e98679-kube-api-access-xs7sx\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:10:11.731226 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:10:11.731025    6004 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ebe091c6-036b-416b-9e66-a9f0cb3171a0-istio-podinfo\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:10:11.731226 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:10:11.731038    6004 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dl56l\" (UniqueName: \"kubernetes.io/projected/ebe091c6-036b-416b-9e66-a9f0cb3171a0-kube-api-access-dl56l\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:10:11.731226 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:10:11.731065    6004 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9b820c81-5ae6-459a-9510-72c234e98679-istio-podinfo\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:10:11.731226 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:10:11.731073    6004 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9b820c81-5ae6-459a-9510-72c234e98679-istio-token\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:10:11.973772 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:10:11.973734    6004 generic.go:356] "Generic (PLEG): container finished" podID="9b820c81-5ae6-459a-9510-72c234e98679" containerID="a19adf1687ca4090f6961a126e29f88f77d847c9cb4d358885128692cafd4c22" exitCode=0
Oct 30 21:10:11.973953 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:10:11.973787    6004 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-781058-openshift-default-55fb495b7-4rkzd"
Oct 30 21:10:11.973953 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:10:11.973816    6004 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-781058-openshift-default-55fb495b7-4rkzd" event={"ID":"9b820c81-5ae6-459a-9510-72c234e98679","Type":"ContainerDied","Data":"a19adf1687ca4090f6961a126e29f88f77d847c9cb4d358885128692cafd4c22"}
Oct 30 21:10:11.973953 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:10:11.973889    6004 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-781058-openshift-default-55fb495b7-4rkzd" event={"ID":"9b820c81-5ae6-459a-9510-72c234e98679","Type":"ContainerDied","Data":"87dacdf2af41696797001eb1740c8f56119368e19e7f6fdba64490feff32b4e7"}
Oct 30 21:10:11.973953 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:10:11.973924    6004 scope.go:122] "RemoveContainer" containerID="a19adf1687ca4090f6961a126e29f88f77d847c9cb4d358885128692cafd4c22"
Oct 30 21:10:11.990784 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:10:11.990454    6004 generic.go:356] "Generic (PLEG): container finished" podID="ebe091c6-036b-416b-9e66-a9f0cb3171a0" containerID="72d489b8ffaf76e28814caffac28b5964edf7054bc0021193df523600cdde783" exitCode=0
Oct 30 21:10:11.990784 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:10:11.990518    6004 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-2b425d-openshift-default-f547dbcbf-mjdrq"
Oct 30 21:10:11.990784 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:10:11.990702    6004 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-2b425d-openshift-default-f547dbcbf-mjdrq" event={"ID":"ebe091c6-036b-416b-9e66-a9f0cb3171a0","Type":"ContainerDied","Data":"72d489b8ffaf76e28814caffac28b5964edf7054bc0021193df523600cdde783"}
Oct 30 21:10:11.990784 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:10:11.990744    6004 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-2b425d-openshift-default-f547dbcbf-mjdrq" event={"ID":"ebe091c6-036b-416b-9e66-a9f0cb3171a0","Type":"ContainerDied","Data":"ff75d46863a3f9fb952e8cf2bea46dc3fc30f9b739752876b70679793db01f78"}
Oct 30 21:10:11.993351 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:10:11.993239    6004 generic.go:356] "Generic (PLEG): container finished" podID="a5e6ce52-9255-48ba-a723-2628da49fdd2" containerID="9738f5c5b5cff2375d615f2f91514e6f72e0508e01bacdbd184c5b5cb86b2e35" exitCode=0
Oct 30 21:10:11.993351 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:10:11.993290    6004 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-682999-openshift-default-54dcb797b5-n25td" event={"ID":"a5e6ce52-9255-48ba-a723-2628da49fdd2","Type":"ContainerDied","Data":"9738f5c5b5cff2375d615f2f91514e6f72e0508e01bacdbd184c5b5cb86b2e35"}
Oct 30 21:10:12.005251 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:10:12.005166    6004 scope.go:122] "RemoveContainer" containerID="a19adf1687ca4090f6961a126e29f88f77d847c9cb4d358885128692cafd4c22"
Oct 30 21:10:12.005520 ip-10-0-138-85 kubenswrapper[6004]: E1030 21:10:12.005497    6004 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a19adf1687ca4090f6961a126e29f88f77d847c9cb4d358885128692cafd4c22\": container with ID starting with a19adf1687ca4090f6961a126e29f88f77d847c9cb4d358885128692cafd4c22 not found: ID does not exist" containerID="a19adf1687ca4090f6961a126e29f88f77d847c9cb4d358885128692cafd4c22"
Oct 30 21:10:12.005580 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:10:12.005528    6004 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a19adf1687ca4090f6961a126e29f88f77d847c9cb4d358885128692cafd4c22"} err="failed to get container status \"a19adf1687ca4090f6961a126e29f88f77d847c9cb4d358885128692cafd4c22\": rpc error: code = NotFound desc = could not find container \"a19adf1687ca4090f6961a126e29f88f77d847c9cb4d358885128692cafd4c22\": container with ID starting with a19adf1687ca4090f6961a126e29f88f77d847c9cb4d358885128692cafd4c22 not found: ID does not exist"
Oct 30 21:10:12.005580 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:10:12.005549    6004 scope.go:122] "RemoveContainer" containerID="72d489b8ffaf76e28814caffac28b5964edf7054bc0021193df523600cdde783"
Oct 30 21:10:12.017852 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:10:12.017830    6004 scope.go:122] "RemoveContainer" containerID="72d489b8ffaf76e28814caffac28b5964edf7054bc0021193df523600cdde783"
Oct 30 21:10:12.018219 ip-10-0-138-85 kubenswrapper[6004]: E1030 21:10:12.018191    6004 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"72d489b8ffaf76e28814caffac28b5964edf7054bc0021193df523600cdde783\": container with ID starting with 72d489b8ffaf76e28814caffac28b5964edf7054bc0021193df523600cdde783 not found: ID does not exist" containerID="72d489b8ffaf76e28814caffac28b5964edf7054bc0021193df523600cdde783"
Oct 30 21:10:12.018311 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:10:12.018230    6004 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"72d489b8ffaf76e28814caffac28b5964edf7054bc0021193df523600cdde783"} err="failed to get container status \"72d489b8ffaf76e28814caffac28b5964edf7054bc0021193df523600cdde783\": rpc error: code = NotFound desc = could not find container \"72d489b8ffaf76e28814caffac28b5964edf7054bc0021193df523600cdde783\": container with ID starting with 72d489b8ffaf76e28814caffac28b5964edf7054bc0021193df523600cdde783 not found: ID does not exist"
Oct 30 21:10:12.047615 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:10:12.047593    6004 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-682999-openshift-default-54dcb797b5-n25td"
Oct 30 21:10:12.135734 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:10:12.135699    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/a5e6ce52-9255-48ba-a723-2628da49fdd2-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a5e6ce52-9255-48ba-a723-2628da49fdd2-istiod-ca-cert\") pod \"a5e6ce52-9255-48ba-a723-2628da49fdd2\" (UID: \"a5e6ce52-9255-48ba-a723-2628da49fdd2\") "
Oct 30 21:10:12.136342 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:10:12.135776    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/a5e6ce52-9255-48ba-a723-2628da49fdd2-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a5e6ce52-9255-48ba-a723-2628da49fdd2-workload-certs\") pod \"a5e6ce52-9255-48ba-a723-2628da49fdd2\" (UID: \"a5e6ce52-9255-48ba-a723-2628da49fdd2\") "
Oct 30 21:10:12.136342 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:10:12.135808    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/a5e6ce52-9255-48ba-a723-2628da49fdd2-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a5e6ce52-9255-48ba-a723-2628da49fdd2-istio-data\") pod \"a5e6ce52-9255-48ba-a723-2628da49fdd2\" (UID: \"a5e6ce52-9255-48ba-a723-2628da49fdd2\") "
Oct 30 21:10:12.136342 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:10:12.135875    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/a5e6ce52-9255-48ba-a723-2628da49fdd2-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a5e6ce52-9255-48ba-a723-2628da49fdd2-istio-envoy\") pod \"a5e6ce52-9255-48ba-a723-2628da49fdd2\" (UID: \"a5e6ce52-9255-48ba-a723-2628da49fdd2\") "
Oct 30 21:10:12.136342 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:10:12.135909    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/a5e6ce52-9255-48ba-a723-2628da49fdd2-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a5e6ce52-9255-48ba-a723-2628da49fdd2-workload-socket\") pod \"a5e6ce52-9255-48ba-a723-2628da49fdd2\" (UID: \"a5e6ce52-9255-48ba-a723-2628da49fdd2\") "
Oct 30 21:10:12.136342 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:10:12.135957    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/a5e6ce52-9255-48ba-a723-2628da49fdd2-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a5e6ce52-9255-48ba-a723-2628da49fdd2-istio-podinfo\") pod \"a5e6ce52-9255-48ba-a723-2628da49fdd2\" (UID: \"a5e6ce52-9255-48ba-a723-2628da49fdd2\") "
Oct 30 21:10:12.136342 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:10:12.136016    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/a5e6ce52-9255-48ba-a723-2628da49fdd2-kube-api-access-npzl8\" (UniqueName: \"kubernetes.io/projected/a5e6ce52-9255-48ba-a723-2628da49fdd2-kube-api-access-npzl8\") pod \"a5e6ce52-9255-48ba-a723-2628da49fdd2\" (UID: \"a5e6ce52-9255-48ba-a723-2628da49fdd2\") "
Oct 30 21:10:12.136342 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:10:12.136179    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a5e6ce52-9255-48ba-a723-2628da49fdd2-workload-certs" pod "a5e6ce52-9255-48ba-a723-2628da49fdd2" (UID: "a5e6ce52-9255-48ba-a723-2628da49fdd2"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:10:12.136342 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:10:12.136201    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a5e6ce52-9255-48ba-a723-2628da49fdd2-istio-data" pod "a5e6ce52-9255-48ba-a723-2628da49fdd2" (UID: "a5e6ce52-9255-48ba-a723-2628da49fdd2"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:10:12.136342 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:10:12.136249    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a5e6ce52-9255-48ba-a723-2628da49fdd2-istiod-ca-cert" pod "a5e6ce52-9255-48ba-a723-2628da49fdd2" (UID: "a5e6ce52-9255-48ba-a723-2628da49fdd2"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:10:12.136342 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:10:12.136292    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a5e6ce52-9255-48ba-a723-2628da49fdd2-workload-socket" pod "a5e6ce52-9255-48ba-a723-2628da49fdd2" (UID: "a5e6ce52-9255-48ba-a723-2628da49fdd2"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:10:12.136846 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:10:12.136523    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/a5e6ce52-9255-48ba-a723-2628da49fdd2-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a5e6ce52-9255-48ba-a723-2628da49fdd2-credential-socket\") pod \"a5e6ce52-9255-48ba-a723-2628da49fdd2\" (UID: \"a5e6ce52-9255-48ba-a723-2628da49fdd2\") "
Oct 30 21:10:12.136846 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:10:12.136627    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/a5e6ce52-9255-48ba-a723-2628da49fdd2-istio-token\" (UniqueName: \"kubernetes.io/projected/a5e6ce52-9255-48ba-a723-2628da49fdd2-istio-token\") pod \"a5e6ce52-9255-48ba-a723-2628da49fdd2\" (UID: \"a5e6ce52-9255-48ba-a723-2628da49fdd2\") "
Oct 30 21:10:12.136846 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:10:12.136746    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a5e6ce52-9255-48ba-a723-2628da49fdd2-credential-socket" pod "a5e6ce52-9255-48ba-a723-2628da49fdd2" (UID: "a5e6ce52-9255-48ba-a723-2628da49fdd2"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:10:12.137260 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:10:12.137241    6004 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a5e6ce52-9255-48ba-a723-2628da49fdd2-istiod-ca-cert\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:10:12.137364 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:10:12.137265    6004 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a5e6ce52-9255-48ba-a723-2628da49fdd2-workload-certs\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:10:12.137364 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:10:12.137278    6004 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a5e6ce52-9255-48ba-a723-2628da49fdd2-istio-data\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:10:12.137364 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:10:12.137291    6004 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a5e6ce52-9255-48ba-a723-2628da49fdd2-workload-socket\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:10:12.137364 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:10:12.137303    6004 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a5e6ce52-9255-48ba-a723-2628da49fdd2-credential-socket\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:10:12.138381 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:10:12.138356    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a5e6ce52-9255-48ba-a723-2628da49fdd2-istio-envoy" pod "a5e6ce52-9255-48ba-a723-2628da49fdd2" (UID: "a5e6ce52-9255-48ba-a723-2628da49fdd2"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:10:12.138482 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:10:12.138357    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/a5e6ce52-9255-48ba-a723-2628da49fdd2-istio-podinfo" pod "a5e6ce52-9255-48ba-a723-2628da49fdd2" (UID: "a5e6ce52-9255-48ba-a723-2628da49fdd2"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 21:10:12.138653 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:10:12.138631    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a5e6ce52-9255-48ba-a723-2628da49fdd2-kube-api-access-npzl8" pod "a5e6ce52-9255-48ba-a723-2628da49fdd2" (UID: "a5e6ce52-9255-48ba-a723-2628da49fdd2"). InnerVolumeSpecName "kube-api-access-npzl8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:10:12.138798 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:10:12.138785    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a5e6ce52-9255-48ba-a723-2628da49fdd2-istio-token" pod "a5e6ce52-9255-48ba-a723-2628da49fdd2" (UID: "a5e6ce52-9255-48ba-a723-2628da49fdd2"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:10:12.160767 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:10:12.160704    6004 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w5-2b425d-openshift-default-f547dbcbf-mjdrq"]
Oct 30 21:10:12.166824 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:10:12.166803    6004 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w5-2b425d-openshift-default-f547dbcbf-mjdrq"]
Oct 30 21:10:12.232467 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:10:12.232434    6004 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="ebe091c6-036b-416b-9e66-a9f0cb3171a0" path="/var/lib/kubelet/pods/ebe091c6-036b-416b-9e66-a9f0cb3171a0/volumes"
Oct 30 21:10:12.238399 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:10:12.238376    6004 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a5e6ce52-9255-48ba-a723-2628da49fdd2-istio-envoy\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:10:12.238533 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:10:12.238398    6004 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a5e6ce52-9255-48ba-a723-2628da49fdd2-istio-podinfo\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:10:12.238533 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:10:12.238428    6004 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-npzl8\" (UniqueName: \"kubernetes.io/projected/a5e6ce52-9255-48ba-a723-2628da49fdd2-kube-api-access-npzl8\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:10:12.238533 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:10:12.238437    6004 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a5e6ce52-9255-48ba-a723-2628da49fdd2-istio-token\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:10:12.285437 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:10:12.285399    6004 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w0-781058-openshift-default-55fb495b7-4rkzd"]
Oct 30 21:10:12.288555 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:10:12.288530    6004 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w0-781058-openshift-default-55fb495b7-4rkzd"]
Oct 30 21:10:13.003311 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:10:13.003266    6004 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-682999-openshift-default-54dcb797b5-n25td" event={"ID":"a5e6ce52-9255-48ba-a723-2628da49fdd2","Type":"ContainerDied","Data":"312a90072c3a2f9fb82d3199f699b00453a829e9530c9fabfaefdce6d0bbd9d7"}
Oct 30 21:10:13.003311 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:10:13.003291    6004 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-682999-openshift-default-54dcb797b5-n25td"
Oct 30 21:10:13.003822 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:10:13.003346    6004 scope.go:122] "RemoveContainer" containerID="9738f5c5b5cff2375d615f2f91514e6f72e0508e01bacdbd184c5b5cb86b2e35"
Oct 30 21:10:13.172873 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:10:13.172841    6004 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w3-682999-openshift-default-54dcb797b5-n25td"]
Oct 30 21:10:13.220873 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:10:13.220841    6004 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w3-682999-openshift-default-54dcb797b5-n25td"]
Oct 30 21:10:14.239551 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:10:14.239510    6004 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="9b820c81-5ae6-459a-9510-72c234e98679" path="/var/lib/kubelet/pods/9b820c81-5ae6-459a-9510-72c234e98679/volumes"
Oct 30 21:10:14.240135 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:10:14.240113    6004 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="a5e6ce52-9255-48ba-a723-2628da49fdd2" path="/var/lib/kubelet/pods/a5e6ce52-9255-48ba-a723-2628da49fdd2/volumes"
Oct 30 21:10:14.288610 ip-10-0-138-85 kubenswrapper[6004]: E1030 21:10:14.288567    6004 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-zz4wr" containerName="extractor"
Oct 30 21:10:26.732490 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:10:26.732455    6004 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-a-b888d0-openshift-default-65d785fbfc-gtmp2"]
Oct 30 21:10:26.733096 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:10:26.733081    6004 cpu_manager.go:414] "containerMap: removing container" podUID="a5e6ce52-9255-48ba-a723-2628da49fdd2" containerName="istio-proxy"
Oct 30 21:10:26.733165 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:10:26.733097    6004 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="a5e6ce52-9255-48ba-a723-2628da49fdd2" containerName="istio-proxy"
Oct 30 21:10:26.733165 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:10:26.733111    6004 cpu_manager.go:414] "containerMap: removing container" podUID="ebe091c6-036b-416b-9e66-a9f0cb3171a0" containerName="istio-proxy"
Oct 30 21:10:26.733165 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:10:26.733116    6004 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="ebe091c6-036b-416b-9e66-a9f0cb3171a0" containerName="istio-proxy"
Oct 30 21:10:26.733165 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:10:26.733132    6004 cpu_manager.go:414] "containerMap: removing container" podUID="9b820c81-5ae6-459a-9510-72c234e98679" containerName="istio-proxy"
Oct 30 21:10:26.733165 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:10:26.733138    6004 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="9b820c81-5ae6-459a-9510-72c234e98679" containerName="istio-proxy"
Oct 30 21:10:26.733322 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:10:26.733244    6004 memory_manager.go:365] "RemoveStaleState removing state" podUID="a5e6ce52-9255-48ba-a723-2628da49fdd2" containerName="istio-proxy"
Oct 30 21:10:26.733322 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:10:26.733253    6004 memory_manager.go:365] "RemoveStaleState removing state" podUID="ebe091c6-036b-416b-9e66-a9f0cb3171a0" containerName="istio-proxy"
Oct 30 21:10:26.733322 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:10:26.733262    6004 memory_manager.go:365] "RemoveStaleState removing state" podUID="9b820c81-5ae6-459a-9510-72c234e98679" containerName="istio-proxy"
Oct 30 21:10:26.738298 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:10:26.738277    6004 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-b888d0-openshift-default-65d785fbfc-gtmp2"
Oct 30 21:10:26.828072 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:10:26.828004    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4812c56a-c9f8-42fb-b68a-b9de077eb943-istio-envoy\") pod \"e2e-api-a-b888d0-openshift-default-65d785fbfc-gtmp2\" (UID: \"4812c56a-c9f8-42fb-b68a-b9de077eb943\") " pod="openshift-ingress/e2e-api-a-b888d0-openshift-default-65d785fbfc-gtmp2"
Oct 30 21:10:26.828072 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:10:26.828043    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4812c56a-c9f8-42fb-b68a-b9de077eb943-istio-data\") pod \"e2e-api-a-b888d0-openshift-default-65d785fbfc-gtmp2\" (UID: \"4812c56a-c9f8-42fb-b68a-b9de077eb943\") " pod="openshift-ingress/e2e-api-a-b888d0-openshift-default-65d785fbfc-gtmp2"
Oct 30 21:10:26.828317 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:10:26.828188    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4812c56a-c9f8-42fb-b68a-b9de077eb943-istio-token\") pod \"e2e-api-a-b888d0-openshift-default-65d785fbfc-gtmp2\" (UID: \"4812c56a-c9f8-42fb-b68a-b9de077eb943\") " pod="openshift-ingress/e2e-api-a-b888d0-openshift-default-65d785fbfc-gtmp2"
Oct 30 21:10:26.828317 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:10:26.828209    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4812c56a-c9f8-42fb-b68a-b9de077eb943-credential-socket\") pod \"e2e-api-a-b888d0-openshift-default-65d785fbfc-gtmp2\" (UID: \"4812c56a-c9f8-42fb-b68a-b9de077eb943\") " pod="openshift-ingress/e2e-api-a-b888d0-openshift-default-65d785fbfc-gtmp2"
Oct 30 21:10:26.828317 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:10:26.828256    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4812c56a-c9f8-42fb-b68a-b9de077eb943-istiod-ca-cert\") pod \"e2e-api-a-b888d0-openshift-default-65d785fbfc-gtmp2\" (UID: \"4812c56a-c9f8-42fb-b68a-b9de077eb943\") " pod="openshift-ingress/e2e-api-a-b888d0-openshift-default-65d785fbfc-gtmp2"
Oct 30 21:10:26.828487 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:10:26.828366    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4812c56a-c9f8-42fb-b68a-b9de077eb943-workload-socket\") pod \"e2e-api-a-b888d0-openshift-default-65d785fbfc-gtmp2\" (UID: \"4812c56a-c9f8-42fb-b68a-b9de077eb943\") " pod="openshift-ingress/e2e-api-a-b888d0-openshift-default-65d785fbfc-gtmp2"
Oct 30 21:10:26.828593 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:10:26.828572    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4812c56a-c9f8-42fb-b68a-b9de077eb943-istio-podinfo\") pod \"e2e-api-a-b888d0-openshift-default-65d785fbfc-gtmp2\" (UID: \"4812c56a-c9f8-42fb-b68a-b9de077eb943\") " pod="openshift-ingress/e2e-api-a-b888d0-openshift-default-65d785fbfc-gtmp2"
Oct 30 21:10:26.828647 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:10:26.828618    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4812c56a-c9f8-42fb-b68a-b9de077eb943-workload-certs\") pod \"e2e-api-a-b888d0-openshift-default-65d785fbfc-gtmp2\" (UID: \"4812c56a-c9f8-42fb-b68a-b9de077eb943\") " pod="openshift-ingress/e2e-api-a-b888d0-openshift-default-65d785fbfc-gtmp2"
Oct 30 21:10:26.828702 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:10:26.828674    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fd9sh\" (UniqueName: \"kubernetes.io/projected/4812c56a-c9f8-42fb-b68a-b9de077eb943-kube-api-access-fd9sh\") pod \"e2e-api-a-b888d0-openshift-default-65d785fbfc-gtmp2\" (UID: \"4812c56a-c9f8-42fb-b68a-b9de077eb943\") " pod="openshift-ingress/e2e-api-a-b888d0-openshift-default-65d785fbfc-gtmp2"
Oct 30 21:10:26.929962 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:10:26.929928    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4812c56a-c9f8-42fb-b68a-b9de077eb943-istio-podinfo\") pod \"e2e-api-a-b888d0-openshift-default-65d785fbfc-gtmp2\" (UID: \"4812c56a-c9f8-42fb-b68a-b9de077eb943\") " pod="openshift-ingress/e2e-api-a-b888d0-openshift-default-65d785fbfc-gtmp2"
Oct 30 21:10:26.930165 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:10:26.929973    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4812c56a-c9f8-42fb-b68a-b9de077eb943-workload-certs\") pod \"e2e-api-a-b888d0-openshift-default-65d785fbfc-gtmp2\" (UID: \"4812c56a-c9f8-42fb-b68a-b9de077eb943\") " pod="openshift-ingress/e2e-api-a-b888d0-openshift-default-65d785fbfc-gtmp2"
Oct 30 21:10:26.930165 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:10:26.929994    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fd9sh\" (UniqueName: \"kubernetes.io/projected/4812c56a-c9f8-42fb-b68a-b9de077eb943-kube-api-access-fd9sh\") pod \"e2e-api-a-b888d0-openshift-default-65d785fbfc-gtmp2\" (UID: \"4812c56a-c9f8-42fb-b68a-b9de077eb943\") " pod="openshift-ingress/e2e-api-a-b888d0-openshift-default-65d785fbfc-gtmp2"
Oct 30 21:10:26.930165 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:10:26.930077    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4812c56a-c9f8-42fb-b68a-b9de077eb943-istio-envoy\") pod \"e2e-api-a-b888d0-openshift-default-65d785fbfc-gtmp2\" (UID: \"4812c56a-c9f8-42fb-b68a-b9de077eb943\") " pod="openshift-ingress/e2e-api-a-b888d0-openshift-default-65d785fbfc-gtmp2"
Oct 30 21:10:26.930165 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:10:26.930095    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4812c56a-c9f8-42fb-b68a-b9de077eb943-istio-data\") pod \"e2e-api-a-b888d0-openshift-default-65d785fbfc-gtmp2\" (UID: \"4812c56a-c9f8-42fb-b68a-b9de077eb943\") " pod="openshift-ingress/e2e-api-a-b888d0-openshift-default-65d785fbfc-gtmp2"
Oct 30 21:10:26.930165 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:10:26.930148    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4812c56a-c9f8-42fb-b68a-b9de077eb943-istio-token\") pod \"e2e-api-a-b888d0-openshift-default-65d785fbfc-gtmp2\" (UID: \"4812c56a-c9f8-42fb-b68a-b9de077eb943\") " pod="openshift-ingress/e2e-api-a-b888d0-openshift-default-65d785fbfc-gtmp2"
Oct 30 21:10:26.930437 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:10:26.930292    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4812c56a-c9f8-42fb-b68a-b9de077eb943-credential-socket\") pod \"e2e-api-a-b888d0-openshift-default-65d785fbfc-gtmp2\" (UID: \"4812c56a-c9f8-42fb-b68a-b9de077eb943\") " pod="openshift-ingress/e2e-api-a-b888d0-openshift-default-65d785fbfc-gtmp2"
Oct 30 21:10:26.930437 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:10:26.930389    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4812c56a-c9f8-42fb-b68a-b9de077eb943-istiod-ca-cert\") pod \"e2e-api-a-b888d0-openshift-default-65d785fbfc-gtmp2\" (UID: \"4812c56a-c9f8-42fb-b68a-b9de077eb943\") " pod="openshift-ingress/e2e-api-a-b888d0-openshift-default-65d785fbfc-gtmp2"
Oct 30 21:10:26.930437 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:10:26.930423    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4812c56a-c9f8-42fb-b68a-b9de077eb943-workload-socket\") pod \"e2e-api-a-b888d0-openshift-default-65d785fbfc-gtmp2\" (UID: \"4812c56a-c9f8-42fb-b68a-b9de077eb943\") " pod="openshift-ingress/e2e-api-a-b888d0-openshift-default-65d785fbfc-gtmp2"
Oct 30 21:10:26.930587 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:10:26.930436    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4812c56a-c9f8-42fb-b68a-b9de077eb943-workload-certs\") pod \"e2e-api-a-b888d0-openshift-default-65d785fbfc-gtmp2\" (UID: \"4812c56a-c9f8-42fb-b68a-b9de077eb943\") " pod="openshift-ingress/e2e-api-a-b888d0-openshift-default-65d785fbfc-gtmp2"
Oct 30 21:10:26.930587 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:10:26.930498    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4812c56a-c9f8-42fb-b68a-b9de077eb943-istio-data\") pod \"e2e-api-a-b888d0-openshift-default-65d785fbfc-gtmp2\" (UID: \"4812c56a-c9f8-42fb-b68a-b9de077eb943\") " pod="openshift-ingress/e2e-api-a-b888d0-openshift-default-65d785fbfc-gtmp2"
Oct 30 21:10:26.930678 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:10:26.930657    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4812c56a-c9f8-42fb-b68a-b9de077eb943-credential-socket\") pod \"e2e-api-a-b888d0-openshift-default-65d785fbfc-gtmp2\" (UID: \"4812c56a-c9f8-42fb-b68a-b9de077eb943\") " pod="openshift-ingress/e2e-api-a-b888d0-openshift-default-65d785fbfc-gtmp2"
Oct 30 21:10:26.930807 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:10:26.930786    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4812c56a-c9f8-42fb-b68a-b9de077eb943-workload-socket\") pod \"e2e-api-a-b888d0-openshift-default-65d785fbfc-gtmp2\" (UID: \"4812c56a-c9f8-42fb-b68a-b9de077eb943\") " pod="openshift-ingress/e2e-api-a-b888d0-openshift-default-65d785fbfc-gtmp2"
Oct 30 21:10:26.931157 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:10:26.931135    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4812c56a-c9f8-42fb-b68a-b9de077eb943-istiod-ca-cert\") pod \"e2e-api-a-b888d0-openshift-default-65d785fbfc-gtmp2\" (UID: \"4812c56a-c9f8-42fb-b68a-b9de077eb943\") " pod="openshift-ingress/e2e-api-a-b888d0-openshift-default-65d785fbfc-gtmp2"
Oct 30 21:10:26.932540 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:10:26.932518    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4812c56a-c9f8-42fb-b68a-b9de077eb943-istio-envoy\") pod \"e2e-api-a-b888d0-openshift-default-65d785fbfc-gtmp2\" (UID: \"4812c56a-c9f8-42fb-b68a-b9de077eb943\") " pod="openshift-ingress/e2e-api-a-b888d0-openshift-default-65d785fbfc-gtmp2"
Oct 30 21:10:26.932742 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:10:26.932726    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4812c56a-c9f8-42fb-b68a-b9de077eb943-istio-podinfo\") pod \"e2e-api-a-b888d0-openshift-default-65d785fbfc-gtmp2\" (UID: \"4812c56a-c9f8-42fb-b68a-b9de077eb943\") " pod="openshift-ingress/e2e-api-a-b888d0-openshift-default-65d785fbfc-gtmp2"
Oct 30 21:10:26.953240 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:10:26.953183    6004 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-b888d0-openshift-default-65d785fbfc-gtmp2"]
Oct 30 21:10:26.988020 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:10:26.987939    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4812c56a-c9f8-42fb-b68a-b9de077eb943-istio-token\") pod \"e2e-api-a-b888d0-openshift-default-65d785fbfc-gtmp2\" (UID: \"4812c56a-c9f8-42fb-b68a-b9de077eb943\") " pod="openshift-ingress/e2e-api-a-b888d0-openshift-default-65d785fbfc-gtmp2"
Oct 30 21:10:26.988020 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:10:26.987994    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fd9sh\" (UniqueName: \"kubernetes.io/projected/4812c56a-c9f8-42fb-b68a-b9de077eb943-kube-api-access-fd9sh\") pod \"e2e-api-a-b888d0-openshift-default-65d785fbfc-gtmp2\" (UID: \"4812c56a-c9f8-42fb-b68a-b9de077eb943\") " pod="openshift-ingress/e2e-api-a-b888d0-openshift-default-65d785fbfc-gtmp2"
Oct 30 21:10:27.054385 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:10:27.054349    6004 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-b888d0-openshift-default-65d785fbfc-gtmp2"
Oct 30 21:10:27.507245 ip-10-0-138-85 kubenswrapper[6004]: W1030 21:10:27.507213    6004 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4812c56a_c9f8_42fb_b68a_b9de077eb943.slice/crio-2fa0208faefb02dbe0a3e57d235d5debcd34e7fa78f45a2c87c9f35b9e57e308 WatchSource:0}: Error finding container 2fa0208faefb02dbe0a3e57d235d5debcd34e7fa78f45a2c87c9f35b9e57e308: Status 404 returned error can't find the container with id 2fa0208faefb02dbe0a3e57d235d5debcd34e7fa78f45a2c87c9f35b9e57e308
Oct 30 21:10:27.510251 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:10:27.510215    6004 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 21:10:27.510376 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:10:27.510319    6004 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 21:10:27.510376 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:10:27.510364    6004 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 21:10:27.513419 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:10:27.513398    6004 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-b888d0-openshift-default-65d785fbfc-gtmp2"]
Oct 30 21:10:28.114599 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:10:28.114564    6004 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-b888d0-openshift-default-65d785fbfc-gtmp2" event={"ID":"4812c56a-c9f8-42fb-b68a-b9de077eb943","Type":"ContainerStarted","Data":"5e57505dd3e4cd98e71a90a685eb40f703ee964c5797fa7e4b8061c75d96586c"}
Oct 30 21:10:28.114997 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:10:28.114620    6004 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-b888d0-openshift-default-65d785fbfc-gtmp2" event={"ID":"4812c56a-c9f8-42fb-b68a-b9de077eb943","Type":"ContainerStarted","Data":"2fa0208faefb02dbe0a3e57d235d5debcd34e7fa78f45a2c87c9f35b9e57e308"}
Oct 30 21:10:28.332785 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:10:28.332734    6004 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-api-a-b888d0-openshift-default-65d785fbfc-gtmp2" podStartSLOduration=2.332721001 podStartE2EDuration="2.332721001s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:10:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:10:28.28259569 +0000 UTC m=+1934.202381807" watchObservedRunningTime="2026-10-30 21:10:28.332721001 +0000 UTC m=+1934.252507118"
Oct 30 21:10:29.058076 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:10:29.057244    6004 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-b888d0-openshift-default-65d785fbfc-gtmp2"
Oct 30 21:10:29.066359 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:10:29.065211    6004 patch_prober.go:29] interesting pod/e2e-api-a-b888d0-openshift-default-65d785fbfc-gtmp2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.101:15021/healthz/ready\": dial tcp 10.132.0.101:15021: connect: connection refused" start-of-body=
Oct 30 21:10:29.066359 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:10:29.065292    6004 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-b888d0-openshift-default-65d785fbfc-gtmp2" podUID="4812c56a-c9f8-42fb-b68a-b9de077eb943" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.101:15021/healthz/ready\": dial tcp 10.132.0.101:15021: connect: connection refused"
Oct 30 21:10:30.059543 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:10:30.056430    6004 patch_prober.go:29] interesting pod/e2e-api-a-b888d0-openshift-default-65d785fbfc-gtmp2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.101:15021/healthz/ready\": dial tcp 10.132.0.101:15021: connect: connection refused" start-of-body=
Oct 30 21:10:30.059543 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:10:30.056494    6004 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-b888d0-openshift-default-65d785fbfc-gtmp2" podUID="4812c56a-c9f8-42fb-b68a-b9de077eb943" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.101:15021/healthz/ready\": dial tcp 10.132.0.101:15021: connect: connection refused"
Oct 30 21:10:31.058427 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:10:31.058387    6004 patch_prober.go:29] interesting pod/e2e-api-a-b888d0-openshift-default-65d785fbfc-gtmp2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.101:15021/healthz/ready\": dial tcp 10.132.0.101:15021: connect: connection refused" start-of-body=
Oct 30 21:10:31.058727 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:10:31.058695    6004 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-b888d0-openshift-default-65d785fbfc-gtmp2" podUID="4812c56a-c9f8-42fb-b68a-b9de077eb943" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.101:15021/healthz/ready\": dial tcp 10.132.0.101:15021: connect: connection refused"
Oct 30 21:10:32.057455 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:10:32.057412    6004 patch_prober.go:29] interesting pod/e2e-api-a-b888d0-openshift-default-65d785fbfc-gtmp2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.101:15021/healthz/ready\": dial tcp 10.132.0.101:15021: connect: connection refused" start-of-body=
Oct 30 21:10:32.058041 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:10:32.058010    6004 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-b888d0-openshift-default-65d785fbfc-gtmp2" podUID="4812c56a-c9f8-42fb-b68a-b9de077eb943" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.101:15021/healthz/ready\": dial tcp 10.132.0.101:15021: connect: connection refused"
Oct 30 21:10:33.056079 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:10:33.056011    6004 patch_prober.go:29] interesting pod/e2e-api-a-b888d0-openshift-default-65d785fbfc-gtmp2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.101:15021/healthz/ready\": dial tcp 10.132.0.101:15021: connect: connection refused" start-of-body=
Oct 30 21:10:33.056363 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:10:33.056321    6004 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-b888d0-openshift-default-65d785fbfc-gtmp2" podUID="4812c56a-c9f8-42fb-b68a-b9de077eb943" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.101:15021/healthz/ready\": dial tcp 10.132.0.101:15021: connect: connection refused"
Oct 30 21:10:34.136585 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:10:34.136553    6004 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-b888d0-openshift-default-65d785fbfc-gtmp2"
Oct 30 21:10:34.137316 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:10:34.137288    6004 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-b888d0-openshift-default-65d785fbfc-gtmp2"
Oct 30 21:10:34.138221 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:10:34.138189    6004 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-b888d0-openshift-default-65d785fbfc-gtmp2"
Oct 30 21:10:34.978300 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:10:34.978256    6004 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-ef7e2d-84b4ffb448-hmts8"]
Oct 30 21:10:34.983008 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:10:34.982983    6004 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-ef7e2d-84b4ffb448-hmts8"
Oct 30 21:10:35.037977 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:10:35.037947    6004 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-a-ef7e2d-serving-cert\""
Oct 30 21:10:35.045997 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:10:35.045962    6004 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-ef7e2d-84b4ffb448-hmts8"]
Oct 30 21:10:35.084838 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:10:35.084800    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f3c5de2e-a210-4383-932a-3655559a2297-metrics-certs\") pod \"maas-api-e2e-api-a-ef7e2d-84b4ffb448-hmts8\" (UID: \"f3c5de2e-a210-4383-932a-3655559a2297\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-ef7e2d-84b4ffb448-hmts8"
Oct 30 21:10:35.085002 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:10:35.084924    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8dndf\" (UniqueName: \"kubernetes.io/projected/f3c5de2e-a210-4383-932a-3655559a2297-kube-api-access-8dndf\") pod \"maas-api-e2e-api-a-ef7e2d-84b4ffb448-hmts8\" (UID: \"f3c5de2e-a210-4383-932a-3655559a2297\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-ef7e2d-84b4ffb448-hmts8"
Oct 30 21:10:35.085161 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:10:35.085137    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f3c5de2e-a210-4383-932a-3655559a2297-openshift-service-ca\") pod \"maas-api-e2e-api-a-ef7e2d-84b4ffb448-hmts8\" (UID: \"f3c5de2e-a210-4383-932a-3655559a2297\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-ef7e2d-84b4ffb448-hmts8"
Oct 30 21:10:35.085235 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:10:35.085190    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f3c5de2e-a210-4383-932a-3655559a2297-maas-api-tls\") pod \"maas-api-e2e-api-a-ef7e2d-84b4ffb448-hmts8\" (UID: \"f3c5de2e-a210-4383-932a-3655559a2297\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-ef7e2d-84b4ffb448-hmts8"
Oct 30 21:10:35.186928 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:10:35.186892    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8dndf\" (UniqueName: \"kubernetes.io/projected/f3c5de2e-a210-4383-932a-3655559a2297-kube-api-access-8dndf\") pod \"maas-api-e2e-api-a-ef7e2d-84b4ffb448-hmts8\" (UID: \"f3c5de2e-a210-4383-932a-3655559a2297\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-ef7e2d-84b4ffb448-hmts8"
Oct 30 21:10:35.187440 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:10:35.187028    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f3c5de2e-a210-4383-932a-3655559a2297-openshift-service-ca\") pod \"maas-api-e2e-api-a-ef7e2d-84b4ffb448-hmts8\" (UID: \"f3c5de2e-a210-4383-932a-3655559a2297\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-ef7e2d-84b4ffb448-hmts8"
Oct 30 21:10:35.187440 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:10:35.187076    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f3c5de2e-a210-4383-932a-3655559a2297-maas-api-tls\") pod \"maas-api-e2e-api-a-ef7e2d-84b4ffb448-hmts8\" (UID: \"f3c5de2e-a210-4383-932a-3655559a2297\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-ef7e2d-84b4ffb448-hmts8"
Oct 30 21:10:35.187440 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:10:35.187208    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f3c5de2e-a210-4383-932a-3655559a2297-metrics-certs\") pod \"maas-api-e2e-api-a-ef7e2d-84b4ffb448-hmts8\" (UID: \"f3c5de2e-a210-4383-932a-3655559a2297\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-ef7e2d-84b4ffb448-hmts8"
Oct 30 21:10:35.187440 ip-10-0-138-85 kubenswrapper[6004]: E1030 21:10:35.187356    6004 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-api-a-ef7e2d-serving-cert: secret "maas-api-e2e-api-a-ef7e2d-serving-cert" not found
Oct 30 21:10:35.187756 ip-10-0-138-85 kubenswrapper[6004]: E1030 21:10:35.187740    6004 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f3c5de2e-a210-4383-932a-3655559a2297-maas-api-tls podName:f3c5de2e-a210-4383-932a-3655559a2297 nodeName:}" failed. No retries permitted until 2026-10-30 21:10:35.687719993 +0000 UTC m=+1941.607506097 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/f3c5de2e-a210-4383-932a-3655559a2297-maas-api-tls") pod "maas-api-e2e-api-a-ef7e2d-84b4ffb448-hmts8" (UID: "f3c5de2e-a210-4383-932a-3655559a2297") : secret "maas-api-e2e-api-a-ef7e2d-serving-cert" not found
Oct 30 21:10:35.187915 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:10:35.187888    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f3c5de2e-a210-4383-932a-3655559a2297-openshift-service-ca\") pod \"maas-api-e2e-api-a-ef7e2d-84b4ffb448-hmts8\" (UID: \"f3c5de2e-a210-4383-932a-3655559a2297\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-ef7e2d-84b4ffb448-hmts8"
Oct 30 21:10:35.190860 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:10:35.190833    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f3c5de2e-a210-4383-932a-3655559a2297-metrics-certs\") pod \"maas-api-e2e-api-a-ef7e2d-84b4ffb448-hmts8\" (UID: \"f3c5de2e-a210-4383-932a-3655559a2297\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-ef7e2d-84b4ffb448-hmts8"
Oct 30 21:10:35.259886 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:10:35.259793    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8dndf\" (UniqueName: \"kubernetes.io/projected/f3c5de2e-a210-4383-932a-3655559a2297-kube-api-access-8dndf\") pod \"maas-api-e2e-api-a-ef7e2d-84b4ffb448-hmts8\" (UID: \"f3c5de2e-a210-4383-932a-3655559a2297\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-ef7e2d-84b4ffb448-hmts8"
Oct 30 21:10:35.705528 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:10:35.705491    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f3c5de2e-a210-4383-932a-3655559a2297-maas-api-tls\") pod \"maas-api-e2e-api-a-ef7e2d-84b4ffb448-hmts8\" (UID: \"f3c5de2e-a210-4383-932a-3655559a2297\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-ef7e2d-84b4ffb448-hmts8"
Oct 30 21:10:35.708225 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:10:35.708196    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f3c5de2e-a210-4383-932a-3655559a2297-maas-api-tls\") pod \"maas-api-e2e-api-a-ef7e2d-84b4ffb448-hmts8\" (UID: \"f3c5de2e-a210-4383-932a-3655559a2297\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-ef7e2d-84b4ffb448-hmts8"
Oct 30 21:10:35.898284 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:10:35.898248    6004 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-ef7e2d-84b4ffb448-hmts8"
Oct 30 21:10:36.361763 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:10:36.361726    6004 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-ef7e2d-84b4ffb448-hmts8"]
Oct 30 21:10:36.363172 ip-10-0-138-85 kubenswrapper[6004]: W1030 21:10:36.363144    6004 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf3c5de2e_a210_4383_932a_3655559a2297.slice/crio-b603971dfc2371ef01463fe464901b66f928b1d972043961eabb3ff5c071f20a WatchSource:0}: Error finding container b603971dfc2371ef01463fe464901b66f928b1d972043961eabb3ff5c071f20a: Status 404 returned error can't find the container with id b603971dfc2371ef01463fe464901b66f928b1d972043961eabb3ff5c071f20a
Oct 30 21:10:37.221580 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:10:37.221546    6004 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-ef7e2d-84b4ffb448-hmts8" event={"ID":"f3c5de2e-a210-4383-932a-3655559a2297","Type":"ContainerStarted","Data":"b603971dfc2371ef01463fe464901b66f928b1d972043961eabb3ff5c071f20a"}
Oct 30 21:10:38.233865 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:10:38.233827    6004 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-ef7e2d-84b4ffb448-hmts8" event={"ID":"f3c5de2e-a210-4383-932a-3655559a2297","Type":"ContainerStarted","Data":"bb81a68fb89c10a2b504a55f4ee822d53dcc59ebb08539357a2d3bf4a198bc05"}
Oct 30 21:10:38.234458 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:10:38.234433    6004 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-ef7e2d-84b4ffb448-hmts8"
Oct 30 21:10:38.355113 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:10:38.352332    6004 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-ef7e2d-84b4ffb448-hmts8" podStartSLOduration=3.524669199 podStartE2EDuration="4.352312071s" totalImagesPullingTime="827.642872ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:10:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:10:38.351584608 +0000 UTC m=+1944.271370726" watchObservedRunningTime="2026-10-30 21:10:38.352312071 +0000 UTC m=+1944.272098192"
Oct 30 21:10:40.330956 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:10:40.330919    6004 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w6-7eaf74-6f597b8c87-jjsw8"]
Oct 30 21:10:40.335271 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:10:40.335250    6004 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w6-7eaf74-6f597b8c87-jjsw8"
Oct 30 21:10:40.384324 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:10:40.384288    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2fj4c\" (UniqueName: \"kubernetes.io/projected/118ff52d-4872-4408-b3d2-feab54040b8b-kube-api-access-2fj4c\") pod \"maas-api-e2e-shared-b-w6-7eaf74-6f597b8c87-jjsw8\" (UID: \"118ff52d-4872-4408-b3d2-feab54040b8b\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w6-7eaf74-6f597b8c87-jjsw8"
Oct 30 21:10:40.384484 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:10:40.384459    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/118ff52d-4872-4408-b3d2-feab54040b8b-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w6-7eaf74-6f597b8c87-jjsw8\" (UID: \"118ff52d-4872-4408-b3d2-feab54040b8b\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w6-7eaf74-6f597b8c87-jjsw8"
Oct 30 21:10:40.384536 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:10:40.384513    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/118ff52d-4872-4408-b3d2-feab54040b8b-metrics-certs\") pod \"maas-api-e2e-shared-b-w6-7eaf74-6f597b8c87-jjsw8\" (UID: \"118ff52d-4872-4408-b3d2-feab54040b8b\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w6-7eaf74-6f597b8c87-jjsw8"
Oct 30 21:10:40.384601 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:10:40.384582    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/118ff52d-4872-4408-b3d2-feab54040b8b-maas-api-tls\") pod \"maas-api-e2e-shared-b-w6-7eaf74-6f597b8c87-jjsw8\" (UID: \"118ff52d-4872-4408-b3d2-feab54040b8b\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w6-7eaf74-6f597b8c87-jjsw8"
Oct 30 21:10:40.441794 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:10:40.441760    6004 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-b-w6-7eaf74-serving-cert\""
Oct 30 21:10:40.447274 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:10:40.447240    6004 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w6-7eaf74-6f597b8c87-jjsw8"]
Oct 30 21:10:40.486162 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:10:40.486124    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/118ff52d-4872-4408-b3d2-feab54040b8b-metrics-certs\") pod \"maas-api-e2e-shared-b-w6-7eaf74-6f597b8c87-jjsw8\" (UID: \"118ff52d-4872-4408-b3d2-feab54040b8b\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w6-7eaf74-6f597b8c87-jjsw8"
Oct 30 21:10:40.486353 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:10:40.486177    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/118ff52d-4872-4408-b3d2-feab54040b8b-maas-api-tls\") pod \"maas-api-e2e-shared-b-w6-7eaf74-6f597b8c87-jjsw8\" (UID: \"118ff52d-4872-4408-b3d2-feab54040b8b\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w6-7eaf74-6f597b8c87-jjsw8"
Oct 30 21:10:40.486419 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:10:40.486379    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2fj4c\" (UniqueName: \"kubernetes.io/projected/118ff52d-4872-4408-b3d2-feab54040b8b-kube-api-access-2fj4c\") pod \"maas-api-e2e-shared-b-w6-7eaf74-6f597b8c87-jjsw8\" (UID: \"118ff52d-4872-4408-b3d2-feab54040b8b\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w6-7eaf74-6f597b8c87-jjsw8"
Oct 30 21:10:40.486544 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:10:40.486524    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/118ff52d-4872-4408-b3d2-feab54040b8b-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w6-7eaf74-6f597b8c87-jjsw8\" (UID: \"118ff52d-4872-4408-b3d2-feab54040b8b\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w6-7eaf74-6f597b8c87-jjsw8"
Oct 30 21:10:40.486935 ip-10-0-138-85 kubenswrapper[6004]: E1030 21:10:40.486895    6004 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-b-w6-7eaf74-serving-cert: secret "maas-api-e2e-shared-b-w6-7eaf74-serving-cert" not found
Oct 30 21:10:40.487120 ip-10-0-138-85 kubenswrapper[6004]: E1030 21:10:40.487107    6004 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/118ff52d-4872-4408-b3d2-feab54040b8b-maas-api-tls podName:118ff52d-4872-4408-b3d2-feab54040b8b nodeName:}" failed. No retries permitted until 2026-10-30 21:10:40.98708591 +0000 UTC m=+1946.906872020 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/118ff52d-4872-4408-b3d2-feab54040b8b-maas-api-tls") pod "maas-api-e2e-shared-b-w6-7eaf74-6f597b8c87-jjsw8" (UID: "118ff52d-4872-4408-b3d2-feab54040b8b") : secret "maas-api-e2e-shared-b-w6-7eaf74-serving-cert" not found
Oct 30 21:10:40.487468 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:10:40.487440    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/118ff52d-4872-4408-b3d2-feab54040b8b-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w6-7eaf74-6f597b8c87-jjsw8\" (UID: \"118ff52d-4872-4408-b3d2-feab54040b8b\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w6-7eaf74-6f597b8c87-jjsw8"
Oct 30 21:10:40.490112 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:10:40.490084    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/118ff52d-4872-4408-b3d2-feab54040b8b-metrics-certs\") pod \"maas-api-e2e-shared-b-w6-7eaf74-6f597b8c87-jjsw8\" (UID: \"118ff52d-4872-4408-b3d2-feab54040b8b\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w6-7eaf74-6f597b8c87-jjsw8"
Oct 30 21:10:40.545516 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:10:40.545488    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2fj4c\" (UniqueName: \"kubernetes.io/projected/118ff52d-4872-4408-b3d2-feab54040b8b-kube-api-access-2fj4c\") pod \"maas-api-e2e-shared-b-w6-7eaf74-6f597b8c87-jjsw8\" (UID: \"118ff52d-4872-4408-b3d2-feab54040b8b\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w6-7eaf74-6f597b8c87-jjsw8"
Oct 30 21:10:40.999060 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:10:40.999014    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/118ff52d-4872-4408-b3d2-feab54040b8b-maas-api-tls\") pod \"maas-api-e2e-shared-b-w6-7eaf74-6f597b8c87-jjsw8\" (UID: \"118ff52d-4872-4408-b3d2-feab54040b8b\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w6-7eaf74-6f597b8c87-jjsw8"
Oct 30 21:10:41.001627 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:10:41.001602    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/118ff52d-4872-4408-b3d2-feab54040b8b-maas-api-tls\") pod \"maas-api-e2e-shared-b-w6-7eaf74-6f597b8c87-jjsw8\" (UID: \"118ff52d-4872-4408-b3d2-feab54040b8b\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w6-7eaf74-6f597b8c87-jjsw8"
Oct 30 21:10:41.249771 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:10:41.249681    6004 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w6-7eaf74-6f597b8c87-jjsw8"
Oct 30 21:10:41.633658 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:10:41.633629    6004 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w6-7eaf74-6f597b8c87-jjsw8"]
Oct 30 21:10:41.634293 ip-10-0-138-85 kubenswrapper[6004]: W1030 21:10:41.634268    6004 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod118ff52d_4872_4408_b3d2_feab54040b8b.slice/crio-0045683d77851249ff562ce2c654e64a736f6999fcfedaf010c3395619dd3d95 WatchSource:0}: Error finding container 0045683d77851249ff562ce2c654e64a736f6999fcfedaf010c3395619dd3d95: Status 404 returned error can't find the container with id 0045683d77851249ff562ce2c654e64a736f6999fcfedaf010c3395619dd3d95
Oct 30 21:10:41.904316 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:10:41.904186    6004 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-a-b888d0-openshift-default-65d785fbfc-wgpfl"]
Oct 30 21:10:41.909692 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:10:41.909672    6004 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-b888d0-openshift-default-65d785fbfc-wgpfl"
Oct 30 21:10:41.984097 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:10:41.984065    6004 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-b888d0-openshift-default-65d785fbfc-wgpfl"]
Oct 30 21:10:42.014278 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:10:42.014239    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q52px\" (UniqueName: \"kubernetes.io/projected/9303d324-812e-4154-907e-63865d73600f-kube-api-access-q52px\") pod \"e2e-api-a-b888d0-openshift-default-65d785fbfc-wgpfl\" (UID: \"9303d324-812e-4154-907e-63865d73600f\") " pod="openshift-ingress/e2e-api-a-b888d0-openshift-default-65d785fbfc-wgpfl"
Oct 30 21:10:42.014443 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:10:42.014282    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9303d324-812e-4154-907e-63865d73600f-istio-podinfo\") pod \"e2e-api-a-b888d0-openshift-default-65d785fbfc-wgpfl\" (UID: \"9303d324-812e-4154-907e-63865d73600f\") " pod="openshift-ingress/e2e-api-a-b888d0-openshift-default-65d785fbfc-wgpfl"
Oct 30 21:10:42.014443 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:10:42.014364    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9303d324-812e-4154-907e-63865d73600f-istio-envoy\") pod \"e2e-api-a-b888d0-openshift-default-65d785fbfc-wgpfl\" (UID: \"9303d324-812e-4154-907e-63865d73600f\") " pod="openshift-ingress/e2e-api-a-b888d0-openshift-default-65d785fbfc-wgpfl"
Oct 30 21:10:42.014443 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:10:42.014385    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9303d324-812e-4154-907e-63865d73600f-istio-data\") pod \"e2e-api-a-b888d0-openshift-default-65d785fbfc-wgpfl\" (UID: \"9303d324-812e-4154-907e-63865d73600f\") " pod="openshift-ingress/e2e-api-a-b888d0-openshift-default-65d785fbfc-wgpfl"
Oct 30 21:10:42.014610 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:10:42.014576    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9303d324-812e-4154-907e-63865d73600f-credential-socket\") pod \"e2e-api-a-b888d0-openshift-default-65d785fbfc-wgpfl\" (UID: \"9303d324-812e-4154-907e-63865d73600f\") " pod="openshift-ingress/e2e-api-a-b888d0-openshift-default-65d785fbfc-wgpfl"
Oct 30 21:10:42.014669 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:10:42.014626    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9303d324-812e-4154-907e-63865d73600f-istio-token\") pod \"e2e-api-a-b888d0-openshift-default-65d785fbfc-wgpfl\" (UID: \"9303d324-812e-4154-907e-63865d73600f\") " pod="openshift-ingress/e2e-api-a-b888d0-openshift-default-65d785fbfc-wgpfl"
Oct 30 21:10:42.014710 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:10:42.014694    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9303d324-812e-4154-907e-63865d73600f-workload-socket\") pod \"e2e-api-a-b888d0-openshift-default-65d785fbfc-wgpfl\" (UID: \"9303d324-812e-4154-907e-63865d73600f\") " pod="openshift-ingress/e2e-api-a-b888d0-openshift-default-65d785fbfc-wgpfl"
Oct 30 21:10:42.014767 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:10:42.014731    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9303d324-812e-4154-907e-63865d73600f-istiod-ca-cert\") pod \"e2e-api-a-b888d0-openshift-default-65d785fbfc-wgpfl\" (UID: \"9303d324-812e-4154-907e-63865d73600f\") " pod="openshift-ingress/e2e-api-a-b888d0-openshift-default-65d785fbfc-wgpfl"
Oct 30 21:10:42.014814 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:10:42.014771    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9303d324-812e-4154-907e-63865d73600f-workload-certs\") pod \"e2e-api-a-b888d0-openshift-default-65d785fbfc-wgpfl\" (UID: \"9303d324-812e-4154-907e-63865d73600f\") " pod="openshift-ingress/e2e-api-a-b888d0-openshift-default-65d785fbfc-wgpfl"
Oct 30 21:10:42.115974 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:10:42.115938    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9303d324-812e-4154-907e-63865d73600f-workload-certs\") pod \"e2e-api-a-b888d0-openshift-default-65d785fbfc-wgpfl\" (UID: \"9303d324-812e-4154-907e-63865d73600f\") " pod="openshift-ingress/e2e-api-a-b888d0-openshift-default-65d785fbfc-wgpfl"
Oct 30 21:10:42.116183 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:10:42.116068    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q52px\" (UniqueName: \"kubernetes.io/projected/9303d324-812e-4154-907e-63865d73600f-kube-api-access-q52px\") pod \"e2e-api-a-b888d0-openshift-default-65d785fbfc-wgpfl\" (UID: \"9303d324-812e-4154-907e-63865d73600f\") " pod="openshift-ingress/e2e-api-a-b888d0-openshift-default-65d785fbfc-wgpfl"
Oct 30 21:10:42.116183 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:10:42.116105    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9303d324-812e-4154-907e-63865d73600f-istio-podinfo\") pod \"e2e-api-a-b888d0-openshift-default-65d785fbfc-wgpfl\" (UID: \"9303d324-812e-4154-907e-63865d73600f\") " pod="openshift-ingress/e2e-api-a-b888d0-openshift-default-65d785fbfc-wgpfl"
Oct 30 21:10:42.116183 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:10:42.116149    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9303d324-812e-4154-907e-63865d73600f-istio-envoy\") pod \"e2e-api-a-b888d0-openshift-default-65d785fbfc-wgpfl\" (UID: \"9303d324-812e-4154-907e-63865d73600f\") " pod="openshift-ingress/e2e-api-a-b888d0-openshift-default-65d785fbfc-wgpfl"
Oct 30 21:10:42.116183 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:10:42.116173    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9303d324-812e-4154-907e-63865d73600f-istio-data\") pod \"e2e-api-a-b888d0-openshift-default-65d785fbfc-wgpfl\" (UID: \"9303d324-812e-4154-907e-63865d73600f\") " pod="openshift-ingress/e2e-api-a-b888d0-openshift-default-65d785fbfc-wgpfl"
Oct 30 21:10:42.116386 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:10:42.116303    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9303d324-812e-4154-907e-63865d73600f-credential-socket\") pod \"e2e-api-a-b888d0-openshift-default-65d785fbfc-wgpfl\" (UID: \"9303d324-812e-4154-907e-63865d73600f\") " pod="openshift-ingress/e2e-api-a-b888d0-openshift-default-65d785fbfc-wgpfl"
Oct 30 21:10:42.116386 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:10:42.116342    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9303d324-812e-4154-907e-63865d73600f-istio-token\") pod \"e2e-api-a-b888d0-openshift-default-65d785fbfc-wgpfl\" (UID: \"9303d324-812e-4154-907e-63865d73600f\") " pod="openshift-ingress/e2e-api-a-b888d0-openshift-default-65d785fbfc-wgpfl"
Oct 30 21:10:42.116386 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:10:42.116375    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9303d324-812e-4154-907e-63865d73600f-workload-socket\") pod \"e2e-api-a-b888d0-openshift-default-65d785fbfc-wgpfl\" (UID: \"9303d324-812e-4154-907e-63865d73600f\") " pod="openshift-ingress/e2e-api-a-b888d0-openshift-default-65d785fbfc-wgpfl"
Oct 30 21:10:42.116536 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:10:42.116417    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9303d324-812e-4154-907e-63865d73600f-istiod-ca-cert\") pod \"e2e-api-a-b888d0-openshift-default-65d785fbfc-wgpfl\" (UID: \"9303d324-812e-4154-907e-63865d73600f\") " pod="openshift-ingress/e2e-api-a-b888d0-openshift-default-65d785fbfc-wgpfl"
Oct 30 21:10:42.116536 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:10:42.116475    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9303d324-812e-4154-907e-63865d73600f-workload-certs\") pod \"e2e-api-a-b888d0-openshift-default-65d785fbfc-wgpfl\" (UID: \"9303d324-812e-4154-907e-63865d73600f\") " pod="openshift-ingress/e2e-api-a-b888d0-openshift-default-65d785fbfc-wgpfl"
Oct 30 21:10:42.116745 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:10:42.116722    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9303d324-812e-4154-907e-63865d73600f-istio-data\") pod \"e2e-api-a-b888d0-openshift-default-65d785fbfc-wgpfl\" (UID: \"9303d324-812e-4154-907e-63865d73600f\") " pod="openshift-ingress/e2e-api-a-b888d0-openshift-default-65d785fbfc-wgpfl"
Oct 30 21:10:42.116916 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:10:42.116889    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9303d324-812e-4154-907e-63865d73600f-workload-socket\") pod \"e2e-api-a-b888d0-openshift-default-65d785fbfc-wgpfl\" (UID: \"9303d324-812e-4154-907e-63865d73600f\") " pod="openshift-ingress/e2e-api-a-b888d0-openshift-default-65d785fbfc-wgpfl"
Oct 30 21:10:42.117010 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:10:42.116965    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9303d324-812e-4154-907e-63865d73600f-credential-socket\") pod \"e2e-api-a-b888d0-openshift-default-65d785fbfc-wgpfl\" (UID: \"9303d324-812e-4154-907e-63865d73600f\") " pod="openshift-ingress/e2e-api-a-b888d0-openshift-default-65d785fbfc-wgpfl"
Oct 30 21:10:42.117226 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:10:42.117200    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9303d324-812e-4154-907e-63865d73600f-istiod-ca-cert\") pod \"e2e-api-a-b888d0-openshift-default-65d785fbfc-wgpfl\" (UID: \"9303d324-812e-4154-907e-63865d73600f\") " pod="openshift-ingress/e2e-api-a-b888d0-openshift-default-65d785fbfc-wgpfl"
Oct 30 21:10:42.118688 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:10:42.118660    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9303d324-812e-4154-907e-63865d73600f-istio-envoy\") pod \"e2e-api-a-b888d0-openshift-default-65d785fbfc-wgpfl\" (UID: \"9303d324-812e-4154-907e-63865d73600f\") " pod="openshift-ingress/e2e-api-a-b888d0-openshift-default-65d785fbfc-wgpfl"
Oct 30 21:10:42.119137 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:10:42.119112    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9303d324-812e-4154-907e-63865d73600f-istio-podinfo\") pod \"e2e-api-a-b888d0-openshift-default-65d785fbfc-wgpfl\" (UID: \"9303d324-812e-4154-907e-63865d73600f\") " pod="openshift-ingress/e2e-api-a-b888d0-openshift-default-65d785fbfc-wgpfl"
Oct 30 21:10:42.175887 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:10:42.175805    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9303d324-812e-4154-907e-63865d73600f-istio-token\") pod \"e2e-api-a-b888d0-openshift-default-65d785fbfc-wgpfl\" (UID: \"9303d324-812e-4154-907e-63865d73600f\") " pod="openshift-ingress/e2e-api-a-b888d0-openshift-default-65d785fbfc-wgpfl"
Oct 30 21:10:42.177061 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:10:42.177023    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q52px\" (UniqueName: \"kubernetes.io/projected/9303d324-812e-4154-907e-63865d73600f-kube-api-access-q52px\") pod \"e2e-api-a-b888d0-openshift-default-65d785fbfc-wgpfl\" (UID: \"9303d324-812e-4154-907e-63865d73600f\") " pod="openshift-ingress/e2e-api-a-b888d0-openshift-default-65d785fbfc-wgpfl"
Oct 30 21:10:42.225419 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:10:42.225390    6004 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-b888d0-openshift-default-65d785fbfc-wgpfl"
Oct 30 21:10:42.258475 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:10:42.258442    6004 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w6-7eaf74-6f597b8c87-jjsw8" event={"ID":"118ff52d-4872-4408-b3d2-feab54040b8b","Type":"ContainerStarted","Data":"0045683d77851249ff562ce2c654e64a736f6999fcfedaf010c3395619dd3d95"}
Oct 30 21:10:42.663951 ip-10-0-138-85 kubenswrapper[6004]: W1030 21:10:42.663921    6004 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9303d324_812e_4154_907e_63865d73600f.slice/crio-49f175a89e5b76bfdba4dcd4b2f0a457093292727bca5a16fc09ee1c00a969a2 WatchSource:0}: Error finding container 49f175a89e5b76bfdba4dcd4b2f0a457093292727bca5a16fc09ee1c00a969a2: Status 404 returned error can't find the container with id 49f175a89e5b76bfdba4dcd4b2f0a457093292727bca5a16fc09ee1c00a969a2
Oct 30 21:10:42.665717 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:10:42.665689    6004 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-b888d0-openshift-default-65d785fbfc-wgpfl"]
Oct 30 21:10:42.667549 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:10:42.667512    6004 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 21:10:42.667654 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:10:42.667594    6004 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 21:10:42.667654 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:10:42.667642    6004 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 21:10:43.268444 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:10:43.268403    6004 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w6-7eaf74-6f597b8c87-jjsw8" event={"ID":"118ff52d-4872-4408-b3d2-feab54040b8b","Type":"ContainerStarted","Data":"8969577b56dbcac51c4220e7165f13676afba6d0f4f4a3be134e9f377bf54809"}
Oct 30 21:10:43.268749 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:10:43.268632    6004 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w6-7eaf74-6f597b8c87-jjsw8"
Oct 30 21:10:43.270470 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:10:43.270435    6004 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-b888d0-openshift-default-65d785fbfc-wgpfl" event={"ID":"9303d324-812e-4154-907e-63865d73600f","Type":"ContainerStarted","Data":"87638f5c802f78c4083a89691d97e9abd9b173ce015022cb8b15e823d261d1b6"}
Oct 30 21:10:43.270610 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:10:43.270495    6004 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-b888d0-openshift-default-65d785fbfc-wgpfl" event={"ID":"9303d324-812e-4154-907e-63865d73600f","Type":"ContainerStarted","Data":"49f175a89e5b76bfdba4dcd4b2f0a457093292727bca5a16fc09ee1c00a969a2"}
Oct 30 21:10:43.390119 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:10:43.390042    6004 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w6-7eaf74-6f597b8c87-jjsw8" podStartSLOduration=2.575310173 podStartE2EDuration="3.390022353s" totalImagesPullingTime="814.71218ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:10:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:10:43.385040612 +0000 UTC m=+1949.304826729" watchObservedRunningTime="2026-10-30 21:10:43.390022353 +0000 UTC m=+1949.309808472"
Oct 30 21:10:43.546138 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:10:43.535901    6004 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-api-a-b888d0-openshift-default-65d785fbfc-wgpfl" podStartSLOduration=2.535877767 podStartE2EDuration="2.535877767s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:10:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:10:43.526728877 +0000 UTC m=+1949.446514987" watchObservedRunningTime="2026-10-30 21:10:43.535877767 +0000 UTC m=+1949.455663888"
Oct 30 21:10:44.227794 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:10:44.227764    6004 patch_prober.go:29] interesting pod/e2e-api-a-b888d0-openshift-default-65d785fbfc-wgpfl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.104:15021/healthz/ready\": dial tcp 10.132.0.104:15021: connect: connection refused" start-of-body=
Oct 30 21:10:44.228240 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:10:44.227816    6004 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-b888d0-openshift-default-65d785fbfc-wgpfl" podUID="9303d324-812e-4154-907e-63865d73600f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.104:15021/healthz/ready\": dial tcp 10.132.0.104:15021: connect: connection refused"
Oct 30 21:10:44.233077 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:10:44.233038    6004 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-b888d0-openshift-default-65d785fbfc-wgpfl"
Oct 30 21:10:44.264586 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:10:44.264553    6004 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-ef7e2d-84b4ffb448-hmts8"
Oct 30 21:10:44.290110 ip-10-0-138-85 kubenswrapper[6004]: E1030 21:10:44.290075    6004 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-zz4wr" containerName="extractor"
Oct 30 21:10:45.225951 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:10:45.225916    6004 patch_prober.go:29] interesting pod/e2e-api-a-b888d0-openshift-default-65d785fbfc-wgpfl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.104:15021/healthz/ready\": dial tcp 10.132.0.104:15021: connect: connection refused" start-of-body=
Oct 30 21:10:45.226133 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:10:45.225966    6004 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-b888d0-openshift-default-65d785fbfc-wgpfl" podUID="9303d324-812e-4154-907e-63865d73600f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.104:15021/healthz/ready\": dial tcp 10.132.0.104:15021: connect: connection refused"
Oct 30 21:10:46.226714 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:10:46.226681    6004 patch_prober.go:29] interesting pod/e2e-api-a-b888d0-openshift-default-65d785fbfc-wgpfl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.104:15021/healthz/ready\": dial tcp 10.132.0.104:15021: connect: connection refused" start-of-body=
Oct 30 21:10:46.227239 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:10:46.226775    6004 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-b888d0-openshift-default-65d785fbfc-wgpfl" podUID="9303d324-812e-4154-907e-63865d73600f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.104:15021/healthz/ready\": dial tcp 10.132.0.104:15021: connect: connection refused"
Oct 30 21:10:46.821319 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:10:46.821279    6004 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-cb6404-58c85d58f9-25k64"]
Oct 30 21:10:46.848435 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:10:46.848367    6004 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-cb6404-58c85d58f9-25k64"
Oct 30 21:10:46.893409 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:10:46.893372    6004 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-cb6404-58c85d58f9-25k64"]
Oct 30 21:10:46.944162 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:10:46.938175    6004 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-api-b-cb6404\""
Oct 30 21:10:46.944162 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:10:46.938846    6004 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-api-b-cb6404-dockercfg-xhgrz\""
Oct 30 21:10:47.129203 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:10:47.129074    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/32c8cf2d-a21e-46da-97a4-dacb149d0f7a-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-b-cb6404-58c85d58f9-25k64\" (UID: \"32c8cf2d-a21e-46da-97a4-dacb149d0f7a\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-cb6404-58c85d58f9-25k64"
Oct 30 21:10:47.159335 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:10:47.155314    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z4t5l\" (UniqueName: \"kubernetes.io/projected/32c8cf2d-a21e-46da-97a4-dacb149d0f7a-kube-api-access-z4t5l\") pod \"payload-pre-processing-e2e-api-b-cb6404-58c85d58f9-25k64\" (UID: \"32c8cf2d-a21e-46da-97a4-dacb149d0f7a\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-cb6404-58c85d58f9-25k64"
Oct 30 21:10:47.226192 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:10:47.226155    6004 patch_prober.go:29] interesting pod/e2e-api-a-b888d0-openshift-default-65d785fbfc-wgpfl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.104:15021/healthz/ready\": dial tcp 10.132.0.104:15021: connect: connection refused" start-of-body=
Oct 30 21:10:47.226356 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:10:47.226225    6004 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-b888d0-openshift-default-65d785fbfc-wgpfl" podUID="9303d324-812e-4154-907e-63865d73600f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.104:15021/healthz/ready\": dial tcp 10.132.0.104:15021: connect: connection refused"
Oct 30 21:10:47.258073 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:10:47.257848    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/32c8cf2d-a21e-46da-97a4-dacb149d0f7a-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-b-cb6404-58c85d58f9-25k64\" (UID: \"32c8cf2d-a21e-46da-97a4-dacb149d0f7a\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-cb6404-58c85d58f9-25k64"
Oct 30 21:10:47.258073 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:10:47.257957    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z4t5l\" (UniqueName: \"kubernetes.io/projected/32c8cf2d-a21e-46da-97a4-dacb149d0f7a-kube-api-access-z4t5l\") pod \"payload-pre-processing-e2e-api-b-cb6404-58c85d58f9-25k64\" (UID: \"32c8cf2d-a21e-46da-97a4-dacb149d0f7a\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-cb6404-58c85d58f9-25k64"
Oct 30 21:10:47.267095 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:10:47.260580    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/32c8cf2d-a21e-46da-97a4-dacb149d0f7a-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-b-cb6404-58c85d58f9-25k64\" (UID: \"32c8cf2d-a21e-46da-97a4-dacb149d0f7a\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-cb6404-58c85d58f9-25k64"
Oct 30 21:10:47.316685 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:10:47.316652    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z4t5l\" (UniqueName: \"kubernetes.io/projected/32c8cf2d-a21e-46da-97a4-dacb149d0f7a-kube-api-access-z4t5l\") pod \"payload-pre-processing-e2e-api-b-cb6404-58c85d58f9-25k64\" (UID: \"32c8cf2d-a21e-46da-97a4-dacb149d0f7a\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-cb6404-58c85d58f9-25k64"
Oct 30 21:10:47.486329 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:10:47.486289    6004 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-cb6404-58c85d58f9-25k64"
Oct 30 21:10:47.889206 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:10:47.887588    6004 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-cb6404-58c85d58f9-25k64"]
Oct 30 21:10:47.889206 ip-10-0-138-85 kubenswrapper[6004]: W1030 21:10:47.888529    6004 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod32c8cf2d_a21e_46da_97a4_dacb149d0f7a.slice/crio-2bfb66d103e6e2a834a778cdf561e971ab355db55864c54eb3f63b387bb99ace WatchSource:0}: Error finding container 2bfb66d103e6e2a834a778cdf561e971ab355db55864c54eb3f63b387bb99ace: Status 404 returned error can't find the container with id 2bfb66d103e6e2a834a778cdf561e971ab355db55864c54eb3f63b387bb99ace
Oct 30 21:10:48.225773 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:10:48.225742    6004 patch_prober.go:29] interesting pod/e2e-api-a-b888d0-openshift-default-65d785fbfc-wgpfl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.104:15021/healthz/ready\": dial tcp 10.132.0.104:15021: connect: connection refused" start-of-body=
Oct 30 21:10:48.225941 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:10:48.225798    6004 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-b888d0-openshift-default-65d785fbfc-wgpfl" podUID="9303d324-812e-4154-907e-63865d73600f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.104:15021/healthz/ready\": dial tcp 10.132.0.104:15021: connect: connection refused"
Oct 30 21:10:48.306342 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:10:48.306301    6004 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-cb6404-58c85d58f9-25k64" event={"ID":"32c8cf2d-a21e-46da-97a4-dacb149d0f7a","Type":"ContainerStarted","Data":"2bfb66d103e6e2a834a778cdf561e971ab355db55864c54eb3f63b387bb99ace"}
Oct 30 21:10:49.231627 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:10:49.231595    6004 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-b888d0-openshift-default-65d785fbfc-wgpfl"
Oct 30 21:10:49.232117 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:10:49.232089    6004 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-b888d0-openshift-default-65d785fbfc-wgpfl"
Oct 30 21:10:49.232835 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:10:49.232809    6004 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-b888d0-openshift-default-65d785fbfc-wgpfl"
Oct 30 21:10:49.284700 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:10:49.284669    6004 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w6-7eaf74-6f597b8c87-jjsw8"
Oct 30 21:10:51.332862 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:10:51.332824    6004 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-cb6404-58c85d58f9-25k64" event={"ID":"32c8cf2d-a21e-46da-97a4-dacb149d0f7a","Type":"ContainerStarted","Data":"bacb7ff74876143c747f46ccb807df48e7c4e8d284ca60ff1812631bbe9b25f6"}
Oct 30 21:10:51.333325 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:10:51.332970    6004 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-api-b-cb6404-58c85d58f9-25k64"
Oct 30 21:10:51.450011 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:10:51.449950    6004 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-api-b-cb6404-58c85d58f9-25k64" podStartSLOduration=2.74198384 podStartE2EDuration="5.449933144s" totalImagesPullingTime="2.707949304s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:10:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:10:51.448034117 +0000 UTC m=+1957.367820236" watchObservedRunningTime="2026-10-30 21:10:51.449933144 +0000 UTC m=+1957.369719274"
Oct 30 21:11:00.923690 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:11:00.923654    6004 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w1-677b45-589b4db885-9lrlm"]
Oct 30 21:11:00.931738 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:11:00.931710    6004 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w1-677b45-589b4db885-9lrlm"
Oct 30 21:11:00.985208 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:11:00.985174    6004 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-b-w1-677b45-serving-cert\""
Oct 30 21:11:00.997946 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:11:00.997908    6004 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w1-677b45-589b4db885-9lrlm"]
Oct 30 21:11:01.113964 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:11:01.113923    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/801ac95e-5a0b-4e42-a632-33fa0536fc44-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w1-677b45-589b4db885-9lrlm\" (UID: \"801ac95e-5a0b-4e42-a632-33fa0536fc44\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w1-677b45-589b4db885-9lrlm"
Oct 30 21:11:01.114203 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:11:01.113984    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/801ac95e-5a0b-4e42-a632-33fa0536fc44-maas-api-tls\") pod \"maas-api-e2e-shared-b-w1-677b45-589b4db885-9lrlm\" (UID: \"801ac95e-5a0b-4e42-a632-33fa0536fc44\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w1-677b45-589b4db885-9lrlm"
Oct 30 21:11:01.114203 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:11:01.114097    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zm8mb\" (UniqueName: \"kubernetes.io/projected/801ac95e-5a0b-4e42-a632-33fa0536fc44-kube-api-access-zm8mb\") pod \"maas-api-e2e-shared-b-w1-677b45-589b4db885-9lrlm\" (UID: \"801ac95e-5a0b-4e42-a632-33fa0536fc44\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w1-677b45-589b4db885-9lrlm"
Oct 30 21:11:01.114327 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:11:01.114269    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/801ac95e-5a0b-4e42-a632-33fa0536fc44-metrics-certs\") pod \"maas-api-e2e-shared-b-w1-677b45-589b4db885-9lrlm\" (UID: \"801ac95e-5a0b-4e42-a632-33fa0536fc44\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w1-677b45-589b4db885-9lrlm"
Oct 30 21:11:01.217639 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:11:01.215644    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/801ac95e-5a0b-4e42-a632-33fa0536fc44-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w1-677b45-589b4db885-9lrlm\" (UID: \"801ac95e-5a0b-4e42-a632-33fa0536fc44\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w1-677b45-589b4db885-9lrlm"
Oct 30 21:11:01.217949 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:11:01.217910    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/801ac95e-5a0b-4e42-a632-33fa0536fc44-maas-api-tls\") pod \"maas-api-e2e-shared-b-w1-677b45-589b4db885-9lrlm\" (UID: \"801ac95e-5a0b-4e42-a632-33fa0536fc44\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w1-677b45-589b4db885-9lrlm"
Oct 30 21:11:01.218115 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:11:01.218029    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zm8mb\" (UniqueName: \"kubernetes.io/projected/801ac95e-5a0b-4e42-a632-33fa0536fc44-kube-api-access-zm8mb\") pod \"maas-api-e2e-shared-b-w1-677b45-589b4db885-9lrlm\" (UID: \"801ac95e-5a0b-4e42-a632-33fa0536fc44\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w1-677b45-589b4db885-9lrlm"
Oct 30 21:11:01.218239 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:11:01.218223    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/801ac95e-5a0b-4e42-a632-33fa0536fc44-metrics-certs\") pod \"maas-api-e2e-shared-b-w1-677b45-589b4db885-9lrlm\" (UID: \"801ac95e-5a0b-4e42-a632-33fa0536fc44\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w1-677b45-589b4db885-9lrlm"
Oct 30 21:11:01.218781 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:11:01.216658    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/801ac95e-5a0b-4e42-a632-33fa0536fc44-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w1-677b45-589b4db885-9lrlm\" (UID: \"801ac95e-5a0b-4e42-a632-33fa0536fc44\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w1-677b45-589b4db885-9lrlm"
Oct 30 21:11:01.218935 ip-10-0-138-85 kubenswrapper[6004]: E1030 21:11:01.218780    6004 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-b-w1-677b45-serving-cert: secret "maas-api-e2e-shared-b-w1-677b45-serving-cert" not found
Oct 30 21:11:01.219034 ip-10-0-138-85 kubenswrapper[6004]: E1030 21:11:01.219005    6004 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/801ac95e-5a0b-4e42-a632-33fa0536fc44-maas-api-tls podName:801ac95e-5a0b-4e42-a632-33fa0536fc44 nodeName:}" failed. No retries permitted until 2026-10-30 21:11:01.718981177 +0000 UTC m=+1967.638767276 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/801ac95e-5a0b-4e42-a632-33fa0536fc44-maas-api-tls") pod "maas-api-e2e-shared-b-w1-677b45-589b4db885-9lrlm" (UID: "801ac95e-5a0b-4e42-a632-33fa0536fc44") : secret "maas-api-e2e-shared-b-w1-677b45-serving-cert" not found
Oct 30 21:11:01.221457 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:11:01.221433    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/801ac95e-5a0b-4e42-a632-33fa0536fc44-metrics-certs\") pod \"maas-api-e2e-shared-b-w1-677b45-589b4db885-9lrlm\" (UID: \"801ac95e-5a0b-4e42-a632-33fa0536fc44\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w1-677b45-589b4db885-9lrlm"
Oct 30 21:11:01.285650 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:11:01.285621    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zm8mb\" (UniqueName: \"kubernetes.io/projected/801ac95e-5a0b-4e42-a632-33fa0536fc44-kube-api-access-zm8mb\") pod \"maas-api-e2e-shared-b-w1-677b45-589b4db885-9lrlm\" (UID: \"801ac95e-5a0b-4e42-a632-33fa0536fc44\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w1-677b45-589b4db885-9lrlm"
Oct 30 21:11:01.725364 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:11:01.725317    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/801ac95e-5a0b-4e42-a632-33fa0536fc44-maas-api-tls\") pod \"maas-api-e2e-shared-b-w1-677b45-589b4db885-9lrlm\" (UID: \"801ac95e-5a0b-4e42-a632-33fa0536fc44\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w1-677b45-589b4db885-9lrlm"
Oct 30 21:11:01.727814 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:11:01.727788    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/801ac95e-5a0b-4e42-a632-33fa0536fc44-maas-api-tls\") pod \"maas-api-e2e-shared-b-w1-677b45-589b4db885-9lrlm\" (UID: \"801ac95e-5a0b-4e42-a632-33fa0536fc44\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w1-677b45-589b4db885-9lrlm"
Oct 30 21:11:01.849382 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:11:01.849348    6004 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w1-677b45-589b4db885-9lrlm"
Oct 30 21:11:02.240740 ip-10-0-138-85 kubenswrapper[6004]: W1030 21:11:02.240713    6004 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod801ac95e_5a0b_4e42_a632_33fa0536fc44.slice/crio-406534f8cd611b4ccf1109714a814a55e9ad8a4e1e57865c138d57a16e1a83f3 WatchSource:0}: Error finding container 406534f8cd611b4ccf1109714a814a55e9ad8a4e1e57865c138d57a16e1a83f3: Status 404 returned error can't find the container with id 406534f8cd611b4ccf1109714a814a55e9ad8a4e1e57865c138d57a16e1a83f3
Oct 30 21:11:02.241088 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:11:02.240988    6004 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w1-677b45-589b4db885-9lrlm"]
Oct 30 21:11:02.346763 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:11:02.346732    6004 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-api-b-cb6404-58c85d58f9-25k64"
Oct 30 21:11:02.430433 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:11:02.430395    6004 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w1-677b45-589b4db885-9lrlm" event={"ID":"801ac95e-5a0b-4e42-a632-33fa0536fc44","Type":"ContainerStarted","Data":"406534f8cd611b4ccf1109714a814a55e9ad8a4e1e57865c138d57a16e1a83f3"}
Oct 30 21:11:03.443409 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:11:03.443366    6004 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w1-677b45-589b4db885-9lrlm" event={"ID":"801ac95e-5a0b-4e42-a632-33fa0536fc44","Type":"ContainerStarted","Data":"ef4e4747c7ad294b9b8866ca8ea26697c0be0931a102892a5f858a8198fdc268"}
Oct 30 21:11:03.443856 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:11:03.443456    6004 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w1-677b45-589b4db885-9lrlm"
Oct 30 21:11:03.564419 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:11:03.564347    6004 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w1-677b45-589b4db885-9lrlm" podStartSLOduration=2.782633486 podStartE2EDuration="3.564329199s" totalImagesPullingTime="781.695713ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:11:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:11:03.561530597 +0000 UTC m=+1969.481316717" watchObservedRunningTime="2026-10-30 21:11:03.564329199 +0000 UTC m=+1969.484115321"
Oct 30 21:11:08.996074 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:11:08.996017    6004 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-w6-7eaf74-openshift-default-69c8f48765-2rvzl"]
Oct 30 21:11:09.000597 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:11:09.000565    6004 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w6-7eaf74-openshift-default-69c8f48765-2rvzl"
Oct 30 21:11:09.132655 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:11:09.132623    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/18f44298-4c12-4e81-942d-f8fdee2e968f-istio-data\") pod \"e2e-shared-b-w6-7eaf74-openshift-default-69c8f48765-2rvzl\" (UID: \"18f44298-4c12-4e81-942d-f8fdee2e968f\") " pod="openshift-ingress/e2e-shared-b-w6-7eaf74-openshift-default-69c8f48765-2rvzl"
Oct 30 21:11:09.132655 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:11:09.132660    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/18f44298-4c12-4e81-942d-f8fdee2e968f-istio-envoy\") pod \"e2e-shared-b-w6-7eaf74-openshift-default-69c8f48765-2rvzl\" (UID: \"18f44298-4c12-4e81-942d-f8fdee2e968f\") " pod="openshift-ingress/e2e-shared-b-w6-7eaf74-openshift-default-69c8f48765-2rvzl"
Oct 30 21:11:09.132896 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:11:09.132693    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/18f44298-4c12-4e81-942d-f8fdee2e968f-workload-socket\") pod \"e2e-shared-b-w6-7eaf74-openshift-default-69c8f48765-2rvzl\" (UID: \"18f44298-4c12-4e81-942d-f8fdee2e968f\") " pod="openshift-ingress/e2e-shared-b-w6-7eaf74-openshift-default-69c8f48765-2rvzl"
Oct 30 21:11:09.132896 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:11:09.132746    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/18f44298-4c12-4e81-942d-f8fdee2e968f-istiod-ca-cert\") pod \"e2e-shared-b-w6-7eaf74-openshift-default-69c8f48765-2rvzl\" (UID: \"18f44298-4c12-4e81-942d-f8fdee2e968f\") " pod="openshift-ingress/e2e-shared-b-w6-7eaf74-openshift-default-69c8f48765-2rvzl"
Oct 30 21:11:09.132896 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:11:09.132797    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wswfm\" (UniqueName: \"kubernetes.io/projected/18f44298-4c12-4e81-942d-f8fdee2e968f-kube-api-access-wswfm\") pod \"e2e-shared-b-w6-7eaf74-openshift-default-69c8f48765-2rvzl\" (UID: \"18f44298-4c12-4e81-942d-f8fdee2e968f\") " pod="openshift-ingress/e2e-shared-b-w6-7eaf74-openshift-default-69c8f48765-2rvzl"
Oct 30 21:11:09.132896 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:11:09.132868    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/18f44298-4c12-4e81-942d-f8fdee2e968f-workload-certs\") pod \"e2e-shared-b-w6-7eaf74-openshift-default-69c8f48765-2rvzl\" (UID: \"18f44298-4c12-4e81-942d-f8fdee2e968f\") " pod="openshift-ingress/e2e-shared-b-w6-7eaf74-openshift-default-69c8f48765-2rvzl"
Oct 30 21:11:09.133111 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:11:09.133032    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/18f44298-4c12-4e81-942d-f8fdee2e968f-istio-podinfo\") pod \"e2e-shared-b-w6-7eaf74-openshift-default-69c8f48765-2rvzl\" (UID: \"18f44298-4c12-4e81-942d-f8fdee2e968f\") " pod="openshift-ingress/e2e-shared-b-w6-7eaf74-openshift-default-69c8f48765-2rvzl"
Oct 30 21:11:09.133161 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:11:09.133129    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/18f44298-4c12-4e81-942d-f8fdee2e968f-istio-token\") pod \"e2e-shared-b-w6-7eaf74-openshift-default-69c8f48765-2rvzl\" (UID: \"18f44298-4c12-4e81-942d-f8fdee2e968f\") " pod="openshift-ingress/e2e-shared-b-w6-7eaf74-openshift-default-69c8f48765-2rvzl"
Oct 30 21:11:09.133216 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:11:09.133186    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/18f44298-4c12-4e81-942d-f8fdee2e968f-credential-socket\") pod \"e2e-shared-b-w6-7eaf74-openshift-default-69c8f48765-2rvzl\" (UID: \"18f44298-4c12-4e81-942d-f8fdee2e968f\") " pod="openshift-ingress/e2e-shared-b-w6-7eaf74-openshift-default-69c8f48765-2rvzl"
Oct 30 21:11:09.168178 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:11:09.168148    6004 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-w6-7eaf74-openshift-default-dockercfg-n66xg\""
Oct 30 21:11:09.205259 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:11:09.205227    6004 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-w6-7eaf74-openshift-default-69c8f48765-2rvzl"]
Oct 30 21:11:09.234525 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:11:09.234491    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/18f44298-4c12-4e81-942d-f8fdee2e968f-istio-data\") pod \"e2e-shared-b-w6-7eaf74-openshift-default-69c8f48765-2rvzl\" (UID: \"18f44298-4c12-4e81-942d-f8fdee2e968f\") " pod="openshift-ingress/e2e-shared-b-w6-7eaf74-openshift-default-69c8f48765-2rvzl"
Oct 30 21:11:09.234525 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:11:09.234527    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/18f44298-4c12-4e81-942d-f8fdee2e968f-istio-envoy\") pod \"e2e-shared-b-w6-7eaf74-openshift-default-69c8f48765-2rvzl\" (UID: \"18f44298-4c12-4e81-942d-f8fdee2e968f\") " pod="openshift-ingress/e2e-shared-b-w6-7eaf74-openshift-default-69c8f48765-2rvzl"
Oct 30 21:11:09.234765 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:11:09.234560    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/18f44298-4c12-4e81-942d-f8fdee2e968f-workload-socket\") pod \"e2e-shared-b-w6-7eaf74-openshift-default-69c8f48765-2rvzl\" (UID: \"18f44298-4c12-4e81-942d-f8fdee2e968f\") " pod="openshift-ingress/e2e-shared-b-w6-7eaf74-openshift-default-69c8f48765-2rvzl"
Oct 30 21:11:09.234765 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:11:09.234587    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/18f44298-4c12-4e81-942d-f8fdee2e968f-istiod-ca-cert\") pod \"e2e-shared-b-w6-7eaf74-openshift-default-69c8f48765-2rvzl\" (UID: \"18f44298-4c12-4e81-942d-f8fdee2e968f\") " pod="openshift-ingress/e2e-shared-b-w6-7eaf74-openshift-default-69c8f48765-2rvzl"
Oct 30 21:11:09.234765 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:11:09.234614    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wswfm\" (UniqueName: \"kubernetes.io/projected/18f44298-4c12-4e81-942d-f8fdee2e968f-kube-api-access-wswfm\") pod \"e2e-shared-b-w6-7eaf74-openshift-default-69c8f48765-2rvzl\" (UID: \"18f44298-4c12-4e81-942d-f8fdee2e968f\") " pod="openshift-ingress/e2e-shared-b-w6-7eaf74-openshift-default-69c8f48765-2rvzl"
Oct 30 21:11:09.234765 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:11:09.234663    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/18f44298-4c12-4e81-942d-f8fdee2e968f-workload-certs\") pod \"e2e-shared-b-w6-7eaf74-openshift-default-69c8f48765-2rvzl\" (UID: \"18f44298-4c12-4e81-942d-f8fdee2e968f\") " pod="openshift-ingress/e2e-shared-b-w6-7eaf74-openshift-default-69c8f48765-2rvzl"
Oct 30 21:11:09.235115 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:11:09.234776    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/18f44298-4c12-4e81-942d-f8fdee2e968f-istio-podinfo\") pod \"e2e-shared-b-w6-7eaf74-openshift-default-69c8f48765-2rvzl\" (UID: \"18f44298-4c12-4e81-942d-f8fdee2e968f\") " pod="openshift-ingress/e2e-shared-b-w6-7eaf74-openshift-default-69c8f48765-2rvzl"
Oct 30 21:11:09.235115 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:11:09.234852    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/18f44298-4c12-4e81-942d-f8fdee2e968f-istio-token\") pod \"e2e-shared-b-w6-7eaf74-openshift-default-69c8f48765-2rvzl\" (UID: \"18f44298-4c12-4e81-942d-f8fdee2e968f\") " pod="openshift-ingress/e2e-shared-b-w6-7eaf74-openshift-default-69c8f48765-2rvzl"
Oct 30 21:11:09.235115 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:11:09.234910    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/18f44298-4c12-4e81-942d-f8fdee2e968f-credential-socket\") pod \"e2e-shared-b-w6-7eaf74-openshift-default-69c8f48765-2rvzl\" (UID: \"18f44298-4c12-4e81-942d-f8fdee2e968f\") " pod="openshift-ingress/e2e-shared-b-w6-7eaf74-openshift-default-69c8f48765-2rvzl"
Oct 30 21:11:09.235115 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:11:09.234946    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/18f44298-4c12-4e81-942d-f8fdee2e968f-istio-data\") pod \"e2e-shared-b-w6-7eaf74-openshift-default-69c8f48765-2rvzl\" (UID: \"18f44298-4c12-4e81-942d-f8fdee2e968f\") " pod="openshift-ingress/e2e-shared-b-w6-7eaf74-openshift-default-69c8f48765-2rvzl"
Oct 30 21:11:09.235387 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:11:09.235240    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/18f44298-4c12-4e81-942d-f8fdee2e968f-credential-socket\") pod \"e2e-shared-b-w6-7eaf74-openshift-default-69c8f48765-2rvzl\" (UID: \"18f44298-4c12-4e81-942d-f8fdee2e968f\") " pod="openshift-ingress/e2e-shared-b-w6-7eaf74-openshift-default-69c8f48765-2rvzl"
Oct 30 21:11:09.235543 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:11:09.235521    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/18f44298-4c12-4e81-942d-f8fdee2e968f-workload-certs\") pod \"e2e-shared-b-w6-7eaf74-openshift-default-69c8f48765-2rvzl\" (UID: \"18f44298-4c12-4e81-942d-f8fdee2e968f\") " pod="openshift-ingress/e2e-shared-b-w6-7eaf74-openshift-default-69c8f48765-2rvzl"
Oct 30 21:11:09.236718 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:11:09.236670    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/18f44298-4c12-4e81-942d-f8fdee2e968f-istiod-ca-cert\") pod \"e2e-shared-b-w6-7eaf74-openshift-default-69c8f48765-2rvzl\" (UID: \"18f44298-4c12-4e81-942d-f8fdee2e968f\") " pod="openshift-ingress/e2e-shared-b-w6-7eaf74-openshift-default-69c8f48765-2rvzl"
Oct 30 21:11:09.237143 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:11:09.237120    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/18f44298-4c12-4e81-942d-f8fdee2e968f-workload-socket\") pod \"e2e-shared-b-w6-7eaf74-openshift-default-69c8f48765-2rvzl\" (UID: \"18f44298-4c12-4e81-942d-f8fdee2e968f\") " pod="openshift-ingress/e2e-shared-b-w6-7eaf74-openshift-default-69c8f48765-2rvzl"
Oct 30 21:11:09.240087 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:11:09.239211    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/18f44298-4c12-4e81-942d-f8fdee2e968f-istio-envoy\") pod \"e2e-shared-b-w6-7eaf74-openshift-default-69c8f48765-2rvzl\" (UID: \"18f44298-4c12-4e81-942d-f8fdee2e968f\") " pod="openshift-ingress/e2e-shared-b-w6-7eaf74-openshift-default-69c8f48765-2rvzl"
Oct 30 21:11:09.240087 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:11:09.240003    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/18f44298-4c12-4e81-942d-f8fdee2e968f-istio-podinfo\") pod \"e2e-shared-b-w6-7eaf74-openshift-default-69c8f48765-2rvzl\" (UID: \"18f44298-4c12-4e81-942d-f8fdee2e968f\") " pod="openshift-ingress/e2e-shared-b-w6-7eaf74-openshift-default-69c8f48765-2rvzl"
Oct 30 21:11:09.304509 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:11:09.304434    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wswfm\" (UniqueName: \"kubernetes.io/projected/18f44298-4c12-4e81-942d-f8fdee2e968f-kube-api-access-wswfm\") pod \"e2e-shared-b-w6-7eaf74-openshift-default-69c8f48765-2rvzl\" (UID: \"18f44298-4c12-4e81-942d-f8fdee2e968f\") " pod="openshift-ingress/e2e-shared-b-w6-7eaf74-openshift-default-69c8f48765-2rvzl"
Oct 30 21:11:09.308086 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:11:09.308045    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/18f44298-4c12-4e81-942d-f8fdee2e968f-istio-token\") pod \"e2e-shared-b-w6-7eaf74-openshift-default-69c8f48765-2rvzl\" (UID: \"18f44298-4c12-4e81-942d-f8fdee2e968f\") " pod="openshift-ingress/e2e-shared-b-w6-7eaf74-openshift-default-69c8f48765-2rvzl"
Oct 30 21:11:09.314979 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:11:09.314952    6004 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w6-7eaf74-openshift-default-69c8f48765-2rvzl"
Oct 30 21:11:09.315620 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:11:09.315597    6004 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-a-ef7e2d-openshift-default-6b6dbc765f-sg5h8"]
Oct 30 21:11:09.320003 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:11:09.319984    6004 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-ef7e2d-openshift-default-6b6dbc765f-sg5h8"
Oct 30 21:11:09.405315 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:11:09.405284    6004 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-ef7e2d-openshift-default-6b6dbc765f-sg5h8"]
Oct 30 21:11:09.438534 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:11:09.438488    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/21c116c2-4862-424a-bedf-41fba3b2612d-credential-socket\") pod \"e2e-api-a-ef7e2d-openshift-default-6b6dbc765f-sg5h8\" (UID: \"21c116c2-4862-424a-bedf-41fba3b2612d\") " pod="openshift-ingress/e2e-api-a-ef7e2d-openshift-default-6b6dbc765f-sg5h8"
Oct 30 21:11:09.438777 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:11:09.438759    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/21c116c2-4862-424a-bedf-41fba3b2612d-istio-envoy\") pod \"e2e-api-a-ef7e2d-openshift-default-6b6dbc765f-sg5h8\" (UID: \"21c116c2-4862-424a-bedf-41fba3b2612d\") " pod="openshift-ingress/e2e-api-a-ef7e2d-openshift-default-6b6dbc765f-sg5h8"
Oct 30 21:11:09.438916 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:11:09.438900    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/21c116c2-4862-424a-bedf-41fba3b2612d-istio-data\") pod \"e2e-api-a-ef7e2d-openshift-default-6b6dbc765f-sg5h8\" (UID: \"21c116c2-4862-424a-bedf-41fba3b2612d\") " pod="openshift-ingress/e2e-api-a-ef7e2d-openshift-default-6b6dbc765f-sg5h8"
Oct 30 21:11:09.439027 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:11:09.439013    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/21c116c2-4862-424a-bedf-41fba3b2612d-workload-certs\") pod \"e2e-api-a-ef7e2d-openshift-default-6b6dbc765f-sg5h8\" (UID: \"21c116c2-4862-424a-bedf-41fba3b2612d\") " pod="openshift-ingress/e2e-api-a-ef7e2d-openshift-default-6b6dbc765f-sg5h8"
Oct 30 21:11:09.439191 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:11:09.439171    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/21c116c2-4862-424a-bedf-41fba3b2612d-istio-token\") pod \"e2e-api-a-ef7e2d-openshift-default-6b6dbc765f-sg5h8\" (UID: \"21c116c2-4862-424a-bedf-41fba3b2612d\") " pod="openshift-ingress/e2e-api-a-ef7e2d-openshift-default-6b6dbc765f-sg5h8"
Oct 30 21:11:09.439261 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:11:09.439238    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2jsk9\" (UniqueName: \"kubernetes.io/projected/21c116c2-4862-424a-bedf-41fba3b2612d-kube-api-access-2jsk9\") pod \"e2e-api-a-ef7e2d-openshift-default-6b6dbc765f-sg5h8\" (UID: \"21c116c2-4862-424a-bedf-41fba3b2612d\") " pod="openshift-ingress/e2e-api-a-ef7e2d-openshift-default-6b6dbc765f-sg5h8"
Oct 30 21:11:09.439320 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:11:09.439277    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/21c116c2-4862-424a-bedf-41fba3b2612d-istiod-ca-cert\") pod \"e2e-api-a-ef7e2d-openshift-default-6b6dbc765f-sg5h8\" (UID: \"21c116c2-4862-424a-bedf-41fba3b2612d\") " pod="openshift-ingress/e2e-api-a-ef7e2d-openshift-default-6b6dbc765f-sg5h8"
Oct 30 21:11:09.439374 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:11:09.439332    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/21c116c2-4862-424a-bedf-41fba3b2612d-workload-socket\") pod \"e2e-api-a-ef7e2d-openshift-default-6b6dbc765f-sg5h8\" (UID: \"21c116c2-4862-424a-bedf-41fba3b2612d\") " pod="openshift-ingress/e2e-api-a-ef7e2d-openshift-default-6b6dbc765f-sg5h8"
Oct 30 21:11:09.439431 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:11:09.439404    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/21c116c2-4862-424a-bedf-41fba3b2612d-istio-podinfo\") pod \"e2e-api-a-ef7e2d-openshift-default-6b6dbc765f-sg5h8\" (UID: \"21c116c2-4862-424a-bedf-41fba3b2612d\") " pod="openshift-ingress/e2e-api-a-ef7e2d-openshift-default-6b6dbc765f-sg5h8"
Oct 30 21:11:09.459981 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:11:09.459946    6004 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w1-677b45-589b4db885-9lrlm"
Oct 30 21:11:09.466202 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:11:09.466183    6004 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-a-ef7e2d-openshift-default-dockercfg-fhxft\""
Oct 30 21:11:09.540873 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:11:09.540830    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/21c116c2-4862-424a-bedf-41fba3b2612d-istio-podinfo\") pod \"e2e-api-a-ef7e2d-openshift-default-6b6dbc765f-sg5h8\" (UID: \"21c116c2-4862-424a-bedf-41fba3b2612d\") " pod="openshift-ingress/e2e-api-a-ef7e2d-openshift-default-6b6dbc765f-sg5h8"
Oct 30 21:11:09.541378 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:11:09.541005    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/21c116c2-4862-424a-bedf-41fba3b2612d-credential-socket\") pod \"e2e-api-a-ef7e2d-openshift-default-6b6dbc765f-sg5h8\" (UID: \"21c116c2-4862-424a-bedf-41fba3b2612d\") " pod="openshift-ingress/e2e-api-a-ef7e2d-openshift-default-6b6dbc765f-sg5h8"
Oct 30 21:11:09.541527 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:11:09.541431    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/21c116c2-4862-424a-bedf-41fba3b2612d-istio-envoy\") pod \"e2e-api-a-ef7e2d-openshift-default-6b6dbc765f-sg5h8\" (UID: \"21c116c2-4862-424a-bedf-41fba3b2612d\") " pod="openshift-ingress/e2e-api-a-ef7e2d-openshift-default-6b6dbc765f-sg5h8"
Oct 30 21:11:09.541527 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:11:09.541460    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/21c116c2-4862-424a-bedf-41fba3b2612d-credential-socket\") pod \"e2e-api-a-ef7e2d-openshift-default-6b6dbc765f-sg5h8\" (UID: \"21c116c2-4862-424a-bedf-41fba3b2612d\") " pod="openshift-ingress/e2e-api-a-ef7e2d-openshift-default-6b6dbc765f-sg5h8"
Oct 30 21:11:09.541641 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:11:09.541531    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/21c116c2-4862-424a-bedf-41fba3b2612d-istio-data\") pod \"e2e-api-a-ef7e2d-openshift-default-6b6dbc765f-sg5h8\" (UID: \"21c116c2-4862-424a-bedf-41fba3b2612d\") " pod="openshift-ingress/e2e-api-a-ef7e2d-openshift-default-6b6dbc765f-sg5h8"
Oct 30 21:11:09.541641 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:11:09.541565    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/21c116c2-4862-424a-bedf-41fba3b2612d-workload-certs\") pod \"e2e-api-a-ef7e2d-openshift-default-6b6dbc765f-sg5h8\" (UID: \"21c116c2-4862-424a-bedf-41fba3b2612d\") " pod="openshift-ingress/e2e-api-a-ef7e2d-openshift-default-6b6dbc765f-sg5h8"
Oct 30 21:11:09.541641 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:11:09.541601    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/21c116c2-4862-424a-bedf-41fba3b2612d-istio-token\") pod \"e2e-api-a-ef7e2d-openshift-default-6b6dbc765f-sg5h8\" (UID: \"21c116c2-4862-424a-bedf-41fba3b2612d\") " pod="openshift-ingress/e2e-api-a-ef7e2d-openshift-default-6b6dbc765f-sg5h8"
Oct 30 21:11:09.541804 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:11:09.541643    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2jsk9\" (UniqueName: \"kubernetes.io/projected/21c116c2-4862-424a-bedf-41fba3b2612d-kube-api-access-2jsk9\") pod \"e2e-api-a-ef7e2d-openshift-default-6b6dbc765f-sg5h8\" (UID: \"21c116c2-4862-424a-bedf-41fba3b2612d\") " pod="openshift-ingress/e2e-api-a-ef7e2d-openshift-default-6b6dbc765f-sg5h8"
Oct 30 21:11:09.541804 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:11:09.541676    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/21c116c2-4862-424a-bedf-41fba3b2612d-istiod-ca-cert\") pod \"e2e-api-a-ef7e2d-openshift-default-6b6dbc765f-sg5h8\" (UID: \"21c116c2-4862-424a-bedf-41fba3b2612d\") " pod="openshift-ingress/e2e-api-a-ef7e2d-openshift-default-6b6dbc765f-sg5h8"
Oct 30 21:11:09.541804 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:11:09.541705    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/21c116c2-4862-424a-bedf-41fba3b2612d-workload-socket\") pod \"e2e-api-a-ef7e2d-openshift-default-6b6dbc765f-sg5h8\" (UID: \"21c116c2-4862-424a-bedf-41fba3b2612d\") " pod="openshift-ingress/e2e-api-a-ef7e2d-openshift-default-6b6dbc765f-sg5h8"
Oct 30 21:11:09.542224 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:11:09.542165    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/21c116c2-4862-424a-bedf-41fba3b2612d-workload-certs\") pod \"e2e-api-a-ef7e2d-openshift-default-6b6dbc765f-sg5h8\" (UID: \"21c116c2-4862-424a-bedf-41fba3b2612d\") " pod="openshift-ingress/e2e-api-a-ef7e2d-openshift-default-6b6dbc765f-sg5h8"
Oct 30 21:11:09.542224 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:11:09.542160    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/21c116c2-4862-424a-bedf-41fba3b2612d-workload-socket\") pod \"e2e-api-a-ef7e2d-openshift-default-6b6dbc765f-sg5h8\" (UID: \"21c116c2-4862-424a-bedf-41fba3b2612d\") " pod="openshift-ingress/e2e-api-a-ef7e2d-openshift-default-6b6dbc765f-sg5h8"
Oct 30 21:11:09.542748 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:11:09.542726    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/21c116c2-4862-424a-bedf-41fba3b2612d-istiod-ca-cert\") pod \"e2e-api-a-ef7e2d-openshift-default-6b6dbc765f-sg5h8\" (UID: \"21c116c2-4862-424a-bedf-41fba3b2612d\") " pod="openshift-ingress/e2e-api-a-ef7e2d-openshift-default-6b6dbc765f-sg5h8"
Oct 30 21:11:09.542855 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:11:09.542830    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/21c116c2-4862-424a-bedf-41fba3b2612d-istio-data\") pod \"e2e-api-a-ef7e2d-openshift-default-6b6dbc765f-sg5h8\" (UID: \"21c116c2-4862-424a-bedf-41fba3b2612d\") " pod="openshift-ingress/e2e-api-a-ef7e2d-openshift-default-6b6dbc765f-sg5h8"
Oct 30 21:11:09.543753 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:11:09.543734    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/21c116c2-4862-424a-bedf-41fba3b2612d-istio-podinfo\") pod \"e2e-api-a-ef7e2d-openshift-default-6b6dbc765f-sg5h8\" (UID: \"21c116c2-4862-424a-bedf-41fba3b2612d\") " pod="openshift-ingress/e2e-api-a-ef7e2d-openshift-default-6b6dbc765f-sg5h8"
Oct 30 21:11:09.544018 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:11:09.543995    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/21c116c2-4862-424a-bedf-41fba3b2612d-istio-envoy\") pod \"e2e-api-a-ef7e2d-openshift-default-6b6dbc765f-sg5h8\" (UID: \"21c116c2-4862-424a-bedf-41fba3b2612d\") " pod="openshift-ingress/e2e-api-a-ef7e2d-openshift-default-6b6dbc765f-sg5h8"
Oct 30 21:11:09.599967 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:11:09.599894    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/21c116c2-4862-424a-bedf-41fba3b2612d-istio-token\") pod \"e2e-api-a-ef7e2d-openshift-default-6b6dbc765f-sg5h8\" (UID: \"21c116c2-4862-424a-bedf-41fba3b2612d\") " pod="openshift-ingress/e2e-api-a-ef7e2d-openshift-default-6b6dbc765f-sg5h8"
Oct 30 21:11:09.600161 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:11:09.600082    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2jsk9\" (UniqueName: \"kubernetes.io/projected/21c116c2-4862-424a-bedf-41fba3b2612d-kube-api-access-2jsk9\") pod \"e2e-api-a-ef7e2d-openshift-default-6b6dbc765f-sg5h8\" (UID: \"21c116c2-4862-424a-bedf-41fba3b2612d\") " pod="openshift-ingress/e2e-api-a-ef7e2d-openshift-default-6b6dbc765f-sg5h8"
Oct 30 21:11:09.657744 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:11:09.657684    6004 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-ef7e2d-openshift-default-6b6dbc765f-sg5h8"
Oct 30 21:11:09.766591 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:11:09.766556    6004 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-w6-7eaf74-openshift-default-69c8f48765-2rvzl"]
Oct 30 21:11:09.779139 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:11:09.777768    6004 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 21:11:09.779139 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:11:09.777860    6004 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 21:11:09.779139 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:11:09.777922    6004 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 21:11:10.069072 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:11:10.068519    6004 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-ef7e2d-openshift-default-6b6dbc765f-sg5h8"]
Oct 30 21:11:10.085862 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:11:10.085817    6004 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 21:11:10.085978 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:11:10.085916    6004 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 21:11:10.085978 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:11:10.085956    6004 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 21:11:10.504200 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:11:10.504163    6004 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-ef7e2d-openshift-default-6b6dbc765f-sg5h8" event={"ID":"21c116c2-4862-424a-bedf-41fba3b2612d","Type":"ContainerStarted","Data":"725cb39a95b45fe75817d491c245583bfde112f0f50abe5e1dbbafec0143ae50"}
Oct 30 21:11:10.504388 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:11:10.504224    6004 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-ef7e2d-openshift-default-6b6dbc765f-sg5h8" event={"ID":"21c116c2-4862-424a-bedf-41fba3b2612d","Type":"ContainerStarted","Data":"c3e5476669f50452706edddfd425113543992cfc400219a5018e33ba7c01f176"}
Oct 30 21:11:10.505994 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:11:10.505965    6004 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w6-7eaf74-openshift-default-69c8f48765-2rvzl" event={"ID":"18f44298-4c12-4e81-942d-f8fdee2e968f","Type":"ContainerStarted","Data":"0e4a327889265b84693b9c76a0100c5b0653e180cdbf3c2010b45a6d6a38dd25"}
Oct 30 21:11:10.506137 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:11:10.506011    6004 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w6-7eaf74-openshift-default-69c8f48765-2rvzl" event={"ID":"18f44298-4c12-4e81-942d-f8fdee2e968f","Type":"ContainerStarted","Data":"32a522c4d31d927f01bc9ff179088e536bd4f583dca9e1c510041c8d3084000e"}
Oct 30 21:11:10.625082 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:11:10.625016    6004 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-api-a-ef7e2d-openshift-default-6b6dbc765f-sg5h8" podStartSLOduration=1.625000942 podStartE2EDuration="1.625000942s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:11:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:11:10.621901743 +0000 UTC m=+1976.541687861" watchObservedRunningTime="2026-10-30 21:11:10.625000942 +0000 UTC m=+1976.544787059"
Oct 30 21:11:10.658126 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:11:10.658079    6004 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-ef7e2d-openshift-default-6b6dbc765f-sg5h8"
Oct 30 21:11:10.767131 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:11:10.766896    6004 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-w6-7eaf74-openshift-default-69c8f48765-2rvzl" podStartSLOduration=2.766874486 podStartE2EDuration="2.766874486s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:11:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:11:10.75243217 +0000 UTC m=+1976.672218287" watchObservedRunningTime="2026-10-30 21:11:10.766874486 +0000 UTC m=+1976.686660605"
Oct 30 21:11:11.315407 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:11:11.315375    6004 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-w6-7eaf74-openshift-default-69c8f48765-2rvzl"
Oct 30 21:11:11.316954 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:11:11.316929    6004 patch_prober.go:29] interesting pod/e2e-shared-b-w6-7eaf74-openshift-default-69c8f48765-2rvzl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.107:15021/healthz/ready\": dial tcp 10.132.0.107:15021: connect: connection refused" start-of-body=
Oct 30 21:11:11.317044 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:11:11.316978    6004 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w6-7eaf74-openshift-default-69c8f48765-2rvzl" podUID="18f44298-4c12-4e81-942d-f8fdee2e968f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.107:15021/healthz/ready\": dial tcp 10.132.0.107:15021: connect: connection refused"
Oct 30 21:11:11.663140 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:11:11.662173    6004 patch_prober.go:29] interesting pod/e2e-api-a-ef7e2d-openshift-default-6b6dbc765f-sg5h8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.108:15021/healthz/ready\": dial tcp 10.132.0.108:15021: connect: connection refused" start-of-body=
Oct 30 21:11:11.663140 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:11:11.662254    6004 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-ef7e2d-openshift-default-6b6dbc765f-sg5h8" podUID="21c116c2-4862-424a-bedf-41fba3b2612d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.108:15021/healthz/ready\": dial tcp 10.132.0.108:15021: connect: connection refused"
Oct 30 21:11:12.315747 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:11:12.315709    6004 patch_prober.go:29] interesting pod/e2e-shared-b-w6-7eaf74-openshift-default-69c8f48765-2rvzl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.107:15021/healthz/ready\": dial tcp 10.132.0.107:15021: connect: connection refused" start-of-body=
Oct 30 21:11:12.316191 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:11:12.315764    6004 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w6-7eaf74-openshift-default-69c8f48765-2rvzl" podUID="18f44298-4c12-4e81-942d-f8fdee2e968f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.107:15021/healthz/ready\": dial tcp 10.132.0.107:15021: connect: connection refused"
Oct 30 21:11:12.667559 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:11:12.667465    6004 patch_prober.go:29] interesting pod/e2e-api-a-ef7e2d-openshift-default-6b6dbc765f-sg5h8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.108:15021/healthz/ready\": dial tcp 10.132.0.108:15021: connect: connection refused" start-of-body=
Oct 30 21:11:12.667810 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:11:12.667781    6004 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-ef7e2d-openshift-default-6b6dbc765f-sg5h8" podUID="21c116c2-4862-424a-bedf-41fba3b2612d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.108:15021/healthz/ready\": dial tcp 10.132.0.108:15021: connect: connection refused"
Oct 30 21:11:13.315631 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:11:13.315589    6004 patch_prober.go:29] interesting pod/e2e-shared-b-w6-7eaf74-openshift-default-69c8f48765-2rvzl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.107:15021/healthz/ready\": dial tcp 10.132.0.107:15021: connect: connection refused" start-of-body=
Oct 30 21:11:13.315815 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:11:13.315648    6004 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w6-7eaf74-openshift-default-69c8f48765-2rvzl" podUID="18f44298-4c12-4e81-942d-f8fdee2e968f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.107:15021/healthz/ready\": dial tcp 10.132.0.107:15021: connect: connection refused"
Oct 30 21:11:13.661130 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:11:13.660576    6004 patch_prober.go:29] interesting pod/e2e-api-a-ef7e2d-openshift-default-6b6dbc765f-sg5h8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.108:15021/healthz/ready\": dial tcp 10.132.0.108:15021: connect: connection refused" start-of-body=
Oct 30 21:11:13.661130 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:11:13.660639    6004 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-ef7e2d-openshift-default-6b6dbc765f-sg5h8" podUID="21c116c2-4862-424a-bedf-41fba3b2612d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.108:15021/healthz/ready\": dial tcp 10.132.0.108:15021: connect: connection refused"
Oct 30 21:11:14.316075 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:11:14.315940    6004 patch_prober.go:29] interesting pod/e2e-shared-b-w6-7eaf74-openshift-default-69c8f48765-2rvzl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.107:15021/healthz/ready\": dial tcp 10.132.0.107:15021: connect: connection refused" start-of-body=
Oct 30 21:11:14.316075 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:11:14.315990    6004 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w6-7eaf74-openshift-default-69c8f48765-2rvzl" podUID="18f44298-4c12-4e81-942d-f8fdee2e968f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.107:15021/healthz/ready\": dial tcp 10.132.0.107:15021: connect: connection refused"
Oct 30 21:11:14.331681 ip-10-0-138-85 kubenswrapper[6004]: E1030 21:11:14.331645    6004 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-zz4wr" containerName="extractor"
Oct 30 21:11:14.670133 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:11:14.666441    6004 patch_prober.go:29] interesting pod/e2e-api-a-ef7e2d-openshift-default-6b6dbc765f-sg5h8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.108:15021/healthz/ready\": dial tcp 10.132.0.108:15021: connect: connection refused" start-of-body=
Oct 30 21:11:14.670133 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:11:14.666506    6004 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-ef7e2d-openshift-default-6b6dbc765f-sg5h8" podUID="21c116c2-4862-424a-bedf-41fba3b2612d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.108:15021/healthz/ready\": dial tcp 10.132.0.108:15021: connect: connection refused"
Oct 30 21:11:15.315931 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:11:15.315882    6004 patch_prober.go:29] interesting pod/e2e-shared-b-w6-7eaf74-openshift-default-69c8f48765-2rvzl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.107:15021/healthz/ready\": dial tcp 10.132.0.107:15021: connect: connection refused" start-of-body=
Oct 30 21:11:15.316301 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:11:15.316257    6004 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w6-7eaf74-openshift-default-69c8f48765-2rvzl" podUID="18f44298-4c12-4e81-942d-f8fdee2e968f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.107:15021/healthz/ready\": dial tcp 10.132.0.107:15021: connect: connection refused"
Oct 30 21:11:15.661131 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:11:15.660433    6004 patch_prober.go:29] interesting pod/e2e-api-a-ef7e2d-openshift-default-6b6dbc765f-sg5h8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.108:15021/healthz/ready\": dial tcp 10.132.0.108:15021: connect: connection refused" start-of-body=
Oct 30 21:11:15.661131 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:11:15.660498    6004 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-ef7e2d-openshift-default-6b6dbc765f-sg5h8" podUID="21c116c2-4862-424a-bedf-41fba3b2612d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.108:15021/healthz/ready\": dial tcp 10.132.0.108:15021: connect: connection refused"
Oct 30 21:11:16.316406 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:11:16.316363    6004 patch_prober.go:29] interesting pod/e2e-shared-b-w6-7eaf74-openshift-default-69c8f48765-2rvzl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.107:15021/healthz/ready\": dial tcp 10.132.0.107:15021: connect: connection refused" start-of-body=
Oct 30 21:11:16.316793 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:11:16.316438    6004 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w6-7eaf74-openshift-default-69c8f48765-2rvzl" podUID="18f44298-4c12-4e81-942d-f8fdee2e968f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.107:15021/healthz/ready\": dial tcp 10.132.0.107:15021: connect: connection refused"
Oct 30 21:11:16.666672 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:11:16.666530    6004 patch_prober.go:29] interesting pod/e2e-api-a-ef7e2d-openshift-default-6b6dbc765f-sg5h8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.108:15021/healthz/ready\": dial tcp 10.132.0.108:15021: connect: connection refused" start-of-body=
Oct 30 21:11:16.667009 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:11:16.666958    6004 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-ef7e2d-openshift-default-6b6dbc765f-sg5h8" podUID="21c116c2-4862-424a-bedf-41fba3b2612d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.108:15021/healthz/ready\": dial tcp 10.132.0.108:15021: connect: connection refused"
Oct 30 21:11:17.067333 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:11:17.067298    6004 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-f3b172-86c94df899-4mfpx"]
Oct 30 21:11:17.073497 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:11:17.073467    6004 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-f3b172-86c94df899-4mfpx"
Oct 30 21:11:17.124992 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:11:17.124954    6004 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-f3b172-86c94df899-4mfpx"]
Oct 30 21:11:17.126561 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:11:17.126538    6004 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-a-f3b172-serving-cert\""
Oct 30 21:11:17.200402 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:11:17.198935    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dfpn5\" (UniqueName: \"kubernetes.io/projected/d4242313-4c6a-409c-a1ed-8c7885206928-kube-api-access-dfpn5\") pod \"maas-api-e2e-inf-a-f3b172-86c94df899-4mfpx\" (UID: \"d4242313-4c6a-409c-a1ed-8c7885206928\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-f3b172-86c94df899-4mfpx"
Oct 30 21:11:17.200402 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:11:17.199100    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d4242313-4c6a-409c-a1ed-8c7885206928-metrics-certs\") pod \"maas-api-e2e-inf-a-f3b172-86c94df899-4mfpx\" (UID: \"d4242313-4c6a-409c-a1ed-8c7885206928\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-f3b172-86c94df899-4mfpx"
Oct 30 21:11:17.200402 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:11:17.199164    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d4242313-4c6a-409c-a1ed-8c7885206928-openshift-service-ca\") pod \"maas-api-e2e-inf-a-f3b172-86c94df899-4mfpx\" (UID: \"d4242313-4c6a-409c-a1ed-8c7885206928\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-f3b172-86c94df899-4mfpx"
Oct 30 21:11:17.200402 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:11:17.199212    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d4242313-4c6a-409c-a1ed-8c7885206928-maas-api-tls\") pod \"maas-api-e2e-inf-a-f3b172-86c94df899-4mfpx\" (UID: \"d4242313-4c6a-409c-a1ed-8c7885206928\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-f3b172-86c94df899-4mfpx"
Oct 30 21:11:17.300544 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:11:17.300502    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d4242313-4c6a-409c-a1ed-8c7885206928-metrics-certs\") pod \"maas-api-e2e-inf-a-f3b172-86c94df899-4mfpx\" (UID: \"d4242313-4c6a-409c-a1ed-8c7885206928\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-f3b172-86c94df899-4mfpx"
Oct 30 21:11:17.300731 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:11:17.300596    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d4242313-4c6a-409c-a1ed-8c7885206928-openshift-service-ca\") pod \"maas-api-e2e-inf-a-f3b172-86c94df899-4mfpx\" (UID: \"d4242313-4c6a-409c-a1ed-8c7885206928\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-f3b172-86c94df899-4mfpx"
Oct 30 21:11:17.300731 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:11:17.300643    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d4242313-4c6a-409c-a1ed-8c7885206928-maas-api-tls\") pod \"maas-api-e2e-inf-a-f3b172-86c94df899-4mfpx\" (UID: \"d4242313-4c6a-409c-a1ed-8c7885206928\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-f3b172-86c94df899-4mfpx"
Oct 30 21:11:17.300872 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:11:17.300855    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dfpn5\" (UniqueName: \"kubernetes.io/projected/d4242313-4c6a-409c-a1ed-8c7885206928-kube-api-access-dfpn5\") pod \"maas-api-e2e-inf-a-f3b172-86c94df899-4mfpx\" (UID: \"d4242313-4c6a-409c-a1ed-8c7885206928\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-f3b172-86c94df899-4mfpx"
Oct 30 21:11:17.301385 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:11:17.301357    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d4242313-4c6a-409c-a1ed-8c7885206928-openshift-service-ca\") pod \"maas-api-e2e-inf-a-f3b172-86c94df899-4mfpx\" (UID: \"d4242313-4c6a-409c-a1ed-8c7885206928\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-f3b172-86c94df899-4mfpx"
Oct 30 21:11:17.303096 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:11:17.303073    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d4242313-4c6a-409c-a1ed-8c7885206928-metrics-certs\") pod \"maas-api-e2e-inf-a-f3b172-86c94df899-4mfpx\" (UID: \"d4242313-4c6a-409c-a1ed-8c7885206928\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-f3b172-86c94df899-4mfpx"
Oct 30 21:11:17.303191 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:11:17.303163    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d4242313-4c6a-409c-a1ed-8c7885206928-maas-api-tls\") pod \"maas-api-e2e-inf-a-f3b172-86c94df899-4mfpx\" (UID: \"d4242313-4c6a-409c-a1ed-8c7885206928\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-f3b172-86c94df899-4mfpx"
Oct 30 21:11:17.321339 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:11:17.321286    6004 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-w6-7eaf74-openshift-default-69c8f48765-2rvzl"
Oct 30 21:11:17.321689 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:11:17.321669    6004 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-w6-7eaf74-openshift-default-69c8f48765-2rvzl"
Oct 30 21:11:17.322219 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:11:17.322202    6004 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-w6-7eaf74-openshift-default-69c8f48765-2rvzl"
Oct 30 21:11:17.358639 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:11:17.358615    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dfpn5\" (UniqueName: \"kubernetes.io/projected/d4242313-4c6a-409c-a1ed-8c7885206928-kube-api-access-dfpn5\") pod \"maas-api-e2e-inf-a-f3b172-86c94df899-4mfpx\" (UID: \"d4242313-4c6a-409c-a1ed-8c7885206928\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-f3b172-86c94df899-4mfpx"
Oct 30 21:11:17.391016 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:11:17.390989    6004 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-f3b172-86c94df899-4mfpx"
Oct 30 21:11:17.663890 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:11:17.663812    6004 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-ef7e2d-openshift-default-6b6dbc765f-sg5h8"
Oct 30 21:11:17.664185 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:11:17.664161    6004 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-ef7e2d-openshift-default-6b6dbc765f-sg5h8"
Oct 30 21:11:17.664939 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:11:17.664920    6004 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-ef7e2d-openshift-default-6b6dbc765f-sg5h8"
Oct 30 21:11:17.777927 ip-10-0-138-85 kubenswrapper[6004]: W1030 21:11:17.777897    6004 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd4242313_4c6a_409c_a1ed_8c7885206928.slice/crio-e767066794ab3bcd18467e8975dc6a19d7dbb073a55b72ecd0477f80b2531887 WatchSource:0}: Error finding container e767066794ab3bcd18467e8975dc6a19d7dbb073a55b72ecd0477f80b2531887: Status 404 returned error can't find the container with id e767066794ab3bcd18467e8975dc6a19d7dbb073a55b72ecd0477f80b2531887
Oct 30 21:11:17.778108 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:11:17.778031    6004 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-f3b172-86c94df899-4mfpx"]
Oct 30 21:11:18.680892 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:11:18.680863    6004 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-f3b172-86c94df899-4mfpx" event={"ID":"d4242313-4c6a-409c-a1ed-8c7885206928","Type":"ContainerStarted","Data":"e767066794ab3bcd18467e8975dc6a19d7dbb073a55b72ecd0477f80b2531887"}
Oct 30 21:11:19.689898 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:11:19.689855    6004 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-f3b172-86c94df899-4mfpx" event={"ID":"d4242313-4c6a-409c-a1ed-8c7885206928","Type":"ContainerStarted","Data":"b77af615760f27b2dffc06629c01ab8f16440ae11351c00ed98044e9d0bd29bd"}
Oct 30 21:11:19.690402 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:11:19.689958    6004 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-f3b172-86c94df899-4mfpx"
Oct 30 21:11:19.808577 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:11:19.808516    6004 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-f3b172-86c94df899-4mfpx" podStartSLOduration=1.915789077 podStartE2EDuration="2.808503352s" totalImagesPullingTime="892.714275ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:11:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:11:19.80706261 +0000 UTC m=+1985.726848721" watchObservedRunningTime="2026-10-30 21:11:19.808503352 +0000 UTC m=+1985.728289469"
Oct 30 21:11:25.703503 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:11:25.703416    6004 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-f3b172-86c94df899-4mfpx"
Oct 30 21:11:39.225039 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:11:39.225004    6004 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-w6-7eaf74-openshift-default-69c8f48765-7b8mx"]
Oct 30 21:11:39.229293 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:11:39.229276    6004 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w6-7eaf74-openshift-default-69c8f48765-7b8mx"
Oct 30 21:11:39.387141 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:11:39.387105    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/51fcc016-5ad8-4bdd-9720-49a1b448c19e-istio-data\") pod \"e2e-shared-b-w6-7eaf74-openshift-default-69c8f48765-7b8mx\" (UID: \"51fcc016-5ad8-4bdd-9720-49a1b448c19e\") " pod="openshift-ingress/e2e-shared-b-w6-7eaf74-openshift-default-69c8f48765-7b8mx"
Oct 30 21:11:39.387444 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:11:39.387424    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/51fcc016-5ad8-4bdd-9720-49a1b448c19e-istio-token\") pod \"e2e-shared-b-w6-7eaf74-openshift-default-69c8f48765-7b8mx\" (UID: \"51fcc016-5ad8-4bdd-9720-49a1b448c19e\") " pod="openshift-ingress/e2e-shared-b-w6-7eaf74-openshift-default-69c8f48765-7b8mx"
Oct 30 21:11:39.387587 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:11:39.387562    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/51fcc016-5ad8-4bdd-9720-49a1b448c19e-istio-podinfo\") pod \"e2e-shared-b-w6-7eaf74-openshift-default-69c8f48765-7b8mx\" (UID: \"51fcc016-5ad8-4bdd-9720-49a1b448c19e\") " pod="openshift-ingress/e2e-shared-b-w6-7eaf74-openshift-default-69c8f48765-7b8mx"
Oct 30 21:11:39.387735 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:11:39.387606    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/51fcc016-5ad8-4bdd-9720-49a1b448c19e-istiod-ca-cert\") pod \"e2e-shared-b-w6-7eaf74-openshift-default-69c8f48765-7b8mx\" (UID: \"51fcc016-5ad8-4bdd-9720-49a1b448c19e\") " pod="openshift-ingress/e2e-shared-b-w6-7eaf74-openshift-default-69c8f48765-7b8mx"
Oct 30 21:11:39.387735 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:11:39.387638    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/51fcc016-5ad8-4bdd-9720-49a1b448c19e-istio-envoy\") pod \"e2e-shared-b-w6-7eaf74-openshift-default-69c8f48765-7b8mx\" (UID: \"51fcc016-5ad8-4bdd-9720-49a1b448c19e\") " pod="openshift-ingress/e2e-shared-b-w6-7eaf74-openshift-default-69c8f48765-7b8mx"
Oct 30 21:11:39.387735 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:11:39.387722    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/51fcc016-5ad8-4bdd-9720-49a1b448c19e-workload-socket\") pod \"e2e-shared-b-w6-7eaf74-openshift-default-69c8f48765-7b8mx\" (UID: \"51fcc016-5ad8-4bdd-9720-49a1b448c19e\") " pod="openshift-ingress/e2e-shared-b-w6-7eaf74-openshift-default-69c8f48765-7b8mx"
Oct 30 21:11:39.387946 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:11:39.387924    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/51fcc016-5ad8-4bdd-9720-49a1b448c19e-workload-certs\") pod \"e2e-shared-b-w6-7eaf74-openshift-default-69c8f48765-7b8mx\" (UID: \"51fcc016-5ad8-4bdd-9720-49a1b448c19e\") " pod="openshift-ingress/e2e-shared-b-w6-7eaf74-openshift-default-69c8f48765-7b8mx"
Oct 30 21:11:39.388115 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:11:39.388096    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l6h99\" (UniqueName: \"kubernetes.io/projected/51fcc016-5ad8-4bdd-9720-49a1b448c19e-kube-api-access-l6h99\") pod \"e2e-shared-b-w6-7eaf74-openshift-default-69c8f48765-7b8mx\" (UID: \"51fcc016-5ad8-4bdd-9720-49a1b448c19e\") " pod="openshift-ingress/e2e-shared-b-w6-7eaf74-openshift-default-69c8f48765-7b8mx"
Oct 30 21:11:39.388204 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:11:39.388185    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/51fcc016-5ad8-4bdd-9720-49a1b448c19e-credential-socket\") pod \"e2e-shared-b-w6-7eaf74-openshift-default-69c8f48765-7b8mx\" (UID: \"51fcc016-5ad8-4bdd-9720-49a1b448c19e\") " pod="openshift-ingress/e2e-shared-b-w6-7eaf74-openshift-default-69c8f48765-7b8mx"
Oct 30 21:11:39.432160 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:11:39.432127    6004 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-w6-7eaf74-openshift-default-69c8f48765-7b8mx"]
Oct 30 21:11:39.490324 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:11:39.490235    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/51fcc016-5ad8-4bdd-9720-49a1b448c19e-workload-socket\") pod \"e2e-shared-b-w6-7eaf74-openshift-default-69c8f48765-7b8mx\" (UID: \"51fcc016-5ad8-4bdd-9720-49a1b448c19e\") " pod="openshift-ingress/e2e-shared-b-w6-7eaf74-openshift-default-69c8f48765-7b8mx"
Oct 30 21:11:39.490324 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:11:39.490294    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/51fcc016-5ad8-4bdd-9720-49a1b448c19e-workload-certs\") pod \"e2e-shared-b-w6-7eaf74-openshift-default-69c8f48765-7b8mx\" (UID: \"51fcc016-5ad8-4bdd-9720-49a1b448c19e\") " pod="openshift-ingress/e2e-shared-b-w6-7eaf74-openshift-default-69c8f48765-7b8mx"
Oct 30 21:11:39.490508 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:11:39.490421    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l6h99\" (UniqueName: \"kubernetes.io/projected/51fcc016-5ad8-4bdd-9720-49a1b448c19e-kube-api-access-l6h99\") pod \"e2e-shared-b-w6-7eaf74-openshift-default-69c8f48765-7b8mx\" (UID: \"51fcc016-5ad8-4bdd-9720-49a1b448c19e\") " pod="openshift-ingress/e2e-shared-b-w6-7eaf74-openshift-default-69c8f48765-7b8mx"
Oct 30 21:11:39.490508 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:11:39.490501    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/51fcc016-5ad8-4bdd-9720-49a1b448c19e-credential-socket\") pod \"e2e-shared-b-w6-7eaf74-openshift-default-69c8f48765-7b8mx\" (UID: \"51fcc016-5ad8-4bdd-9720-49a1b448c19e\") " pod="openshift-ingress/e2e-shared-b-w6-7eaf74-openshift-default-69c8f48765-7b8mx"
Oct 30 21:11:39.490591 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:11:39.490576    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/51fcc016-5ad8-4bdd-9720-49a1b448c19e-istio-data\") pod \"e2e-shared-b-w6-7eaf74-openshift-default-69c8f48765-7b8mx\" (UID: \"51fcc016-5ad8-4bdd-9720-49a1b448c19e\") " pod="openshift-ingress/e2e-shared-b-w6-7eaf74-openshift-default-69c8f48765-7b8mx"
Oct 30 21:11:39.490702 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:11:39.490685    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/51fcc016-5ad8-4bdd-9720-49a1b448c19e-istio-token\") pod \"e2e-shared-b-w6-7eaf74-openshift-default-69c8f48765-7b8mx\" (UID: \"51fcc016-5ad8-4bdd-9720-49a1b448c19e\") " pod="openshift-ingress/e2e-shared-b-w6-7eaf74-openshift-default-69c8f48765-7b8mx"
Oct 30 21:11:39.490737 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:11:39.490725    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/51fcc016-5ad8-4bdd-9720-49a1b448c19e-istio-podinfo\") pod \"e2e-shared-b-w6-7eaf74-openshift-default-69c8f48765-7b8mx\" (UID: \"51fcc016-5ad8-4bdd-9720-49a1b448c19e\") " pod="openshift-ingress/e2e-shared-b-w6-7eaf74-openshift-default-69c8f48765-7b8mx"
Oct 30 21:11:39.490774 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:11:39.490762    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/51fcc016-5ad8-4bdd-9720-49a1b448c19e-istiod-ca-cert\") pod \"e2e-shared-b-w6-7eaf74-openshift-default-69c8f48765-7b8mx\" (UID: \"51fcc016-5ad8-4bdd-9720-49a1b448c19e\") " pod="openshift-ingress/e2e-shared-b-w6-7eaf74-openshift-default-69c8f48765-7b8mx"
Oct 30 21:11:39.490807 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:11:39.490793    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/51fcc016-5ad8-4bdd-9720-49a1b448c19e-istio-envoy\") pod \"e2e-shared-b-w6-7eaf74-openshift-default-69c8f48765-7b8mx\" (UID: \"51fcc016-5ad8-4bdd-9720-49a1b448c19e\") " pod="openshift-ingress/e2e-shared-b-w6-7eaf74-openshift-default-69c8f48765-7b8mx"
Oct 30 21:11:39.491457 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:11:39.491426    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/51fcc016-5ad8-4bdd-9720-49a1b448c19e-credential-socket\") pod \"e2e-shared-b-w6-7eaf74-openshift-default-69c8f48765-7b8mx\" (UID: \"51fcc016-5ad8-4bdd-9720-49a1b448c19e\") " pod="openshift-ingress/e2e-shared-b-w6-7eaf74-openshift-default-69c8f48765-7b8mx"
Oct 30 21:11:39.491630 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:11:39.491533    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/51fcc016-5ad8-4bdd-9720-49a1b448c19e-workload-socket\") pod \"e2e-shared-b-w6-7eaf74-openshift-default-69c8f48765-7b8mx\" (UID: \"51fcc016-5ad8-4bdd-9720-49a1b448c19e\") " pod="openshift-ingress/e2e-shared-b-w6-7eaf74-openshift-default-69c8f48765-7b8mx"
Oct 30 21:11:39.491729 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:11:39.491702    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/51fcc016-5ad8-4bdd-9720-49a1b448c19e-istio-data\") pod \"e2e-shared-b-w6-7eaf74-openshift-default-69c8f48765-7b8mx\" (UID: \"51fcc016-5ad8-4bdd-9720-49a1b448c19e\") " pod="openshift-ingress/e2e-shared-b-w6-7eaf74-openshift-default-69c8f48765-7b8mx"
Oct 30 21:11:39.491933 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:11:39.491909    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/51fcc016-5ad8-4bdd-9720-49a1b448c19e-workload-certs\") pod \"e2e-shared-b-w6-7eaf74-openshift-default-69c8f48765-7b8mx\" (UID: \"51fcc016-5ad8-4bdd-9720-49a1b448c19e\") " pod="openshift-ingress/e2e-shared-b-w6-7eaf74-openshift-default-69c8f48765-7b8mx"
Oct 30 21:11:39.492544 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:11:39.492448    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/51fcc016-5ad8-4bdd-9720-49a1b448c19e-istiod-ca-cert\") pod \"e2e-shared-b-w6-7eaf74-openshift-default-69c8f48765-7b8mx\" (UID: \"51fcc016-5ad8-4bdd-9720-49a1b448c19e\") " pod="openshift-ingress/e2e-shared-b-w6-7eaf74-openshift-default-69c8f48765-7b8mx"
Oct 30 21:11:39.493790 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:11:39.493763    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/51fcc016-5ad8-4bdd-9720-49a1b448c19e-istio-envoy\") pod \"e2e-shared-b-w6-7eaf74-openshift-default-69c8f48765-7b8mx\" (UID: \"51fcc016-5ad8-4bdd-9720-49a1b448c19e\") " pod="openshift-ingress/e2e-shared-b-w6-7eaf74-openshift-default-69c8f48765-7b8mx"
Oct 30 21:11:39.494011 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:11:39.493993    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/51fcc016-5ad8-4bdd-9720-49a1b448c19e-istio-podinfo\") pod \"e2e-shared-b-w6-7eaf74-openshift-default-69c8f48765-7b8mx\" (UID: \"51fcc016-5ad8-4bdd-9720-49a1b448c19e\") " pod="openshift-ingress/e2e-shared-b-w6-7eaf74-openshift-default-69c8f48765-7b8mx"
Oct 30 21:11:39.548184 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:11:39.548154    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/51fcc016-5ad8-4bdd-9720-49a1b448c19e-istio-token\") pod \"e2e-shared-b-w6-7eaf74-openshift-default-69c8f48765-7b8mx\" (UID: \"51fcc016-5ad8-4bdd-9720-49a1b448c19e\") " pod="openshift-ingress/e2e-shared-b-w6-7eaf74-openshift-default-69c8f48765-7b8mx"
Oct 30 21:11:39.548450 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:11:39.548426    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l6h99\" (UniqueName: \"kubernetes.io/projected/51fcc016-5ad8-4bdd-9720-49a1b448c19e-kube-api-access-l6h99\") pod \"e2e-shared-b-w6-7eaf74-openshift-default-69c8f48765-7b8mx\" (UID: \"51fcc016-5ad8-4bdd-9720-49a1b448c19e\") " pod="openshift-ingress/e2e-shared-b-w6-7eaf74-openshift-default-69c8f48765-7b8mx"
Oct 30 21:11:39.847349 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:11:39.847250    6004 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w6-7eaf74-openshift-default-69c8f48765-7b8mx"
Oct 30 21:11:40.298783 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:11:40.298752    6004 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-w6-7eaf74-openshift-default-69c8f48765-7b8mx"]
Oct 30 21:11:40.325084 ip-10-0-138-85 kubenswrapper[6004]: W1030 21:11:40.325030    6004 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod51fcc016_5ad8_4bdd_9720_49a1b448c19e.slice/crio-2cd620cbafc8b4a1047e8c287794185b257e1d728595d9d40edd64a851546239 WatchSource:0}: Error finding container 2cd620cbafc8b4a1047e8c287794185b257e1d728595d9d40edd64a851546239: Status 404 returned error can't find the container with id 2cd620cbafc8b4a1047e8c287794185b257e1d728595d9d40edd64a851546239
Oct 30 21:11:40.327600 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:11:40.327564    6004 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 21:11:40.327695 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:11:40.327634    6004 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 21:11:40.327695 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:11:40.327665    6004 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 21:11:40.855379 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:11:40.855337    6004 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w6-7eaf74-openshift-default-69c8f48765-7b8mx" event={"ID":"51fcc016-5ad8-4bdd-9720-49a1b448c19e","Type":"ContainerStarted","Data":"2a6e2a592889f92900be2d9ee9f55274ab06cdc352dc7ee70e85be6582a12e7a"}
Oct 30 21:11:40.855581 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:11:40.855393    6004 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w6-7eaf74-openshift-default-69c8f48765-7b8mx" event={"ID":"51fcc016-5ad8-4bdd-9720-49a1b448c19e","Type":"ContainerStarted","Data":"2cd620cbafc8b4a1047e8c287794185b257e1d728595d9d40edd64a851546239"}
Oct 30 21:11:41.074791 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:11:41.074717    6004 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-w6-7eaf74-openshift-default-69c8f48765-7b8mx" podStartSLOduration=2.074696279 podStartE2EDuration="2.074696279s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:11:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:11:41.024911202 +0000 UTC m=+2006.944697313" watchObservedRunningTime="2026-10-30 21:11:41.074696279 +0000 UTC m=+2006.994482398"
Oct 30 21:11:41.850454 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:11:41.850422    6004 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-w6-7eaf74-openshift-default-69c8f48765-7b8mx"
Oct 30 21:11:41.853190 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:11:41.853159    6004 patch_prober.go:29] interesting pod/e2e-shared-b-w6-7eaf74-openshift-default-69c8f48765-7b8mx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.110:15021/healthz/ready\": dial tcp 10.132.0.110:15021: connect: connection refused" start-of-body=
Oct 30 21:11:41.853569 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:11:41.853542    6004 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w6-7eaf74-openshift-default-69c8f48765-7b8mx" podUID="51fcc016-5ad8-4bdd-9720-49a1b448c19e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.110:15021/healthz/ready\": dial tcp 10.132.0.110:15021: connect: connection refused"
Oct 30 21:11:42.861180 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:11:42.853294    6004 patch_prober.go:29] interesting pod/e2e-shared-b-w6-7eaf74-openshift-default-69c8f48765-7b8mx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.110:15021/healthz/ready\": dial tcp 10.132.0.110:15021: connect: connection refused" start-of-body=
Oct 30 21:11:42.861180 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:11:42.853356    6004 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w6-7eaf74-openshift-default-69c8f48765-7b8mx" podUID="51fcc016-5ad8-4bdd-9720-49a1b448c19e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.110:15021/healthz/ready\": dial tcp 10.132.0.110:15021: connect: connection refused"
Oct 30 21:11:43.850470 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:11:43.850429    6004 patch_prober.go:29] interesting pod/e2e-shared-b-w6-7eaf74-openshift-default-69c8f48765-7b8mx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.110:15021/healthz/ready\": dial tcp 10.132.0.110:15021: connect: connection refused" start-of-body=
Oct 30 21:11:43.850757 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:11:43.850726    6004 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w6-7eaf74-openshift-default-69c8f48765-7b8mx" podUID="51fcc016-5ad8-4bdd-9720-49a1b448c19e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.110:15021/healthz/ready\": dial tcp 10.132.0.110:15021: connect: connection refused"
Oct 30 21:11:44.308214 ip-10-0-138-85 kubenswrapper[6004]: E1030 21:11:44.308180    6004 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-zz4wr" containerName="extractor"
Oct 30 21:11:44.856486 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:11:44.856446    6004 patch_prober.go:29] interesting pod/e2e-shared-b-w6-7eaf74-openshift-default-69c8f48765-7b8mx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.110:15021/healthz/ready\": dial tcp 10.132.0.110:15021: connect: connection refused" start-of-body=
Oct 30 21:11:44.856817 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:11:44.856781    6004 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w6-7eaf74-openshift-default-69c8f48765-7b8mx" podUID="51fcc016-5ad8-4bdd-9720-49a1b448c19e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.110:15021/healthz/ready\": dial tcp 10.132.0.110:15021: connect: connection refused"
Oct 30 21:11:45.859076 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:11:45.851624    6004 patch_prober.go:29] interesting pod/e2e-shared-b-w6-7eaf74-openshift-default-69c8f48765-7b8mx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.110:15021/healthz/ready\": dial tcp 10.132.0.110:15021: connect: connection refused" start-of-body=
Oct 30 21:11:45.859076 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:11:45.851701    6004 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w6-7eaf74-openshift-default-69c8f48765-7b8mx" podUID="51fcc016-5ad8-4bdd-9720-49a1b448c19e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.110:15021/healthz/ready\": dial tcp 10.132.0.110:15021: connect: connection refused"
Oct 30 21:11:47.145537 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:11:47.145493    6004 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-w6-7eaf74-openshift-default-69c8f48765-7b8mx"
Oct 30 21:11:47.146186 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:11:47.146101    6004 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-w6-7eaf74-openshift-default-69c8f48765-7b8mx"
Oct 30 21:11:47.147403 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:11:47.147383    6004 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-w6-7eaf74-openshift-default-69c8f48765-7b8mx"
Oct 30 21:12:07.149781 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:12:07.149743    6004 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w0-781058-openshift-default-55fb495b7-xgtg7"]
Oct 30 21:12:07.150349 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:12:07.149966    6004 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w0-781058-openshift-default-55fb495b7-xgtg7" podUID="c9a46681-c4b7-48f6-b95a-60f12f98c54d" containerName="istio-proxy" containerID="cri-o://feb1f01de4c266fe1cfc3a730367316c4438c84478e5fc00d14a617d26cf1bd8" gracePeriod=30
Oct 30 21:12:07.203749 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:12:07.203715    6004 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w5-2b425d-openshift-default-f547dbcbf-v9wp8"]
Oct 30 21:12:07.203970 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:12:07.203930    6004 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w5-2b425d-openshift-default-f547dbcbf-v9wp8" podUID="2f468858-dc38-49e9-a978-cd859ba366dd" containerName="istio-proxy" containerID="cri-o://d83a9565bfda0cd65c6ae623ee68f023412382ba19377922dc23d0c968e85c95" gracePeriod=30
Oct 30 21:12:07.357227 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:12:07.357186    6004 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w3-682999-openshift-default-54dcb797b5-nmbtx"]
Oct 30 21:12:07.357458 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:12:07.357415    6004 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w3-682999-openshift-default-54dcb797b5-nmbtx" podUID="e33839df-6b8e-4947-83cc-7baec9b30e50" containerName="istio-proxy" containerID="cri-o://806140dbe1925d8594c84222fced626620f4d02becbd74b8ab30f0d070412800" gracePeriod=30
Oct 30 21:12:09.144134 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:12:09.144091    6004 patch_prober.go:29] interesting pod/e2e-worker-w3-682999-openshift-default-54dcb797b5-nmbtx container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Oct 30 21:12:09.144537 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:12:09.144177    6004 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w3-682999-openshift-default-54dcb797b5-nmbtx" podUID="e33839df-6b8e-4947-83cc-7baec9b30e50" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 30 21:12:11.355083 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:12:11.355026    6004 patch_prober.go:29] interesting pod/e2e-worker-w0-781058-openshift-default-55fb495b7-xgtg7 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Oct 30 21:12:11.355513 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:12:11.355119    6004 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w0-781058-openshift-default-55fb495b7-xgtg7" podUID="c9a46681-c4b7-48f6-b95a-60f12f98c54d" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 30 21:12:12.563212 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:12:12.563183    6004 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-781058-openshift-default-55fb495b7-xgtg7"
Oct 30 21:12:12.572235 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:12:12.570954    6004 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-2b425d-openshift-default-f547dbcbf-v9wp8"
Oct 30 21:12:12.663744 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:12:12.663715    6004 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-682999-openshift-default-54dcb797b5-nmbtx"
Oct 30 21:12:12.666693 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:12:12.666669    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/2f468858-dc38-49e9-a978-cd859ba366dd-kube-api-access-4dw94\" (UniqueName: \"kubernetes.io/projected/2f468858-dc38-49e9-a978-cd859ba366dd-kube-api-access-4dw94\") pod \"2f468858-dc38-49e9-a978-cd859ba366dd\" (UID: \"2f468858-dc38-49e9-a978-cd859ba366dd\") "
Oct 30 21:12:12.666826 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:12:12.666714    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/2f468858-dc38-49e9-a978-cd859ba366dd-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2f468858-dc38-49e9-a978-cd859ba366dd-istio-data\") pod \"2f468858-dc38-49e9-a978-cd859ba366dd\" (UID: \"2f468858-dc38-49e9-a978-cd859ba366dd\") "
Oct 30 21:12:12.666826 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:12:12.666747    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/2f468858-dc38-49e9-a978-cd859ba366dd-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2f468858-dc38-49e9-a978-cd859ba366dd-istio-podinfo\") pod \"2f468858-dc38-49e9-a978-cd859ba366dd\" (UID: \"2f468858-dc38-49e9-a978-cd859ba366dd\") "
Oct 30 21:12:12.666826 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:12:12.666777    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/c9a46681-c4b7-48f6-b95a-60f12f98c54d-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c9a46681-c4b7-48f6-b95a-60f12f98c54d-istio-data\") pod \"c9a46681-c4b7-48f6-b95a-60f12f98c54d\" (UID: \"c9a46681-c4b7-48f6-b95a-60f12f98c54d\") "
Oct 30 21:12:12.666826 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:12:12.666809    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/2f468858-dc38-49e9-a978-cd859ba366dd-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2f468858-dc38-49e9-a978-cd859ba366dd-istio-envoy\") pod \"2f468858-dc38-49e9-a978-cd859ba366dd\" (UID: \"2f468858-dc38-49e9-a978-cd859ba366dd\") "
Oct 30 21:12:12.667125 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:12:12.667098    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2f468858-dc38-49e9-a978-cd859ba366dd-istio-data" pod "2f468858-dc38-49e9-a978-cd859ba366dd" (UID: "2f468858-dc38-49e9-a978-cd859ba366dd"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:12:12.667195 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:12:12.667114    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/c9a46681-c4b7-48f6-b95a-60f12f98c54d-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c9a46681-c4b7-48f6-b95a-60f12f98c54d-istiod-ca-cert\") pod \"c9a46681-c4b7-48f6-b95a-60f12f98c54d\" (UID: \"c9a46681-c4b7-48f6-b95a-60f12f98c54d\") "
Oct 30 21:12:12.667195 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:12:12.667106    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c9a46681-c4b7-48f6-b95a-60f12f98c54d-istio-data" pod "c9a46681-c4b7-48f6-b95a-60f12f98c54d" (UID: "c9a46681-c4b7-48f6-b95a-60f12f98c54d"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:12:12.667195 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:12:12.667182    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/2f468858-dc38-49e9-a978-cd859ba366dd-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2f468858-dc38-49e9-a978-cd859ba366dd-credential-socket\") pod \"2f468858-dc38-49e9-a978-cd859ba366dd\" (UID: \"2f468858-dc38-49e9-a978-cd859ba366dd\") "
Oct 30 21:12:12.667375 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:12:12.667221    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/2f468858-dc38-49e9-a978-cd859ba366dd-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2f468858-dc38-49e9-a978-cd859ba366dd-workload-socket\") pod \"2f468858-dc38-49e9-a978-cd859ba366dd\" (UID: \"2f468858-dc38-49e9-a978-cd859ba366dd\") "
Oct 30 21:12:12.667375 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:12:12.667323    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/c9a46681-c4b7-48f6-b95a-60f12f98c54d-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c9a46681-c4b7-48f6-b95a-60f12f98c54d-workload-socket\") pod \"c9a46681-c4b7-48f6-b95a-60f12f98c54d\" (UID: \"c9a46681-c4b7-48f6-b95a-60f12f98c54d\") "
Oct 30 21:12:12.667375 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:12:12.667366    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/c9a46681-c4b7-48f6-b95a-60f12f98c54d-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c9a46681-c4b7-48f6-b95a-60f12f98c54d-istio-envoy\") pod \"c9a46681-c4b7-48f6-b95a-60f12f98c54d\" (UID: \"c9a46681-c4b7-48f6-b95a-60f12f98c54d\") "
Oct 30 21:12:12.667532 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:12:12.667419    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/c9a46681-c4b7-48f6-b95a-60f12f98c54d-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c9a46681-c4b7-48f6-b95a-60f12f98c54d-istio-podinfo\") pod \"c9a46681-c4b7-48f6-b95a-60f12f98c54d\" (UID: \"c9a46681-c4b7-48f6-b95a-60f12f98c54d\") "
Oct 30 21:12:12.667532 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:12:12.667463    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/c9a46681-c4b7-48f6-b95a-60f12f98c54d-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c9a46681-c4b7-48f6-b95a-60f12f98c54d-workload-certs\") pod \"c9a46681-c4b7-48f6-b95a-60f12f98c54d\" (UID: \"c9a46681-c4b7-48f6-b95a-60f12f98c54d\") "
Oct 30 21:12:12.667532 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:12:12.667489    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/c9a46681-c4b7-48f6-b95a-60f12f98c54d-istio-token\" (UniqueName: \"kubernetes.io/projected/c9a46681-c4b7-48f6-b95a-60f12f98c54d-istio-token\") pod \"c9a46681-c4b7-48f6-b95a-60f12f98c54d\" (UID: \"c9a46681-c4b7-48f6-b95a-60f12f98c54d\") "
Oct 30 21:12:12.667532 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:12:12.667499    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2f468858-dc38-49e9-a978-cd859ba366dd-credential-socket" pod "2f468858-dc38-49e9-a978-cd859ba366dd" (UID: "2f468858-dc38-49e9-a978-cd859ba366dd"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:12:12.667532 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:12:12.667510    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c9a46681-c4b7-48f6-b95a-60f12f98c54d-istiod-ca-cert" pod "c9a46681-c4b7-48f6-b95a-60f12f98c54d" (UID: "c9a46681-c4b7-48f6-b95a-60f12f98c54d"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:12:12.667786 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:12:12.667584    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/c9a46681-c4b7-48f6-b95a-60f12f98c54d-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c9a46681-c4b7-48f6-b95a-60f12f98c54d-credential-socket\") pod \"c9a46681-c4b7-48f6-b95a-60f12f98c54d\" (UID: \"c9a46681-c4b7-48f6-b95a-60f12f98c54d\") "
Oct 30 21:12:12.667786 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:12:12.667613    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/2f468858-dc38-49e9-a978-cd859ba366dd-istio-token\" (UniqueName: \"kubernetes.io/projected/2f468858-dc38-49e9-a978-cd859ba366dd-istio-token\") pod \"2f468858-dc38-49e9-a978-cd859ba366dd\" (UID: \"2f468858-dc38-49e9-a978-cd859ba366dd\") "
Oct 30 21:12:12.667786 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:12:12.667686    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/2f468858-dc38-49e9-a978-cd859ba366dd-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2f468858-dc38-49e9-a978-cd859ba366dd-workload-certs\") pod \"2f468858-dc38-49e9-a978-cd859ba366dd\" (UID: \"2f468858-dc38-49e9-a978-cd859ba366dd\") "
Oct 30 21:12:12.667786 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:12:12.667692    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2f468858-dc38-49e9-a978-cd859ba366dd-workload-socket" pod "2f468858-dc38-49e9-a978-cd859ba366dd" (UID: "2f468858-dc38-49e9-a978-cd859ba366dd"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:12:12.667786 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:12:12.667706    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c9a46681-c4b7-48f6-b95a-60f12f98c54d-workload-socket" pod "c9a46681-c4b7-48f6-b95a-60f12f98c54d" (UID: "c9a46681-c4b7-48f6-b95a-60f12f98c54d"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:12:12.668065 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:12:12.667805    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c9a46681-c4b7-48f6-b95a-60f12f98c54d-workload-certs" pod "c9a46681-c4b7-48f6-b95a-60f12f98c54d" (UID: "c9a46681-c4b7-48f6-b95a-60f12f98c54d"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:12:12.668065 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:12:12.667901    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2f468858-dc38-49e9-a978-cd859ba366dd-workload-certs" pod "2f468858-dc38-49e9-a978-cd859ba366dd" (UID: "2f468858-dc38-49e9-a978-cd859ba366dd"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:12:12.668065 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:12:12.667920    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/c9a46681-c4b7-48f6-b95a-60f12f98c54d-kube-api-access-pr4j8\" (UniqueName: \"kubernetes.io/projected/c9a46681-c4b7-48f6-b95a-60f12f98c54d-kube-api-access-pr4j8\") pod \"c9a46681-c4b7-48f6-b95a-60f12f98c54d\" (UID: \"c9a46681-c4b7-48f6-b95a-60f12f98c54d\") "
Oct 30 21:12:12.668065 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:12:12.668024    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c9a46681-c4b7-48f6-b95a-60f12f98c54d-credential-socket" pod "c9a46681-c4b7-48f6-b95a-60f12f98c54d" (UID: "c9a46681-c4b7-48f6-b95a-60f12f98c54d"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:12:12.668275 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:12:12.668103    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/2f468858-dc38-49e9-a978-cd859ba366dd-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2f468858-dc38-49e9-a978-cd859ba366dd-istiod-ca-cert\") pod \"2f468858-dc38-49e9-a978-cd859ba366dd\" (UID: \"2f468858-dc38-49e9-a978-cd859ba366dd\") "
Oct 30 21:12:12.669632 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:12:12.668889    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2f468858-dc38-49e9-a978-cd859ba366dd-istiod-ca-cert" pod "2f468858-dc38-49e9-a978-cd859ba366dd" (UID: "2f468858-dc38-49e9-a978-cd859ba366dd"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:12:12.669632 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:12:12.669039    6004 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c9a46681-c4b7-48f6-b95a-60f12f98c54d-workload-socket\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:12:12.669632 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:12:12.669079    6004 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c9a46681-c4b7-48f6-b95a-60f12f98c54d-workload-certs\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:12:12.669632 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:12:12.669093    6004 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c9a46681-c4b7-48f6-b95a-60f12f98c54d-credential-socket\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:12:12.669632 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:12:12.669108    6004 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2f468858-dc38-49e9-a978-cd859ba366dd-workload-certs\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:12:12.669632 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:12:12.669122    6004 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2f468858-dc38-49e9-a978-cd859ba366dd-istiod-ca-cert\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:12:12.669632 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:12:12.669136    6004 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2f468858-dc38-49e9-a978-cd859ba366dd-istio-data\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:12:12.669632 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:12:12.669149    6004 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c9a46681-c4b7-48f6-b95a-60f12f98c54d-istio-data\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:12:12.669632 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:12:12.669163    6004 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c9a46681-c4b7-48f6-b95a-60f12f98c54d-istiod-ca-cert\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:12:12.669632 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:12:12.669177    6004 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2f468858-dc38-49e9-a978-cd859ba366dd-credential-socket\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:12:12.669632 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:12:12.669190    6004 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2f468858-dc38-49e9-a978-cd859ba366dd-workload-socket\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:12:12.670260 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:12:12.670195    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c9a46681-c4b7-48f6-b95a-60f12f98c54d-istio-token" pod "c9a46681-c4b7-48f6-b95a-60f12f98c54d" (UID: "c9a46681-c4b7-48f6-b95a-60f12f98c54d"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:12:12.670902 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:12:12.670879    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c9a46681-c4b7-48f6-b95a-60f12f98c54d-istio-envoy" pod "c9a46681-c4b7-48f6-b95a-60f12f98c54d" (UID: "c9a46681-c4b7-48f6-b95a-60f12f98c54d"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:12:12.670902 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:12:12.670886    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2f468858-dc38-49e9-a978-cd859ba366dd-istio-token" pod "2f468858-dc38-49e9-a978-cd859ba366dd" (UID: "2f468858-dc38-49e9-a978-cd859ba366dd"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:12:12.671114 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:12:12.670981    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2f468858-dc38-49e9-a978-cd859ba366dd-istio-envoy" pod "2f468858-dc38-49e9-a978-cd859ba366dd" (UID: "2f468858-dc38-49e9-a978-cd859ba366dd"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:12:12.671114 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:12:12.670993    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/2f468858-dc38-49e9-a978-cd859ba366dd-istio-podinfo" pod "2f468858-dc38-49e9-a978-cd859ba366dd" (UID: "2f468858-dc38-49e9-a978-cd859ba366dd"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 21:12:12.671114 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:12:12.671022    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/c9a46681-c4b7-48f6-b95a-60f12f98c54d-istio-podinfo" pod "c9a46681-c4b7-48f6-b95a-60f12f98c54d" (UID: "c9a46681-c4b7-48f6-b95a-60f12f98c54d"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 21:12:12.671677 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:12:12.671654    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2f468858-dc38-49e9-a978-cd859ba366dd-kube-api-access-4dw94" pod "2f468858-dc38-49e9-a978-cd859ba366dd" (UID: "2f468858-dc38-49e9-a978-cd859ba366dd"). InnerVolumeSpecName "kube-api-access-4dw94". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:12:12.672285 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:12:12.672268    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c9a46681-c4b7-48f6-b95a-60f12f98c54d-kube-api-access-pr4j8" pod "c9a46681-c4b7-48f6-b95a-60f12f98c54d" (UID: "c9a46681-c4b7-48f6-b95a-60f12f98c54d"). InnerVolumeSpecName "kube-api-access-pr4j8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:12:12.770370 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:12:12.770289    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/e33839df-6b8e-4947-83cc-7baec9b30e50-kube-api-access-mtbrz\" (UniqueName: \"kubernetes.io/projected/e33839df-6b8e-4947-83cc-7baec9b30e50-kube-api-access-mtbrz\") pod \"e33839df-6b8e-4947-83cc-7baec9b30e50\" (UID: \"e33839df-6b8e-4947-83cc-7baec9b30e50\") "
Oct 30 21:12:12.770370 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:12:12.770346    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/e33839df-6b8e-4947-83cc-7baec9b30e50-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e33839df-6b8e-4947-83cc-7baec9b30e50-istio-podinfo\") pod \"e33839df-6b8e-4947-83cc-7baec9b30e50\" (UID: \"e33839df-6b8e-4947-83cc-7baec9b30e50\") "
Oct 30 21:12:12.770615 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:12:12.770437    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/e33839df-6b8e-4947-83cc-7baec9b30e50-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e33839df-6b8e-4947-83cc-7baec9b30e50-istio-envoy\") pod \"e33839df-6b8e-4947-83cc-7baec9b30e50\" (UID: \"e33839df-6b8e-4947-83cc-7baec9b30e50\") "
Oct 30 21:12:12.770615 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:12:12.770473    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/e33839df-6b8e-4947-83cc-7baec9b30e50-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e33839df-6b8e-4947-83cc-7baec9b30e50-istio-data\") pod \"e33839df-6b8e-4947-83cc-7baec9b30e50\" (UID: \"e33839df-6b8e-4947-83cc-7baec9b30e50\") "
Oct 30 21:12:12.770615 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:12:12.770559    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/e33839df-6b8e-4947-83cc-7baec9b30e50-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e33839df-6b8e-4947-83cc-7baec9b30e50-workload-socket\") pod \"e33839df-6b8e-4947-83cc-7baec9b30e50\" (UID: \"e33839df-6b8e-4947-83cc-7baec9b30e50\") "
Oct 30 21:12:12.770784 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:12:12.770621    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/e33839df-6b8e-4947-83cc-7baec9b30e50-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e33839df-6b8e-4947-83cc-7baec9b30e50-istiod-ca-cert\") pod \"e33839df-6b8e-4947-83cc-7baec9b30e50\" (UID: \"e33839df-6b8e-4947-83cc-7baec9b30e50\") "
Oct 30 21:12:12.770784 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:12:12.770714    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/e33839df-6b8e-4947-83cc-7baec9b30e50-istio-token\" (UniqueName: \"kubernetes.io/projected/e33839df-6b8e-4947-83cc-7baec9b30e50-istio-token\") pod \"e33839df-6b8e-4947-83cc-7baec9b30e50\" (UID: \"e33839df-6b8e-4947-83cc-7baec9b30e50\") "
Oct 30 21:12:12.770784 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:12:12.770779    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/e33839df-6b8e-4947-83cc-7baec9b30e50-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e33839df-6b8e-4947-83cc-7baec9b30e50-credential-socket\") pod \"e33839df-6b8e-4947-83cc-7baec9b30e50\" (UID: \"e33839df-6b8e-4947-83cc-7baec9b30e50\") "
Oct 30 21:12:12.770944 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:12:12.770828    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/e33839df-6b8e-4947-83cc-7baec9b30e50-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e33839df-6b8e-4947-83cc-7baec9b30e50-workload-certs\") pod \"e33839df-6b8e-4947-83cc-7baec9b30e50\" (UID: \"e33839df-6b8e-4947-83cc-7baec9b30e50\") "
Oct 30 21:12:12.770944 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:12:12.770926    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e33839df-6b8e-4947-83cc-7baec9b30e50-istio-data" pod "e33839df-6b8e-4947-83cc-7baec9b30e50" (UID: "e33839df-6b8e-4947-83cc-7baec9b30e50"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:12:12.771488 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:12:12.771455    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e33839df-6b8e-4947-83cc-7baec9b30e50-credential-socket" pod "e33839df-6b8e-4947-83cc-7baec9b30e50" (UID: "e33839df-6b8e-4947-83cc-7baec9b30e50"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:12:12.771605 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:12:12.771587    6004 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pr4j8\" (UniqueName: \"kubernetes.io/projected/c9a46681-c4b7-48f6-b95a-60f12f98c54d-kube-api-access-pr4j8\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:12:12.771688 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:12:12.771667    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e33839df-6b8e-4947-83cc-7baec9b30e50-workload-socket" pod "e33839df-6b8e-4947-83cc-7baec9b30e50" (UID: "e33839df-6b8e-4947-83cc-7baec9b30e50"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:12:12.771751 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:12:12.771682    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e33839df-6b8e-4947-83cc-7baec9b30e50-workload-certs" pod "e33839df-6b8e-4947-83cc-7baec9b30e50" (UID: "e33839df-6b8e-4947-83cc-7baec9b30e50"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:12:12.771751 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:12:12.771607    6004 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4dw94\" (UniqueName: \"kubernetes.io/projected/2f468858-dc38-49e9-a978-cd859ba366dd-kube-api-access-4dw94\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:12:12.771751 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:12:12.771720    6004 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e33839df-6b8e-4947-83cc-7baec9b30e50-credential-socket\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:12:12.771751 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:12:12.771738    6004 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2f468858-dc38-49e9-a978-cd859ba366dd-istio-podinfo\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:12:12.771959 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:12:12.771754    6004 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2f468858-dc38-49e9-a978-cd859ba366dd-istio-envoy\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:12:12.771959 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:12:12.771768    6004 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c9a46681-c4b7-48f6-b95a-60f12f98c54d-istio-envoy\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:12:12.771959 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:12:12.771783    6004 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c9a46681-c4b7-48f6-b95a-60f12f98c54d-istio-podinfo\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:12:12.771959 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:12:12.771797    6004 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c9a46681-c4b7-48f6-b95a-60f12f98c54d-istio-token\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:12:12.771959 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:12:12.771811    6004 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2f468858-dc38-49e9-a978-cd859ba366dd-istio-token\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:12:12.771959 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:12:12.771825    6004 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e33839df-6b8e-4947-83cc-7baec9b30e50-istio-data\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:12:12.772300 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:12:12.772174    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e33839df-6b8e-4947-83cc-7baec9b30e50-istiod-ca-cert" pod "e33839df-6b8e-4947-83cc-7baec9b30e50" (UID: "e33839df-6b8e-4947-83cc-7baec9b30e50"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:12:12.774103 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:12:12.773920    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e33839df-6b8e-4947-83cc-7baec9b30e50-kube-api-access-mtbrz" pod "e33839df-6b8e-4947-83cc-7baec9b30e50" (UID: "e33839df-6b8e-4947-83cc-7baec9b30e50"). InnerVolumeSpecName "kube-api-access-mtbrz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:12:12.774281 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:12:12.774258    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e33839df-6b8e-4947-83cc-7baec9b30e50-istio-envoy" pod "e33839df-6b8e-4947-83cc-7baec9b30e50" (UID: "e33839df-6b8e-4947-83cc-7baec9b30e50"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:12:12.775203 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:12:12.775178    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e33839df-6b8e-4947-83cc-7baec9b30e50-istio-token" pod "e33839df-6b8e-4947-83cc-7baec9b30e50" (UID: "e33839df-6b8e-4947-83cc-7baec9b30e50"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:12:12.775457 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:12:12.775435    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/e33839df-6b8e-4947-83cc-7baec9b30e50-istio-podinfo" pod "e33839df-6b8e-4947-83cc-7baec9b30e50" (UID: "e33839df-6b8e-4947-83cc-7baec9b30e50"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 21:12:12.882556 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:12:12.882515    6004 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e33839df-6b8e-4947-83cc-7baec9b30e50-istio-podinfo\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:12:12.882737 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:12:12.882564    6004 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e33839df-6b8e-4947-83cc-7baec9b30e50-istio-envoy\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:12:12.882737 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:12:12.882581    6004 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e33839df-6b8e-4947-83cc-7baec9b30e50-workload-socket\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:12:12.882737 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:12:12.882594    6004 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e33839df-6b8e-4947-83cc-7baec9b30e50-istiod-ca-cert\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:12:12.882737 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:12:12.882608    6004 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e33839df-6b8e-4947-83cc-7baec9b30e50-istio-token\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:12:12.882936 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:12:12.882740    6004 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e33839df-6b8e-4947-83cc-7baec9b30e50-workload-certs\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:12:12.882936 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:12:12.882755    6004 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mtbrz\" (UniqueName: \"kubernetes.io/projected/e33839df-6b8e-4947-83cc-7baec9b30e50-kube-api-access-mtbrz\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:12:13.165701 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:12:13.165607    6004 generic.go:356] "Generic (PLEG): container finished" podID="e33839df-6b8e-4947-83cc-7baec9b30e50" containerID="806140dbe1925d8594c84222fced626620f4d02becbd74b8ab30f0d070412800" exitCode=0
Oct 30 21:12:13.165701 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:12:13.165694    6004 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-682999-openshift-default-54dcb797b5-nmbtx" event={"ID":"e33839df-6b8e-4947-83cc-7baec9b30e50","Type":"ContainerDied","Data":"806140dbe1925d8594c84222fced626620f4d02becbd74b8ab30f0d070412800"}
Oct 30 21:12:13.165942 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:12:13.165706    6004 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-682999-openshift-default-54dcb797b5-nmbtx"
Oct 30 21:12:13.165942 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:12:13.165763    6004 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-682999-openshift-default-54dcb797b5-nmbtx" event={"ID":"e33839df-6b8e-4947-83cc-7baec9b30e50","Type":"ContainerDied","Data":"92d1514176302124197c4e823d887ef2c12ee91dac8516f742ad74688c37fd3c"}
Oct 30 21:12:13.165942 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:12:13.165787    6004 scope.go:122] "RemoveContainer" containerID="806140dbe1925d8594c84222fced626620f4d02becbd74b8ab30f0d070412800"
Oct 30 21:12:13.177021 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:12:13.176994    6004 generic.go:356] "Generic (PLEG): container finished" podID="2f468858-dc38-49e9-a978-cd859ba366dd" containerID="d83a9565bfda0cd65c6ae623ee68f023412382ba19377922dc23d0c968e85c95" exitCode=0
Oct 30 21:12:13.177193 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:12:13.177082    6004 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-2b425d-openshift-default-f547dbcbf-v9wp8"
Oct 30 21:12:13.177455 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:12:13.177082    6004 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-2b425d-openshift-default-f547dbcbf-v9wp8" event={"ID":"2f468858-dc38-49e9-a978-cd859ba366dd","Type":"ContainerDied","Data":"d83a9565bfda0cd65c6ae623ee68f023412382ba19377922dc23d0c968e85c95"}
Oct 30 21:12:13.177539 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:12:13.177487    6004 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-2b425d-openshift-default-f547dbcbf-v9wp8" event={"ID":"2f468858-dc38-49e9-a978-cd859ba366dd","Type":"ContainerDied","Data":"a579e93801c8f274a660f7df69efe6e4b8e69317ca082d78a98cd5a02b170da5"}
Oct 30 21:12:13.178932 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:12:13.178904    6004 generic.go:356] "Generic (PLEG): container finished" podID="c9a46681-c4b7-48f6-b95a-60f12f98c54d" containerID="feb1f01de4c266fe1cfc3a730367316c4438c84478e5fc00d14a617d26cf1bd8" exitCode=0
Oct 30 21:12:13.179113 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:12:13.179094    6004 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-781058-openshift-default-55fb495b7-xgtg7" event={"ID":"c9a46681-c4b7-48f6-b95a-60f12f98c54d","Type":"ContainerDied","Data":"feb1f01de4c266fe1cfc3a730367316c4438c84478e5fc00d14a617d26cf1bd8"}
Oct 30 21:12:13.179207 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:12:13.179142    6004 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-781058-openshift-default-55fb495b7-xgtg7" event={"ID":"c9a46681-c4b7-48f6-b95a-60f12f98c54d","Type":"ContainerDied","Data":"4013deded1e29abc34f7b6416e2292fb74dc5dbfbb201f2feba2c1999634087e"}
Oct 30 21:12:13.179267 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:12:13.179233    6004 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-781058-openshift-default-55fb495b7-xgtg7"
Oct 30 21:12:13.212899 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:12:13.212872    6004 scope.go:122] "RemoveContainer" containerID="806140dbe1925d8594c84222fced626620f4d02becbd74b8ab30f0d070412800"
Oct 30 21:12:13.213299 ip-10-0-138-85 kubenswrapper[6004]: E1030 21:12:13.213275    6004 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"806140dbe1925d8594c84222fced626620f4d02becbd74b8ab30f0d070412800\": container with ID starting with 806140dbe1925d8594c84222fced626620f4d02becbd74b8ab30f0d070412800 not found: ID does not exist" containerID="806140dbe1925d8594c84222fced626620f4d02becbd74b8ab30f0d070412800"
Oct 30 21:12:13.213407 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:12:13.213306    6004 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"806140dbe1925d8594c84222fced626620f4d02becbd74b8ab30f0d070412800"} err="failed to get container status \"806140dbe1925d8594c84222fced626620f4d02becbd74b8ab30f0d070412800\": rpc error: code = NotFound desc = could not find container \"806140dbe1925d8594c84222fced626620f4d02becbd74b8ab30f0d070412800\": container with ID starting with 806140dbe1925d8594c84222fced626620f4d02becbd74b8ab30f0d070412800 not found: ID does not exist"
Oct 30 21:12:13.213407 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:12:13.213325    6004 scope.go:122] "RemoveContainer" containerID="d83a9565bfda0cd65c6ae623ee68f023412382ba19377922dc23d0c968e85c95"
Oct 30 21:12:13.223587 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:12:13.223566    6004 scope.go:122] "RemoveContainer" containerID="d83a9565bfda0cd65c6ae623ee68f023412382ba19377922dc23d0c968e85c95"
Oct 30 21:12:13.223885 ip-10-0-138-85 kubenswrapper[6004]: E1030 21:12:13.223862    6004 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d83a9565bfda0cd65c6ae623ee68f023412382ba19377922dc23d0c968e85c95\": container with ID starting with d83a9565bfda0cd65c6ae623ee68f023412382ba19377922dc23d0c968e85c95 not found: ID does not exist" containerID="d83a9565bfda0cd65c6ae623ee68f023412382ba19377922dc23d0c968e85c95"
Oct 30 21:12:13.223968 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:12:13.223892    6004 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d83a9565bfda0cd65c6ae623ee68f023412382ba19377922dc23d0c968e85c95"} err="failed to get container status \"d83a9565bfda0cd65c6ae623ee68f023412382ba19377922dc23d0c968e85c95\": rpc error: code = NotFound desc = could not find container \"d83a9565bfda0cd65c6ae623ee68f023412382ba19377922dc23d0c968e85c95\": container with ID starting with d83a9565bfda0cd65c6ae623ee68f023412382ba19377922dc23d0c968e85c95 not found: ID does not exist"
Oct 30 21:12:13.223968 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:12:13.223910    6004 scope.go:122] "RemoveContainer" containerID="feb1f01de4c266fe1cfc3a730367316c4438c84478e5fc00d14a617d26cf1bd8"
Oct 30 21:12:13.233451 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:12:13.233433    6004 scope.go:122] "RemoveContainer" containerID="feb1f01de4c266fe1cfc3a730367316c4438c84478e5fc00d14a617d26cf1bd8"
Oct 30 21:12:13.233737 ip-10-0-138-85 kubenswrapper[6004]: E1030 21:12:13.233714    6004 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"feb1f01de4c266fe1cfc3a730367316c4438c84478e5fc00d14a617d26cf1bd8\": container with ID starting with feb1f01de4c266fe1cfc3a730367316c4438c84478e5fc00d14a617d26cf1bd8 not found: ID does not exist" containerID="feb1f01de4c266fe1cfc3a730367316c4438c84478e5fc00d14a617d26cf1bd8"
Oct 30 21:12:13.233800 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:12:13.233759    6004 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"feb1f01de4c266fe1cfc3a730367316c4438c84478e5fc00d14a617d26cf1bd8"} err="failed to get container status \"feb1f01de4c266fe1cfc3a730367316c4438c84478e5fc00d14a617d26cf1bd8\": rpc error: code = NotFound desc = could not find container \"feb1f01de4c266fe1cfc3a730367316c4438c84478e5fc00d14a617d26cf1bd8\": container with ID starting with feb1f01de4c266fe1cfc3a730367316c4438c84478e5fc00d14a617d26cf1bd8 not found: ID does not exist"
Oct 30 21:12:13.334489 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:12:13.334449    6004 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w5-2b425d-openshift-default-f547dbcbf-v9wp8"]
Oct 30 21:12:13.337842 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:12:13.337819    6004 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w5-2b425d-openshift-default-f547dbcbf-v9wp8"]
Oct 30 21:12:13.444967 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:12:13.444934    6004 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w3-682999-openshift-default-54dcb797b5-nmbtx"]
Oct 30 21:12:13.449978 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:12:13.449952    6004 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w3-682999-openshift-default-54dcb797b5-nmbtx"]
Oct 30 21:12:13.563896 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:12:13.563863    6004 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w0-781058-openshift-default-55fb495b7-xgtg7"]
Oct 30 21:12:13.567434 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:12:13.567405    6004 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w0-781058-openshift-default-55fb495b7-xgtg7"]
Oct 30 21:12:14.301091 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:12:14.299395    6004 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="2f468858-dc38-49e9-a978-cd859ba366dd" path="/var/lib/kubelet/pods/2f468858-dc38-49e9-a978-cd859ba366dd/volumes"
Oct 30 21:12:14.301091 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:12:14.301011    6004 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="c9a46681-c4b7-48f6-b95a-60f12f98c54d" path="/var/lib/kubelet/pods/c9a46681-c4b7-48f6-b95a-60f12f98c54d/volumes"
Oct 30 21:12:14.301580 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:12:14.301556    6004 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="e33839df-6b8e-4947-83cc-7baec9b30e50" path="/var/lib/kubelet/pods/e33839df-6b8e-4947-83cc-7baec9b30e50/volumes"
Oct 30 21:12:14.337127 ip-10-0-138-85 kubenswrapper[6004]: E1030 21:12:14.337017    6004 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-zz4wr" containerName="extractor"
Oct 30 21:12:21.962944 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:12:21.962909    6004 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-cb6404-5b8885c785-vhrvl"]
Oct 30 21:12:21.963645 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:12:21.963628    6004 cpu_manager.go:414] "containerMap: removing container" podUID="2f468858-dc38-49e9-a978-cd859ba366dd" containerName="istio-proxy"
Oct 30 21:12:21.963706 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:12:21.963646    6004 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="2f468858-dc38-49e9-a978-cd859ba366dd" containerName="istio-proxy"
Oct 30 21:12:21.963706 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:12:21.963681    6004 cpu_manager.go:414] "containerMap: removing container" podUID="c9a46681-c4b7-48f6-b95a-60f12f98c54d" containerName="istio-proxy"
Oct 30 21:12:21.963706 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:12:21.963686    6004 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="c9a46681-c4b7-48f6-b95a-60f12f98c54d" containerName="istio-proxy"
Oct 30 21:12:21.963803 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:12:21.963714    6004 cpu_manager.go:414] "containerMap: removing container" podUID="e33839df-6b8e-4947-83cc-7baec9b30e50" containerName="istio-proxy"
Oct 30 21:12:21.963803 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:12:21.963719    6004 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="e33839df-6b8e-4947-83cc-7baec9b30e50" containerName="istio-proxy"
Oct 30 21:12:21.963860 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:12:21.963804    6004 memory_manager.go:365] "RemoveStaleState removing state" podUID="e33839df-6b8e-4947-83cc-7baec9b30e50" containerName="istio-proxy"
Oct 30 21:12:21.963860 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:12:21.963812    6004 memory_manager.go:365] "RemoveStaleState removing state" podUID="2f468858-dc38-49e9-a978-cd859ba366dd" containerName="istio-proxy"
Oct 30 21:12:21.963860 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:12:21.963823    6004 memory_manager.go:365] "RemoveStaleState removing state" podUID="c9a46681-c4b7-48f6-b95a-60f12f98c54d" containerName="istio-proxy"
Oct 30 21:12:21.969297 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:12:21.969276    6004 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-cb6404-5b8885c785-vhrvl"
Oct 30 21:12:22.025650 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:12:22.025610    6004 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-b-cb6404-serving-cert\""
Oct 30 21:12:22.030421 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:12:22.030395    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f70ac5fb-9ac9-4cb2-b2aa-4d37bfc117ee-metrics-certs\") pod \"maas-api-e2e-api-b-cb6404-5b8885c785-vhrvl\" (UID: \"f70ac5fb-9ac9-4cb2-b2aa-4d37bfc117ee\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-cb6404-5b8885c785-vhrvl"
Oct 30 21:12:22.030570 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:12:22.030553    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f70ac5fb-9ac9-4cb2-b2aa-4d37bfc117ee-openshift-service-ca\") pod \"maas-api-e2e-api-b-cb6404-5b8885c785-vhrvl\" (UID: \"f70ac5fb-9ac9-4cb2-b2aa-4d37bfc117ee\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-cb6404-5b8885c785-vhrvl"
Oct 30 21:12:22.030612 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:12:22.030587    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lrmcl\" (UniqueName: \"kubernetes.io/projected/f70ac5fb-9ac9-4cb2-b2aa-4d37bfc117ee-kube-api-access-lrmcl\") pod \"maas-api-e2e-api-b-cb6404-5b8885c785-vhrvl\" (UID: \"f70ac5fb-9ac9-4cb2-b2aa-4d37bfc117ee\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-cb6404-5b8885c785-vhrvl"
Oct 30 21:12:22.030653 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:12:22.030608    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f70ac5fb-9ac9-4cb2-b2aa-4d37bfc117ee-maas-api-tls\") pod \"maas-api-e2e-api-b-cb6404-5b8885c785-vhrvl\" (UID: \"f70ac5fb-9ac9-4cb2-b2aa-4d37bfc117ee\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-cb6404-5b8885c785-vhrvl"
Oct 30 21:12:22.081687 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:12:22.081650    6004 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-cb6404-5b8885c785-vhrvl"]
Oct 30 21:12:22.132418 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:12:22.132382    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f70ac5fb-9ac9-4cb2-b2aa-4d37bfc117ee-metrics-certs\") pod \"maas-api-e2e-api-b-cb6404-5b8885c785-vhrvl\" (UID: \"f70ac5fb-9ac9-4cb2-b2aa-4d37bfc117ee\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-cb6404-5b8885c785-vhrvl"
Oct 30 21:12:22.132614 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:12:22.132537    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f70ac5fb-9ac9-4cb2-b2aa-4d37bfc117ee-openshift-service-ca\") pod \"maas-api-e2e-api-b-cb6404-5b8885c785-vhrvl\" (UID: \"f70ac5fb-9ac9-4cb2-b2aa-4d37bfc117ee\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-cb6404-5b8885c785-vhrvl"
Oct 30 21:12:22.132614 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:12:22.132579    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lrmcl\" (UniqueName: \"kubernetes.io/projected/f70ac5fb-9ac9-4cb2-b2aa-4d37bfc117ee-kube-api-access-lrmcl\") pod \"maas-api-e2e-api-b-cb6404-5b8885c785-vhrvl\" (UID: \"f70ac5fb-9ac9-4cb2-b2aa-4d37bfc117ee\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-cb6404-5b8885c785-vhrvl"
Oct 30 21:12:22.132614 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:12:22.132610    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f70ac5fb-9ac9-4cb2-b2aa-4d37bfc117ee-maas-api-tls\") pod \"maas-api-e2e-api-b-cb6404-5b8885c785-vhrvl\" (UID: \"f70ac5fb-9ac9-4cb2-b2aa-4d37bfc117ee\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-cb6404-5b8885c785-vhrvl"
Oct 30 21:12:22.132874 ip-10-0-138-85 kubenswrapper[6004]: E1030 21:12:22.132853    6004 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-api-b-cb6404-serving-cert: secret "maas-api-e2e-api-b-cb6404-serving-cert" not found
Oct 30 21:12:22.132960 ip-10-0-138-85 kubenswrapper[6004]: E1030 21:12:22.132948    6004 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f70ac5fb-9ac9-4cb2-b2aa-4d37bfc117ee-maas-api-tls podName:f70ac5fb-9ac9-4cb2-b2aa-4d37bfc117ee nodeName:}" failed. No retries permitted until 2026-10-30 21:12:22.632922634 +0000 UTC m=+2048.552708732 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/f70ac5fb-9ac9-4cb2-b2aa-4d37bfc117ee-maas-api-tls") pod "maas-api-e2e-api-b-cb6404-5b8885c785-vhrvl" (UID: "f70ac5fb-9ac9-4cb2-b2aa-4d37bfc117ee") : secret "maas-api-e2e-api-b-cb6404-serving-cert" not found
Oct 30 21:12:22.133751 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:12:22.133727    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f70ac5fb-9ac9-4cb2-b2aa-4d37bfc117ee-openshift-service-ca\") pod \"maas-api-e2e-api-b-cb6404-5b8885c785-vhrvl\" (UID: \"f70ac5fb-9ac9-4cb2-b2aa-4d37bfc117ee\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-cb6404-5b8885c785-vhrvl"
Oct 30 21:12:22.134998 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:12:22.134976    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f70ac5fb-9ac9-4cb2-b2aa-4d37bfc117ee-metrics-certs\") pod \"maas-api-e2e-api-b-cb6404-5b8885c785-vhrvl\" (UID: \"f70ac5fb-9ac9-4cb2-b2aa-4d37bfc117ee\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-cb6404-5b8885c785-vhrvl"
Oct 30 21:12:22.193198 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:12:22.193159    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lrmcl\" (UniqueName: \"kubernetes.io/projected/f70ac5fb-9ac9-4cb2-b2aa-4d37bfc117ee-kube-api-access-lrmcl\") pod \"maas-api-e2e-api-b-cb6404-5b8885c785-vhrvl\" (UID: \"f70ac5fb-9ac9-4cb2-b2aa-4d37bfc117ee\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-cb6404-5b8885c785-vhrvl"
Oct 30 21:12:22.645943 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:12:22.645907    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f70ac5fb-9ac9-4cb2-b2aa-4d37bfc117ee-maas-api-tls\") pod \"maas-api-e2e-api-b-cb6404-5b8885c785-vhrvl\" (UID: \"f70ac5fb-9ac9-4cb2-b2aa-4d37bfc117ee\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-cb6404-5b8885c785-vhrvl"
Oct 30 21:12:22.648588 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:12:22.648557    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f70ac5fb-9ac9-4cb2-b2aa-4d37bfc117ee-maas-api-tls\") pod \"maas-api-e2e-api-b-cb6404-5b8885c785-vhrvl\" (UID: \"f70ac5fb-9ac9-4cb2-b2aa-4d37bfc117ee\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-cb6404-5b8885c785-vhrvl"
Oct 30 21:12:22.883163 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:12:22.883114    6004 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-cb6404-5b8885c785-vhrvl"
Oct 30 21:12:23.269311 ip-10-0-138-85 kubenswrapper[6004]: W1030 21:12:23.269271    6004 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf70ac5fb_9ac9_4cb2_b2aa_4d37bfc117ee.slice/crio-1c8d222db1ed680e5134815715a4e1d023837ba700ba711ce1f466cedfbc6ee1 WatchSource:0}: Error finding container 1c8d222db1ed680e5134815715a4e1d023837ba700ba711ce1f466cedfbc6ee1: Status 404 returned error can't find the container with id 1c8d222db1ed680e5134815715a4e1d023837ba700ba711ce1f466cedfbc6ee1
Oct 30 21:12:23.269311 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:12:23.269296    6004 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-cb6404-5b8885c785-vhrvl"]
Oct 30 21:12:23.410336 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:12:23.410291    6004 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-cb6404-5b8885c785-vhrvl" event={"ID":"f70ac5fb-9ac9-4cb2-b2aa-4d37bfc117ee","Type":"ContainerStarted","Data":"1c8d222db1ed680e5134815715a4e1d023837ba700ba711ce1f466cedfbc6ee1"}
Oct 30 21:12:24.420512 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:12:24.420413    6004 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-cb6404-5b8885c785-vhrvl" event={"ID":"f70ac5fb-9ac9-4cb2-b2aa-4d37bfc117ee","Type":"ContainerStarted","Data":"bb4e6a4aa50dbf74fb29b2c7a0a56ab503699e6325903ae7a4acd7c14eac3b56"}
Oct 30 21:12:24.420871 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:12:24.420516    6004 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-cb6404-5b8885c785-vhrvl"
Oct 30 21:12:24.538941 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:12:24.538871    6004 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-cb6404-5b8885c785-vhrvl" podStartSLOduration=2.6415835640000003 podStartE2EDuration="3.538850513s" totalImagesPullingTime="897.266949ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:12:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:12:24.536100412 +0000 UTC m=+2050.455886531" watchObservedRunningTime="2026-10-30 21:12:24.538850513 +0000 UTC m=+2050.458636633"
Oct 30 21:12:30.435517 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:12:30.435484    6004 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-cb6404-5b8885c785-vhrvl"
Oct 30 21:12:44.290120 ip-10-0-138-85 kubenswrapper[6004]: E1030 21:12:44.290079    6004 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-zz4wr" containerName="extractor"
Oct 30 21:12:59.107537 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:12:59.107442    6004 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-9926f7-795755f5d8-p2slb"]
Oct 30 21:12:59.110390 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:12:59.107703    6004 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-9926f7-795755f5d8-p2slb" podUID="552ce26c-3856-42d4-a079-0b9d2309a83c" containerName="maas-api" containerID="cri-o://1aaf1c3912dad1fcbbda0b229363dc5ae5c82f6e71e61a383737f8a214679744" gracePeriod=30
Oct 30 21:12:59.603074 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:12:59.602457    6004 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-9926f7-795755f5d8-p2slb"
Oct 30 21:12:59.741783 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:12:59.741747    6004 generic.go:356] "Generic (PLEG): container finished" podID="552ce26c-3856-42d4-a079-0b9d2309a83c" containerID="1aaf1c3912dad1fcbbda0b229363dc5ae5c82f6e71e61a383737f8a214679744" exitCode=0
Oct 30 21:12:59.741966 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:12:59.741803    6004 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-9926f7-795755f5d8-p2slb"
Oct 30 21:12:59.741966 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:12:59.741824    6004 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-9926f7-795755f5d8-p2slb" event={"ID":"552ce26c-3856-42d4-a079-0b9d2309a83c","Type":"ContainerDied","Data":"1aaf1c3912dad1fcbbda0b229363dc5ae5c82f6e71e61a383737f8a214679744"}
Oct 30 21:12:59.741966 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:12:59.741895    6004 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-9926f7-795755f5d8-p2slb" event={"ID":"552ce26c-3856-42d4-a079-0b9d2309a83c","Type":"ContainerDied","Data":"63140ec2acf185b0234878dae1a32c4b90834ce840255f9aebb754b589643388"}
Oct 30 21:12:59.741966 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:12:59.741928    6004 scope.go:122] "RemoveContainer" containerID="1aaf1c3912dad1fcbbda0b229363dc5ae5c82f6e71e61a383737f8a214679744"
Oct 30 21:12:59.756499 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:12:59.756480    6004 scope.go:122] "RemoveContainer" containerID="1aaf1c3912dad1fcbbda0b229363dc5ae5c82f6e71e61a383737f8a214679744"
Oct 30 21:12:59.756878 ip-10-0-138-85 kubenswrapper[6004]: E1030 21:12:59.756854    6004 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1aaf1c3912dad1fcbbda0b229363dc5ae5c82f6e71e61a383737f8a214679744\": container with ID starting with 1aaf1c3912dad1fcbbda0b229363dc5ae5c82f6e71e61a383737f8a214679744 not found: ID does not exist" containerID="1aaf1c3912dad1fcbbda0b229363dc5ae5c82f6e71e61a383737f8a214679744"
Oct 30 21:12:59.756989 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:12:59.756889    6004 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1aaf1c3912dad1fcbbda0b229363dc5ae5c82f6e71e61a383737f8a214679744"} err="failed to get container status \"1aaf1c3912dad1fcbbda0b229363dc5ae5c82f6e71e61a383737f8a214679744\": rpc error: code = NotFound desc = could not find container \"1aaf1c3912dad1fcbbda0b229363dc5ae5c82f6e71e61a383737f8a214679744\": container with ID starting with 1aaf1c3912dad1fcbbda0b229363dc5ae5c82f6e71e61a383737f8a214679744 not found: ID does not exist"
Oct 30 21:12:59.768720 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:12:59.768696    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/552ce26c-3856-42d4-a079-0b9d2309a83c-kube-api-access-qrfvn\" (UniqueName: \"kubernetes.io/projected/552ce26c-3856-42d4-a079-0b9d2309a83c-kube-api-access-qrfvn\") pod \"552ce26c-3856-42d4-a079-0b9d2309a83c\" (UID: \"552ce26c-3856-42d4-a079-0b9d2309a83c\") "
Oct 30 21:12:59.768845 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:12:59.768774    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/552ce26c-3856-42d4-a079-0b9d2309a83c-metrics-certs\" (UniqueName: \"kubernetes.io/secret/552ce26c-3856-42d4-a079-0b9d2309a83c-metrics-certs\") pod \"552ce26c-3856-42d4-a079-0b9d2309a83c\" (UID: \"552ce26c-3856-42d4-a079-0b9d2309a83c\") "
Oct 30 21:12:59.768845 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:12:59.768837    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/552ce26c-3856-42d4-a079-0b9d2309a83c-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/552ce26c-3856-42d4-a079-0b9d2309a83c-openshift-service-ca\") pod \"552ce26c-3856-42d4-a079-0b9d2309a83c\" (UID: \"552ce26c-3856-42d4-a079-0b9d2309a83c\") "
Oct 30 21:12:59.768961 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:12:59.768920    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/552ce26c-3856-42d4-a079-0b9d2309a83c-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/552ce26c-3856-42d4-a079-0b9d2309a83c-maas-api-tls\") pod \"552ce26c-3856-42d4-a079-0b9d2309a83c\" (UID: \"552ce26c-3856-42d4-a079-0b9d2309a83c\") "
Oct 30 21:12:59.769603 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:12:59.769573    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/552ce26c-3856-42d4-a079-0b9d2309a83c-openshift-service-ca" pod "552ce26c-3856-42d4-a079-0b9d2309a83c" (UID: "552ce26c-3856-42d4-a079-0b9d2309a83c"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:12:59.773094 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:12:59.772228    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/552ce26c-3856-42d4-a079-0b9d2309a83c-metrics-certs" pod "552ce26c-3856-42d4-a079-0b9d2309a83c" (UID: "552ce26c-3856-42d4-a079-0b9d2309a83c"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:12:59.773094 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:12:59.772370    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/552ce26c-3856-42d4-a079-0b9d2309a83c-kube-api-access-qrfvn" pod "552ce26c-3856-42d4-a079-0b9d2309a83c" (UID: "552ce26c-3856-42d4-a079-0b9d2309a83c"). InnerVolumeSpecName "kube-api-access-qrfvn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:12:59.773094 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:12:59.772473    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/552ce26c-3856-42d4-a079-0b9d2309a83c-maas-api-tls" pod "552ce26c-3856-42d4-a079-0b9d2309a83c" (UID: "552ce26c-3856-42d4-a079-0b9d2309a83c"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:12:59.870937 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:12:59.870904    6004 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qrfvn\" (UniqueName: \"kubernetes.io/projected/552ce26c-3856-42d4-a079-0b9d2309a83c-kube-api-access-qrfvn\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:12:59.870937 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:12:59.870934    6004 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/552ce26c-3856-42d4-a079-0b9d2309a83c-metrics-certs\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:12:59.870937 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:12:59.870945    6004 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/552ce26c-3856-42d4-a079-0b9d2309a83c-openshift-service-ca\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:12:59.871198 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:12:59.870955    6004 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/552ce26c-3856-42d4-a079-0b9d2309a83c-maas-api-tls\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:13:00.198172 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:13:00.198112    6004 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-9926f7-795755f5d8-p2slb"]
Oct 30 21:13:00.212068 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:13:00.205488    6004 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-9926f7-795755f5d8-p2slb"]
Oct 30 21:13:00.256076 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:13:00.247530    6004 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="552ce26c-3856-42d4-a079-0b9d2309a83c" path="/var/lib/kubelet/pods/552ce26c-3856-42d4-a079-0b9d2309a83c/volumes"
Oct 30 21:13:00.400205 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:13:00.400118    6004 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-f3b172-86c94df899-4mfpx"]
Oct 30 21:13:00.400379 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:13:00.400317    6004 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-f3b172-86c94df899-4mfpx" podUID="d4242313-4c6a-409c-a1ed-8c7885206928" containerName="maas-api" containerID="cri-o://b77af615760f27b2dffc06629c01ab8f16440ae11351c00ed98044e9d0bd29bd" gracePeriod=30
Oct 30 21:13:00.760012 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:13:00.759980    6004 generic.go:356] "Generic (PLEG): container finished" podID="d4242313-4c6a-409c-a1ed-8c7885206928" containerID="b77af615760f27b2dffc06629c01ab8f16440ae11351c00ed98044e9d0bd29bd" exitCode=0
Oct 30 21:13:00.760220 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:13:00.760099    6004 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-f3b172-86c94df899-4mfpx" event={"ID":"d4242313-4c6a-409c-a1ed-8c7885206928","Type":"ContainerDied","Data":"b77af615760f27b2dffc06629c01ab8f16440ae11351c00ed98044e9d0bd29bd"}
Oct 30 21:13:00.891072 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:13:00.886560    6004 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-f3b172-86c94df899-4mfpx"
Oct 30 21:13:00.923079 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:13:00.922285    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/d4242313-4c6a-409c-a1ed-8c7885206928-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d4242313-4c6a-409c-a1ed-8c7885206928-openshift-service-ca\") pod \"d4242313-4c6a-409c-a1ed-8c7885206928\" (UID: \"d4242313-4c6a-409c-a1ed-8c7885206928\") "
Oct 30 21:13:00.923079 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:13:00.922345    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/d4242313-4c6a-409c-a1ed-8c7885206928-metrics-certs\" (UniqueName: \"kubernetes.io/secret/d4242313-4c6a-409c-a1ed-8c7885206928-metrics-certs\") pod \"d4242313-4c6a-409c-a1ed-8c7885206928\" (UID: \"d4242313-4c6a-409c-a1ed-8c7885206928\") "
Oct 30 21:13:00.923079 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:13:00.922554    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/d4242313-4c6a-409c-a1ed-8c7885206928-kube-api-access-dfpn5\" (UniqueName: \"kubernetes.io/projected/d4242313-4c6a-409c-a1ed-8c7885206928-kube-api-access-dfpn5\") pod \"d4242313-4c6a-409c-a1ed-8c7885206928\" (UID: \"d4242313-4c6a-409c-a1ed-8c7885206928\") "
Oct 30 21:13:00.923079 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:13:00.922594    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/d4242313-4c6a-409c-a1ed-8c7885206928-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d4242313-4c6a-409c-a1ed-8c7885206928-maas-api-tls\") pod \"d4242313-4c6a-409c-a1ed-8c7885206928\" (UID: \"d4242313-4c6a-409c-a1ed-8c7885206928\") "
Oct 30 21:13:00.934879 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:13:00.932222    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d4242313-4c6a-409c-a1ed-8c7885206928-openshift-service-ca" pod "d4242313-4c6a-409c-a1ed-8c7885206928" (UID: "d4242313-4c6a-409c-a1ed-8c7885206928"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:13:00.940071 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:13:00.939808    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d4242313-4c6a-409c-a1ed-8c7885206928-maas-api-tls" pod "d4242313-4c6a-409c-a1ed-8c7885206928" (UID: "d4242313-4c6a-409c-a1ed-8c7885206928"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:13:00.949596 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:13:00.943443    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d4242313-4c6a-409c-a1ed-8c7885206928-kube-api-access-dfpn5" pod "d4242313-4c6a-409c-a1ed-8c7885206928" (UID: "d4242313-4c6a-409c-a1ed-8c7885206928"). InnerVolumeSpecName "kube-api-access-dfpn5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:13:00.961651 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:13:00.961604    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d4242313-4c6a-409c-a1ed-8c7885206928-metrics-certs" pod "d4242313-4c6a-409c-a1ed-8c7885206928" (UID: "d4242313-4c6a-409c-a1ed-8c7885206928"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:13:01.033327 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:13:01.033232    6004 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dfpn5\" (UniqueName: \"kubernetes.io/projected/d4242313-4c6a-409c-a1ed-8c7885206928-kube-api-access-dfpn5\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:13:01.033327 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:13:01.033272    6004 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d4242313-4c6a-409c-a1ed-8c7885206928-maas-api-tls\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:13:01.033327 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:13:01.033288    6004 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d4242313-4c6a-409c-a1ed-8c7885206928-openshift-service-ca\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:13:01.033327 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:13:01.033301    6004 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d4242313-4c6a-409c-a1ed-8c7885206928-metrics-certs\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:13:01.771083 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:13:01.771037    6004 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-f3b172-86c94df899-4mfpx" event={"ID":"d4242313-4c6a-409c-a1ed-8c7885206928","Type":"ContainerDied","Data":"e767066794ab3bcd18467e8975dc6a19d7dbb073a55b72ecd0477f80b2531887"}
Oct 30 21:13:01.771083 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:13:01.771080    6004 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-f3b172-86c94df899-4mfpx"
Oct 30 21:13:01.771645 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:13:01.771108    6004 scope.go:122] "RemoveContainer" containerID="b77af615760f27b2dffc06629c01ab8f16440ae11351c00ed98044e9d0bd29bd"
Oct 30 21:13:01.947774 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:13:01.947733    6004 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-f3b172-86c94df899-4mfpx"]
Oct 30 21:13:01.990535 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:13:01.990498    6004 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-f3b172-86c94df899-4mfpx"]
Oct 30 21:13:02.232742 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:13:02.232705    6004 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="d4242313-4c6a-409c-a1ed-8c7885206928" path="/var/lib/kubelet/pods/d4242313-4c6a-409c-a1ed-8c7885206928/volumes"
Oct 30 21:13:03.708874 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:13:03.708831    6004 prober.go:122] "Probe failed" probeType="Readiness" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-f3b172-86c94df899-4mfpx" podUID="d4242313-4c6a-409c-a1ed-8c7885206928" containerName="maas-api" probeResult="failure" output="Get \"https://10.132.0.109:8443/health\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:13:14.309962 ip-10-0-138-85 kubenswrapper[6004]: E1030 21:13:14.309916    6004 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-zz4wr" containerName="extractor"
Oct 30 21:13:14.567186 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:13:14.567096    6004 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-sb7ds_90cd3de0-c573-41c2-bf3e-cf0e46a41d50/console-operator/2.log"
Oct 30 21:13:14.579544 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:13:14.579521    6004 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-sb7ds_90cd3de0-c573-41c2-bf3e-cf0e46a41d50/console-operator/2.log"
Oct 30 21:13:44.293595 ip-10-0-138-85 kubenswrapper[6004]: E1030 21:13:44.293555    6004 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-zz4wr" containerName="extractor"
Oct 30 21:13:52.513720 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:13:52.513686    6004 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-ef7e2d-84b4ffb448-hmts8"]
Oct 30 21:13:52.514144 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:13:52.513879    6004 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-ef7e2d-84b4ffb448-hmts8" podUID="f3c5de2e-a210-4383-932a-3655559a2297" containerName="maas-api" containerID="cri-o://bb81a68fb89c10a2b504a55f4ee822d53dcc59ebb08539357a2d3bf4a198bc05" gracePeriod=30
Oct 30 21:13:52.925290 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:13:52.925257    6004 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-ef7e2d-84b4ffb448-hmts8"
Oct 30 21:13:53.088272 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:13:53.088232    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/f3c5de2e-a210-4383-932a-3655559a2297-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f3c5de2e-a210-4383-932a-3655559a2297-openshift-service-ca\") pod \"f3c5de2e-a210-4383-932a-3655559a2297\" (UID: \"f3c5de2e-a210-4383-932a-3655559a2297\") "
Oct 30 21:13:53.088693 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:13:53.088672    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/f3c5de2e-a210-4383-932a-3655559a2297-metrics-certs\" (UniqueName: \"kubernetes.io/secret/f3c5de2e-a210-4383-932a-3655559a2297-metrics-certs\") pod \"f3c5de2e-a210-4383-932a-3655559a2297\" (UID: \"f3c5de2e-a210-4383-932a-3655559a2297\") "
Oct 30 21:13:53.088865 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:13:53.088849    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/f3c5de2e-a210-4383-932a-3655559a2297-kube-api-access-8dndf\" (UniqueName: \"kubernetes.io/projected/f3c5de2e-a210-4383-932a-3655559a2297-kube-api-access-8dndf\") pod \"f3c5de2e-a210-4383-932a-3655559a2297\" (UID: \"f3c5de2e-a210-4383-932a-3655559a2297\") "
Oct 30 21:13:53.089069 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:13:53.089037    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/f3c5de2e-a210-4383-932a-3655559a2297-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f3c5de2e-a210-4383-932a-3655559a2297-maas-api-tls\") pod \"f3c5de2e-a210-4383-932a-3655559a2297\" (UID: \"f3c5de2e-a210-4383-932a-3655559a2297\") "
Oct 30 21:13:53.098679 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:13:53.098643    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f3c5de2e-a210-4383-932a-3655559a2297-openshift-service-ca" pod "f3c5de2e-a210-4383-932a-3655559a2297" (UID: "f3c5de2e-a210-4383-932a-3655559a2297"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:13:53.117600 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:13:53.117545    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f3c5de2e-a210-4383-932a-3655559a2297-maas-api-tls" pod "f3c5de2e-a210-4383-932a-3655559a2297" (UID: "f3c5de2e-a210-4383-932a-3655559a2297"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:13:53.132003 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:13:53.131964    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f3c5de2e-a210-4383-932a-3655559a2297-metrics-certs" pod "f3c5de2e-a210-4383-932a-3655559a2297" (UID: "f3c5de2e-a210-4383-932a-3655559a2297"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:13:53.133008 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:13:53.132962    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f3c5de2e-a210-4383-932a-3655559a2297-kube-api-access-8dndf" pod "f3c5de2e-a210-4383-932a-3655559a2297" (UID: "f3c5de2e-a210-4383-932a-3655559a2297"). InnerVolumeSpecName "kube-api-access-8dndf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:13:53.191009 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:13:53.190954    6004 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f3c5de2e-a210-4383-932a-3655559a2297-openshift-service-ca\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:13:53.191009 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:13:53.190983    6004 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f3c5de2e-a210-4383-932a-3655559a2297-metrics-certs\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:13:53.191009 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:13:53.190993    6004 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8dndf\" (UniqueName: \"kubernetes.io/projected/f3c5de2e-a210-4383-932a-3655559a2297-kube-api-access-8dndf\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:13:53.191009 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:13:53.191007    6004 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f3c5de2e-a210-4383-932a-3655559a2297-maas-api-tls\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:13:53.352427 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:13:53.352323    6004 generic.go:356] "Generic (PLEG): container finished" podID="f3c5de2e-a210-4383-932a-3655559a2297" containerID="bb81a68fb89c10a2b504a55f4ee822d53dcc59ebb08539357a2d3bf4a198bc05" exitCode=0
Oct 30 21:13:53.352635 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:13:53.352452    6004 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-ef7e2d-84b4ffb448-hmts8" event={"ID":"f3c5de2e-a210-4383-932a-3655559a2297","Type":"ContainerDied","Data":"bb81a68fb89c10a2b504a55f4ee822d53dcc59ebb08539357a2d3bf4a198bc05"}
Oct 30 21:13:53.352635 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:13:53.352547    6004 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-ef7e2d-84b4ffb448-hmts8" event={"ID":"f3c5de2e-a210-4383-932a-3655559a2297","Type":"ContainerDied","Data":"b603971dfc2371ef01463fe464901b66f928b1d972043961eabb3ff5c071f20a"}
Oct 30 21:13:53.352635 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:13:53.352587    6004 scope.go:122] "RemoveContainer" containerID="bb81a68fb89c10a2b504a55f4ee822d53dcc59ebb08539357a2d3bf4a198bc05"
Oct 30 21:13:53.353146 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:13:53.353120    6004 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-ef7e2d-84b4ffb448-hmts8"
Oct 30 21:13:53.381356 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:13:53.381315    6004 scope.go:122] "RemoveContainer" containerID="bb81a68fb89c10a2b504a55f4ee822d53dcc59ebb08539357a2d3bf4a198bc05"
Oct 30 21:13:53.382123 ip-10-0-138-85 kubenswrapper[6004]: E1030 21:13:53.382042    6004 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bb81a68fb89c10a2b504a55f4ee822d53dcc59ebb08539357a2d3bf4a198bc05\": container with ID starting with bb81a68fb89c10a2b504a55f4ee822d53dcc59ebb08539357a2d3bf4a198bc05 not found: ID does not exist" containerID="bb81a68fb89c10a2b504a55f4ee822d53dcc59ebb08539357a2d3bf4a198bc05"
Oct 30 21:13:53.384989 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:13:53.384953    6004 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bb81a68fb89c10a2b504a55f4ee822d53dcc59ebb08539357a2d3bf4a198bc05"} err="failed to get container status \"bb81a68fb89c10a2b504a55f4ee822d53dcc59ebb08539357a2d3bf4a198bc05\": rpc error: code = NotFound desc = could not find container \"bb81a68fb89c10a2b504a55f4ee822d53dcc59ebb08539357a2d3bf4a198bc05\": container with ID starting with bb81a68fb89c10a2b504a55f4ee822d53dcc59ebb08539357a2d3bf4a198bc05 not found: ID does not exist"
Oct 30 21:13:53.533597 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:13:53.533500    6004 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-ef7e2d-84b4ffb448-hmts8"]
Oct 30 21:13:53.540235 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:13:53.540207    6004 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-ef7e2d-84b4ffb448-hmts8"]
Oct 30 21:13:54.232482 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:13:54.232451    6004 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="f3c5de2e-a210-4383-932a-3655559a2297" path="/var/lib/kubelet/pods/f3c5de2e-a210-4383-932a-3655559a2297/volumes"
Oct 30 21:14:02.921406 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:14:02.921368    6004 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-ef7e2d-openshift-default-6b6dbc765f-sg5h8"]
Oct 30 21:14:02.921897 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:14:02.921634    6004 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-api-a-ef7e2d-openshift-default-6b6dbc765f-sg5h8" podUID="21c116c2-4862-424a-bedf-41fba3b2612d" containerName="istio-proxy" containerID="cri-o://725cb39a95b45fe75817d491c245583bfde112f0f50abe5e1dbbafec0143ae50" gracePeriod=30
Oct 30 21:14:08.233123 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:14:08.233097    6004 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-ef7e2d-openshift-default-6b6dbc765f-sg5h8"
Oct 30 21:14:08.352656 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:14:08.352619    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/21c116c2-4862-424a-bedf-41fba3b2612d-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/21c116c2-4862-424a-bedf-41fba3b2612d-workload-certs\") pod \"21c116c2-4862-424a-bedf-41fba3b2612d\" (UID: \"21c116c2-4862-424a-bedf-41fba3b2612d\") "
Oct 30 21:14:08.352825 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:14:08.352671    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/21c116c2-4862-424a-bedf-41fba3b2612d-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/21c116c2-4862-424a-bedf-41fba3b2612d-workload-socket\") pod \"21c116c2-4862-424a-bedf-41fba3b2612d\" (UID: \"21c116c2-4862-424a-bedf-41fba3b2612d\") "
Oct 30 21:14:08.352825 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:14:08.352708    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/21c116c2-4862-424a-bedf-41fba3b2612d-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/21c116c2-4862-424a-bedf-41fba3b2612d-credential-socket\") pod \"21c116c2-4862-424a-bedf-41fba3b2612d\" (UID: \"21c116c2-4862-424a-bedf-41fba3b2612d\") "
Oct 30 21:14:08.352825 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:14:08.352800    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/21c116c2-4862-424a-bedf-41fba3b2612d-kube-api-access-2jsk9\" (UniqueName: \"kubernetes.io/projected/21c116c2-4862-424a-bedf-41fba3b2612d-kube-api-access-2jsk9\") pod \"21c116c2-4862-424a-bedf-41fba3b2612d\" (UID: \"21c116c2-4862-424a-bedf-41fba3b2612d\") "
Oct 30 21:14:08.353014 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:14:08.352863    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/21c116c2-4862-424a-bedf-41fba3b2612d-istio-token\" (UniqueName: \"kubernetes.io/projected/21c116c2-4862-424a-bedf-41fba3b2612d-istio-token\") pod \"21c116c2-4862-424a-bedf-41fba3b2612d\" (UID: \"21c116c2-4862-424a-bedf-41fba3b2612d\") "
Oct 30 21:14:08.353014 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:14:08.352908    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/21c116c2-4862-424a-bedf-41fba3b2612d-workload-certs" pod "21c116c2-4862-424a-bedf-41fba3b2612d" (UID: "21c116c2-4862-424a-bedf-41fba3b2612d"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:14:08.353014 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:14:08.352923    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/21c116c2-4862-424a-bedf-41fba3b2612d-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/21c116c2-4862-424a-bedf-41fba3b2612d-istio-envoy\") pod \"21c116c2-4862-424a-bedf-41fba3b2612d\" (UID: \"21c116c2-4862-424a-bedf-41fba3b2612d\") "
Oct 30 21:14:08.353014 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:14:08.352972    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/21c116c2-4862-424a-bedf-41fba3b2612d-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/21c116c2-4862-424a-bedf-41fba3b2612d-istio-data\") pod \"21c116c2-4862-424a-bedf-41fba3b2612d\" (UID: \"21c116c2-4862-424a-bedf-41fba3b2612d\") "
Oct 30 21:14:08.353245 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:14:08.353020    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/21c116c2-4862-424a-bedf-41fba3b2612d-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/21c116c2-4862-424a-bedf-41fba3b2612d-istiod-ca-cert\") pod \"21c116c2-4862-424a-bedf-41fba3b2612d\" (UID: \"21c116c2-4862-424a-bedf-41fba3b2612d\") "
Oct 30 21:14:08.353245 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:14:08.353101    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/21c116c2-4862-424a-bedf-41fba3b2612d-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/21c116c2-4862-424a-bedf-41fba3b2612d-istio-podinfo\") pod \"21c116c2-4862-424a-bedf-41fba3b2612d\" (UID: \"21c116c2-4862-424a-bedf-41fba3b2612d\") "
Oct 30 21:14:08.353245 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:14:08.353164    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/21c116c2-4862-424a-bedf-41fba3b2612d-credential-socket" pod "21c116c2-4862-424a-bedf-41fba3b2612d" (UID: "21c116c2-4862-424a-bedf-41fba3b2612d"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:14:08.353409 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:14:08.353359    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/21c116c2-4862-424a-bedf-41fba3b2612d-workload-socket" pod "21c116c2-4862-424a-bedf-41fba3b2612d" (UID: "21c116c2-4862-424a-bedf-41fba3b2612d"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:14:08.353613 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:14:08.353563    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/21c116c2-4862-424a-bedf-41fba3b2612d-istiod-ca-cert" pod "21c116c2-4862-424a-bedf-41fba3b2612d" (UID: "21c116c2-4862-424a-bedf-41fba3b2612d"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:14:08.353707 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:14:08.353409    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/21c116c2-4862-424a-bedf-41fba3b2612d-istio-data" pod "21c116c2-4862-424a-bedf-41fba3b2612d" (UID: "21c116c2-4862-424a-bedf-41fba3b2612d"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:14:08.353958 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:14:08.353936    6004 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/21c116c2-4862-424a-bedf-41fba3b2612d-workload-certs\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:14:08.354066 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:14:08.353962    6004 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/21c116c2-4862-424a-bedf-41fba3b2612d-workload-socket\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:14:08.354066 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:14:08.353977    6004 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/21c116c2-4862-424a-bedf-41fba3b2612d-credential-socket\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:14:08.354066 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:14:08.353991    6004 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/21c116c2-4862-424a-bedf-41fba3b2612d-istio-data\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:14:08.354066 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:14:08.354005    6004 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/21c116c2-4862-424a-bedf-41fba3b2612d-istiod-ca-cert\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:14:08.355354 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:14:08.355295    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/21c116c2-4862-424a-bedf-41fba3b2612d-istio-token" pod "21c116c2-4862-424a-bedf-41fba3b2612d" (UID: "21c116c2-4862-424a-bedf-41fba3b2612d"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:14:08.355493 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:14:08.355473    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/21c116c2-4862-424a-bedf-41fba3b2612d-istio-podinfo" pod "21c116c2-4862-424a-bedf-41fba3b2612d" (UID: "21c116c2-4862-424a-bedf-41fba3b2612d"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 21:14:08.355553 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:14:08.355487    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/21c116c2-4862-424a-bedf-41fba3b2612d-istio-envoy" pod "21c116c2-4862-424a-bedf-41fba3b2612d" (UID: "21c116c2-4862-424a-bedf-41fba3b2612d"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:14:08.355827 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:14:08.355807    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/21c116c2-4862-424a-bedf-41fba3b2612d-kube-api-access-2jsk9" pod "21c116c2-4862-424a-bedf-41fba3b2612d" (UID: "21c116c2-4862-424a-bedf-41fba3b2612d"). InnerVolumeSpecName "kube-api-access-2jsk9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:14:08.455777 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:14:08.455738    6004 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/21c116c2-4862-424a-bedf-41fba3b2612d-istio-envoy\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:14:08.455777 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:14:08.455777    6004 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/21c116c2-4862-424a-bedf-41fba3b2612d-istio-podinfo\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:14:08.456043 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:14:08.455796    6004 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2jsk9\" (UniqueName: \"kubernetes.io/projected/21c116c2-4862-424a-bedf-41fba3b2612d-kube-api-access-2jsk9\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:14:08.456043 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:14:08.455812    6004 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/21c116c2-4862-424a-bedf-41fba3b2612d-istio-token\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:14:08.472961 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:14:08.472877    6004 generic.go:356] "Generic (PLEG): container finished" podID="21c116c2-4862-424a-bedf-41fba3b2612d" containerID="725cb39a95b45fe75817d491c245583bfde112f0f50abe5e1dbbafec0143ae50" exitCode=0
Oct 30 21:14:08.472961 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:14:08.472931    6004 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-ef7e2d-openshift-default-6b6dbc765f-sg5h8"
Oct 30 21:14:08.473166 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:14:08.472941    6004 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-ef7e2d-openshift-default-6b6dbc765f-sg5h8" event={"ID":"21c116c2-4862-424a-bedf-41fba3b2612d","Type":"ContainerDied","Data":"725cb39a95b45fe75817d491c245583bfde112f0f50abe5e1dbbafec0143ae50"}
Oct 30 21:14:08.473166 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:14:08.473017    6004 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-ef7e2d-openshift-default-6b6dbc765f-sg5h8" event={"ID":"21c116c2-4862-424a-bedf-41fba3b2612d","Type":"ContainerDied","Data":"c3e5476669f50452706edddfd425113543992cfc400219a5018e33ba7c01f176"}
Oct 30 21:14:08.473166 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:14:08.473087    6004 scope.go:122] "RemoveContainer" containerID="725cb39a95b45fe75817d491c245583bfde112f0f50abe5e1dbbafec0143ae50"
Oct 30 21:14:08.485393 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:14:08.485372    6004 scope.go:122] "RemoveContainer" containerID="725cb39a95b45fe75817d491c245583bfde112f0f50abe5e1dbbafec0143ae50"
Oct 30 21:14:08.485682 ip-10-0-138-85 kubenswrapper[6004]: E1030 21:14:08.485664    6004 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"725cb39a95b45fe75817d491c245583bfde112f0f50abe5e1dbbafec0143ae50\": container with ID starting with 725cb39a95b45fe75817d491c245583bfde112f0f50abe5e1dbbafec0143ae50 not found: ID does not exist" containerID="725cb39a95b45fe75817d491c245583bfde112f0f50abe5e1dbbafec0143ae50"
Oct 30 21:14:08.485735 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:14:08.485690    6004 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"725cb39a95b45fe75817d491c245583bfde112f0f50abe5e1dbbafec0143ae50"} err="failed to get container status \"725cb39a95b45fe75817d491c245583bfde112f0f50abe5e1dbbafec0143ae50\": rpc error: code = NotFound desc = could not find container \"725cb39a95b45fe75817d491c245583bfde112f0f50abe5e1dbbafec0143ae50\": container with ID starting with 725cb39a95b45fe75817d491c245583bfde112f0f50abe5e1dbbafec0143ae50 not found: ID does not exist"
Oct 30 21:14:08.645491 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:14:08.645454    6004 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-ef7e2d-openshift-default-6b6dbc765f-sg5h8"]
Oct 30 21:14:08.650887 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:14:08.650861    6004 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-a-ef7e2d-openshift-default-6b6dbc765f-sg5h8"]
Oct 30 21:14:10.238484 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:14:10.238441    6004 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="21c116c2-4862-424a-bedf-41fba3b2612d" path="/var/lib/kubelet/pods/21c116c2-4862-424a-bedf-41fba3b2612d/volumes"
Oct 30 21:14:10.857718 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:14:10.857686    6004 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w1-4d1110-6868947598-j228b"]
Oct 30 21:14:10.857987 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:14:10.857959    6004 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w1-4d1110-6868947598-j228b" podUID="f2d38836-68af-4498-a047-ae6e99704b53" containerName="maas-api" containerID="cri-o://59ad4b4b4cd461b9d7aee642ed6e07676f3445d8b818c60e9f303d29895ff7a6" gracePeriod=30
Oct 30 21:14:11.334165 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:14:11.329271    6004 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w1-4d1110-6868947598-j228b"
Oct 30 21:14:11.431838 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:14:11.431809    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/f2d38836-68af-4498-a047-ae6e99704b53-kube-api-access-nkw9v\" (UniqueName: \"kubernetes.io/projected/f2d38836-68af-4498-a047-ae6e99704b53-kube-api-access-nkw9v\") pod \"f2d38836-68af-4498-a047-ae6e99704b53\" (UID: \"f2d38836-68af-4498-a047-ae6e99704b53\") "
Oct 30 21:14:11.432045 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:14:11.431991    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/f2d38836-68af-4498-a047-ae6e99704b53-metrics-certs\" (UniqueName: \"kubernetes.io/secret/f2d38836-68af-4498-a047-ae6e99704b53-metrics-certs\") pod \"f2d38836-68af-4498-a047-ae6e99704b53\" (UID: \"f2d38836-68af-4498-a047-ae6e99704b53\") "
Oct 30 21:14:11.432217 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:14:11.432150    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/f2d38836-68af-4498-a047-ae6e99704b53-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f2d38836-68af-4498-a047-ae6e99704b53-maas-api-tls\") pod \"f2d38836-68af-4498-a047-ae6e99704b53\" (UID: \"f2d38836-68af-4498-a047-ae6e99704b53\") "
Oct 30 21:14:11.432280 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:14:11.432220    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/f2d38836-68af-4498-a047-ae6e99704b53-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f2d38836-68af-4498-a047-ae6e99704b53-openshift-service-ca\") pod \"f2d38836-68af-4498-a047-ae6e99704b53\" (UID: \"f2d38836-68af-4498-a047-ae6e99704b53\") "
Oct 30 21:14:11.432863 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:14:11.432668    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f2d38836-68af-4498-a047-ae6e99704b53-openshift-service-ca" pod "f2d38836-68af-4498-a047-ae6e99704b53" (UID: "f2d38836-68af-4498-a047-ae6e99704b53"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:14:11.432863 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:14:11.432812    6004 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f2d38836-68af-4498-a047-ae6e99704b53-openshift-service-ca\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:14:11.434271 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:14:11.434202    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f2d38836-68af-4498-a047-ae6e99704b53-maas-api-tls" pod "f2d38836-68af-4498-a047-ae6e99704b53" (UID: "f2d38836-68af-4498-a047-ae6e99704b53"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:14:11.434533 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:14:11.434506    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f2d38836-68af-4498-a047-ae6e99704b53-kube-api-access-nkw9v" pod "f2d38836-68af-4498-a047-ae6e99704b53" (UID: "f2d38836-68af-4498-a047-ae6e99704b53"). InnerVolumeSpecName "kube-api-access-nkw9v". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:14:11.438146 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:14:11.438120    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f2d38836-68af-4498-a047-ae6e99704b53-metrics-certs" pod "f2d38836-68af-4498-a047-ae6e99704b53" (UID: "f2d38836-68af-4498-a047-ae6e99704b53"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:14:11.516921 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:14:11.516831    6004 generic.go:356] "Generic (PLEG): container finished" podID="f2d38836-68af-4498-a047-ae6e99704b53" containerID="59ad4b4b4cd461b9d7aee642ed6e07676f3445d8b818c60e9f303d29895ff7a6" exitCode=0
Oct 30 21:14:11.516921 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:14:11.516883    6004 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w1-4d1110-6868947598-j228b"
Oct 30 21:14:11.517132 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:14:11.516910    6004 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w1-4d1110-6868947598-j228b" event={"ID":"f2d38836-68af-4498-a047-ae6e99704b53","Type":"ContainerDied","Data":"59ad4b4b4cd461b9d7aee642ed6e07676f3445d8b818c60e9f303d29895ff7a6"}
Oct 30 21:14:11.517132 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:14:11.516967    6004 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w1-4d1110-6868947598-j228b" event={"ID":"f2d38836-68af-4498-a047-ae6e99704b53","Type":"ContainerDied","Data":"991178163a0a315398faaf04773e9631bc0c7e40be43dfaa55b62859b56f4d3d"}
Oct 30 21:14:11.517132 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:14:11.516993    6004 scope.go:122] "RemoveContainer" containerID="59ad4b4b4cd461b9d7aee642ed6e07676f3445d8b818c60e9f303d29895ff7a6"
Oct 30 21:14:11.527605 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:14:11.527585    6004 scope.go:122] "RemoveContainer" containerID="59ad4b4b4cd461b9d7aee642ed6e07676f3445d8b818c60e9f303d29895ff7a6"
Oct 30 21:14:11.527875 ip-10-0-138-85 kubenswrapper[6004]: E1030 21:14:11.527855    6004 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"59ad4b4b4cd461b9d7aee642ed6e07676f3445d8b818c60e9f303d29895ff7a6\": container with ID starting with 59ad4b4b4cd461b9d7aee642ed6e07676f3445d8b818c60e9f303d29895ff7a6 not found: ID does not exist" containerID="59ad4b4b4cd461b9d7aee642ed6e07676f3445d8b818c60e9f303d29895ff7a6"
Oct 30 21:14:11.527942 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:14:11.527887    6004 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"59ad4b4b4cd461b9d7aee642ed6e07676f3445d8b818c60e9f303d29895ff7a6"} err="failed to get container status \"59ad4b4b4cd461b9d7aee642ed6e07676f3445d8b818c60e9f303d29895ff7a6\": rpc error: code = NotFound desc = could not find container \"59ad4b4b4cd461b9d7aee642ed6e07676f3445d8b818c60e9f303d29895ff7a6\": container with ID starting with 59ad4b4b4cd461b9d7aee642ed6e07676f3445d8b818c60e9f303d29895ff7a6 not found: ID does not exist"
Oct 30 21:14:11.533720 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:14:11.533698    6004 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f2d38836-68af-4498-a047-ae6e99704b53-metrics-certs\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:14:11.533720 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:14:11.533721    6004 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f2d38836-68af-4498-a047-ae6e99704b53-maas-api-tls\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:14:11.533838 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:14:11.533732    6004 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nkw9v\" (UniqueName: \"kubernetes.io/projected/f2d38836-68af-4498-a047-ae6e99704b53-kube-api-access-nkw9v\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:14:11.696369 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:14:11.696329    6004 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w1-4d1110-6868947598-j228b"]
Oct 30 21:14:11.700872 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:14:11.700837    6004 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w1-4d1110-6868947598-j228b"]
Oct 30 21:14:12.233442 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:14:12.233410    6004 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="f2d38836-68af-4498-a047-ae6e99704b53" path="/var/lib/kubelet/pods/f2d38836-68af-4498-a047-ae6e99704b53/volumes"
Oct 30 21:14:14.325096 ip-10-0-138-85 kubenswrapper[6004]: E1030 21:14:14.324835    6004 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-zz4wr" containerName="extractor"
Oct 30 21:14:17.916636 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:14:17.915865    6004 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-255f05-7cb4855d94-kqj22"]
Oct 30 21:14:17.916636 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:14:17.916152    6004 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-255f05-7cb4855d94-kqj22" podUID="79165cd4-9579-48e3-99e3-8b6a63c9379c" containerName="maas-api" containerID="cri-o://6d9031099353eb2960873b873cacbf46de0a470818164c5688ad385844fc4e9a" gracePeriod=30
Oct 30 21:14:18.650086 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:14:18.640194    6004 generic.go:356] "Generic (PLEG): container finished" podID="79165cd4-9579-48e3-99e3-8b6a63c9379c" containerID="6d9031099353eb2960873b873cacbf46de0a470818164c5688ad385844fc4e9a" exitCode=0
Oct 30 21:14:18.650086 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:14:18.640451    6004 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-255f05-7cb4855d94-kqj22" event={"ID":"79165cd4-9579-48e3-99e3-8b6a63c9379c","Type":"ContainerDied","Data":"6d9031099353eb2960873b873cacbf46de0a470818164c5688ad385844fc4e9a"}
Oct 30 21:14:18.757328 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:14:18.757301    6004 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-255f05-7cb4855d94-kqj22"
Oct 30 21:14:18.806808 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:14:18.806776    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/79165cd4-9579-48e3-99e3-8b6a63c9379c-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/79165cd4-9579-48e3-99e3-8b6a63c9379c-openshift-service-ca\") pod \"79165cd4-9579-48e3-99e3-8b6a63c9379c\" (UID: \"79165cd4-9579-48e3-99e3-8b6a63c9379c\") "
Oct 30 21:14:18.806962 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:14:18.806839    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/79165cd4-9579-48e3-99e3-8b6a63c9379c-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/79165cd4-9579-48e3-99e3-8b6a63c9379c-maas-api-tls\") pod \"79165cd4-9579-48e3-99e3-8b6a63c9379c\" (UID: \"79165cd4-9579-48e3-99e3-8b6a63c9379c\") "
Oct 30 21:14:18.806962 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:14:18.806918    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/79165cd4-9579-48e3-99e3-8b6a63c9379c-metrics-certs\" (UniqueName: \"kubernetes.io/secret/79165cd4-9579-48e3-99e3-8b6a63c9379c-metrics-certs\") pod \"79165cd4-9579-48e3-99e3-8b6a63c9379c\" (UID: \"79165cd4-9579-48e3-99e3-8b6a63c9379c\") "
Oct 30 21:14:18.807036 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:14:18.806975    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/79165cd4-9579-48e3-99e3-8b6a63c9379c-kube-api-access-4wqc7\" (UniqueName: \"kubernetes.io/projected/79165cd4-9579-48e3-99e3-8b6a63c9379c-kube-api-access-4wqc7\") pod \"79165cd4-9579-48e3-99e3-8b6a63c9379c\" (UID: \"79165cd4-9579-48e3-99e3-8b6a63c9379c\") "
Oct 30 21:14:18.807246 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:14:18.807219    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/79165cd4-9579-48e3-99e3-8b6a63c9379c-openshift-service-ca" pod "79165cd4-9579-48e3-99e3-8b6a63c9379c" (UID: "79165cd4-9579-48e3-99e3-8b6a63c9379c"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:14:18.807531 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:14:18.807510    6004 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/79165cd4-9579-48e3-99e3-8b6a63c9379c-openshift-service-ca\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:14:18.809144 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:14:18.809116    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/79165cd4-9579-48e3-99e3-8b6a63c9379c-metrics-certs" pod "79165cd4-9579-48e3-99e3-8b6a63c9379c" (UID: "79165cd4-9579-48e3-99e3-8b6a63c9379c"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:14:18.809238 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:14:18.809140    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/79165cd4-9579-48e3-99e3-8b6a63c9379c-maas-api-tls" pod "79165cd4-9579-48e3-99e3-8b6a63c9379c" (UID: "79165cd4-9579-48e3-99e3-8b6a63c9379c"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:14:18.809238 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:14:18.809165    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/79165cd4-9579-48e3-99e3-8b6a63c9379c-kube-api-access-4wqc7" pod "79165cd4-9579-48e3-99e3-8b6a63c9379c" (UID: "79165cd4-9579-48e3-99e3-8b6a63c9379c"). InnerVolumeSpecName "kube-api-access-4wqc7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:14:18.908342 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:14:18.908299    6004 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/79165cd4-9579-48e3-99e3-8b6a63c9379c-maas-api-tls\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:14:18.908342 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:14:18.908337    6004 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/79165cd4-9579-48e3-99e3-8b6a63c9379c-metrics-certs\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:14:18.908342 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:14:18.908348    6004 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4wqc7\" (UniqueName: \"kubernetes.io/projected/79165cd4-9579-48e3-99e3-8b6a63c9379c-kube-api-access-4wqc7\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:14:19.651592 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:14:19.651560    6004 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-255f05-7cb4855d94-kqj22"
Oct 30 21:14:19.651592 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:14:19.651568    6004 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-255f05-7cb4855d94-kqj22" event={"ID":"79165cd4-9579-48e3-99e3-8b6a63c9379c","Type":"ContainerDied","Data":"c0a7c77d2c81d0a5841927379427b3adbade6dd67d06bb1f4eb4be564a170368"}
Oct 30 21:14:19.652181 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:14:19.651660    6004 scope.go:122] "RemoveContainer" containerID="6d9031099353eb2960873b873cacbf46de0a470818164c5688ad385844fc4e9a"
Oct 30 21:14:19.820213 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:14:19.820176    6004 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-255f05-7cb4855d94-kqj22"]
Oct 30 21:14:19.823231 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:14:19.823203    6004 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-255f05-7cb4855d94-kqj22"]
Oct 30 21:14:20.233000 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:14:20.232967    6004 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="79165cd4-9579-48e3-99e3-8b6a63c9379c" path="/var/lib/kubelet/pods/79165cd4-9579-48e3-99e3-8b6a63c9379c/volumes"
Oct 30 21:14:33.736494 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:14:33.736417    6004 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w2-d061d0/distinct-2-w2-d061d0-kserve-5c6bb99fbf-b4kqs"]
Oct 30 21:14:33.786270 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:14:33.786235    6004 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w2-d061d0/premium-w2-d061d0-kserve-5c589d8c9f-rt7v4"]
Oct 30 21:14:43.745847 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:14:43.745799    6004 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-b888d0-openshift-default-65d785fbfc-gtmp2"]
Oct 30 21:14:43.746463 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:14:43.746032    6004 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-api-a-b888d0-openshift-default-65d785fbfc-gtmp2" podUID="4812c56a-c9f8-42fb-b68a-b9de077eb943" containerName="istio-proxy" containerID="cri-o://5e57505dd3e4cd98e71a90a685eb40f703ee964c5797fa7e4b8061c75d96586c" gracePeriod=30
Oct 30 21:14:44.291222 ip-10-0-138-85 kubenswrapper[6004]: E1030 21:14:44.291183    6004 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-zz4wr" containerName="extractor"
Oct 30 21:14:48.758067 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:14:48.758002    6004 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-models-e2e-worker-w2-d061d0/distinct-2-w2-d061d0-kserve-5c6bb99fbf-b4kqs" podUID="32264f6c-999b-4bad-bd2e-7664cadc0669" containerName="main" containerID="cri-o://3d051582fdd4e9b6d4833cc86141078f4da888efa97f3523fdc03c039f0c4375" gracePeriod=45
Oct 30 21:14:48.808864 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:14:48.808830    6004 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-models-e2e-worker-w2-d061d0/premium-w2-d061d0-kserve-5c589d8c9f-rt7v4" podUID="769fd172-1d4c-4cd3-8eda-e8d4850c0f67" containerName="main" containerID="cri-o://1d28a880981a536930b6850dc783496d58f4d5e27a527ccd5ae89da8bfcd5a2a" gracePeriod=45
Oct 30 21:14:48.817517 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:14:48.817490    6004 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-d061d0/distinct-2-w2-d061d0-kserve-5c6bb99fbf-b4kqs" podUID="32264f6c-999b-4bad-bd2e-7664cadc0669" containerName="main" probeResult="failure" output="Get \"https://10.132.0.71:8000/ready\": dial tcp 10.132.0.71:8000: connect: connection refused"
Oct 30 21:14:48.919010 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:14:48.918983    6004 generic.go:356] "Generic (PLEG): container finished" podID="4812c56a-c9f8-42fb-b68a-b9de077eb943" containerID="5e57505dd3e4cd98e71a90a685eb40f703ee964c5797fa7e4b8061c75d96586c" exitCode=0
Oct 30 21:14:48.919122 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:14:48.919077    6004 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-b888d0-openshift-default-65d785fbfc-gtmp2" event={"ID":"4812c56a-c9f8-42fb-b68a-b9de077eb943","Type":"ContainerDied","Data":"5e57505dd3e4cd98e71a90a685eb40f703ee964c5797fa7e4b8061c75d96586c"}
Oct 30 21:14:48.920897 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:14:48.920874    6004 generic.go:356] "Generic (PLEG): container finished" podID="32264f6c-999b-4bad-bd2e-7664cadc0669" containerID="3d051582fdd4e9b6d4833cc86141078f4da888efa97f3523fdc03c039f0c4375" exitCode=0
Oct 30 21:14:48.920977 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:14:48.920946    6004 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w2-d061d0/distinct-2-w2-d061d0-kserve-5c6bb99fbf-b4kqs" event={"ID":"32264f6c-999b-4bad-bd2e-7664cadc0669","Type":"ContainerDied","Data":"3d051582fdd4e9b6d4833cc86141078f4da888efa97f3523fdc03c039f0c4375"}
Oct 30 21:14:49.121571 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:14:49.121539    6004 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-769df7846c-r95sw"]
Oct 30 21:14:49.122259 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:14:49.121947    6004 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-r95sw" podUID="230542f2-9ac3-4abe-83af-8f63a2c3c240" containerName="istio-proxy" containerID="cri-o://6869693d566b0b1bef8b7e86fd8681b794cf464dcb83852a4f715215705b15ff" gracePeriod=30
Oct 30 21:14:49.134191 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:14:49.134169    6004 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w2-d061d0/premium-w2-d061d0-kserve-5c589d8c9f-rt7v4"
Oct 30 21:14:49.194247 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:14:49.194212    6004 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w2-d061d0/distinct-2-w2-d061d0-kserve-5c6bb99fbf-b4kqs"
Oct 30 21:14:49.197021 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:14:49.196427    6004 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-b888d0-openshift-default-65d785fbfc-gtmp2"
Oct 30 21:14:49.321704 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:14:49.321632    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/32264f6c-999b-4bad-bd2e-7664cadc0669-home\" (UniqueName: \"kubernetes.io/empty-dir/32264f6c-999b-4bad-bd2e-7664cadc0669-home\") pod \"32264f6c-999b-4bad-bd2e-7664cadc0669\" (UID: \"32264f6c-999b-4bad-bd2e-7664cadc0669\") "
Oct 30 21:14:49.321704 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:14:49.321682    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/769fd172-1d4c-4cd3-8eda-e8d4850c0f67-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/769fd172-1d4c-4cd3-8eda-e8d4850c0f67-model-cache\") pod \"769fd172-1d4c-4cd3-8eda-e8d4850c0f67\" (UID: \"769fd172-1d4c-4cd3-8eda-e8d4850c0f67\") "
Oct 30 21:14:49.321930 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:14:49.321775    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/32264f6c-999b-4bad-bd2e-7664cadc0669-kube-api-access-gsrvb\" (UniqueName: \"kubernetes.io/projected/32264f6c-999b-4bad-bd2e-7664cadc0669-kube-api-access-gsrvb\") pod \"32264f6c-999b-4bad-bd2e-7664cadc0669\" (UID: \"32264f6c-999b-4bad-bd2e-7664cadc0669\") "
Oct 30 21:14:49.321930 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:14:49.321825    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/32264f6c-999b-4bad-bd2e-7664cadc0669-dshm\" (UniqueName: \"kubernetes.io/empty-dir/32264f6c-999b-4bad-bd2e-7664cadc0669-dshm\") pod \"32264f6c-999b-4bad-bd2e-7664cadc0669\" (UID: \"32264f6c-999b-4bad-bd2e-7664cadc0669\") "
Oct 30 21:14:49.321930 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:14:49.321864    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/32264f6c-999b-4bad-bd2e-7664cadc0669-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/32264f6c-999b-4bad-bd2e-7664cadc0669-tmp-dir\") pod \"32264f6c-999b-4bad-bd2e-7664cadc0669\" (UID: \"32264f6c-999b-4bad-bd2e-7664cadc0669\") "
Oct 30 21:14:49.321930 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:14:49.321893    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/32264f6c-999b-4bad-bd2e-7664cadc0669-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/32264f6c-999b-4bad-bd2e-7664cadc0669-model-cache\") pod \"32264f6c-999b-4bad-bd2e-7664cadc0669\" (UID: \"32264f6c-999b-4bad-bd2e-7664cadc0669\") "
Oct 30 21:14:49.321930 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:14:49.321896    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/32264f6c-999b-4bad-bd2e-7664cadc0669-home" pod "32264f6c-999b-4bad-bd2e-7664cadc0669" (UID: "32264f6c-999b-4bad-bd2e-7664cadc0669"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:14:49.322231 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:14:49.321981    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/4812c56a-c9f8-42fb-b68a-b9de077eb943-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4812c56a-c9f8-42fb-b68a-b9de077eb943-istio-envoy\") pod \"4812c56a-c9f8-42fb-b68a-b9de077eb943\" (UID: \"4812c56a-c9f8-42fb-b68a-b9de077eb943\") "
Oct 30 21:14:49.322231 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:14:49.321988    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/769fd172-1d4c-4cd3-8eda-e8d4850c0f67-model-cache" pod "769fd172-1d4c-4cd3-8eda-e8d4850c0f67" (UID: "769fd172-1d4c-4cd3-8eda-e8d4850c0f67"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:14:49.322231 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:14:49.322014    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/4812c56a-c9f8-42fb-b68a-b9de077eb943-kube-api-access-fd9sh\" (UniqueName: \"kubernetes.io/projected/4812c56a-c9f8-42fb-b68a-b9de077eb943-kube-api-access-fd9sh\") pod \"4812c56a-c9f8-42fb-b68a-b9de077eb943\" (UID: \"4812c56a-c9f8-42fb-b68a-b9de077eb943\") "
Oct 30 21:14:49.322231 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:14:49.322045    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/769fd172-1d4c-4cd3-8eda-e8d4850c0f67-tls-certs\" (UniqueName: \"kubernetes.io/secret/769fd172-1d4c-4cd3-8eda-e8d4850c0f67-tls-certs\") pod \"769fd172-1d4c-4cd3-8eda-e8d4850c0f67\" (UID: \"769fd172-1d4c-4cd3-8eda-e8d4850c0f67\") "
Oct 30 21:14:49.322231 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:14:49.322101    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/4812c56a-c9f8-42fb-b68a-b9de077eb943-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4812c56a-c9f8-42fb-b68a-b9de077eb943-credential-socket\") pod \"4812c56a-c9f8-42fb-b68a-b9de077eb943\" (UID: \"4812c56a-c9f8-42fb-b68a-b9de077eb943\") "
Oct 30 21:14:49.322231 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:14:49.322165    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/4812c56a-c9f8-42fb-b68a-b9de077eb943-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4812c56a-c9f8-42fb-b68a-b9de077eb943-istio-podinfo\") pod \"4812c56a-c9f8-42fb-b68a-b9de077eb943\" (UID: \"4812c56a-c9f8-42fb-b68a-b9de077eb943\") "
Oct 30 21:14:49.322231 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:14:49.322201    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/4812c56a-c9f8-42fb-b68a-b9de077eb943-istio-token\" (UniqueName: \"kubernetes.io/projected/4812c56a-c9f8-42fb-b68a-b9de077eb943-istio-token\") pod \"4812c56a-c9f8-42fb-b68a-b9de077eb943\" (UID: \"4812c56a-c9f8-42fb-b68a-b9de077eb943\") "
Oct 30 21:14:49.322231 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:14:49.322226    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/769fd172-1d4c-4cd3-8eda-e8d4850c0f67-home\" (UniqueName: \"kubernetes.io/empty-dir/769fd172-1d4c-4cd3-8eda-e8d4850c0f67-home\") pod \"769fd172-1d4c-4cd3-8eda-e8d4850c0f67\" (UID: \"769fd172-1d4c-4cd3-8eda-e8d4850c0f67\") "
Oct 30 21:14:49.322673 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:14:49.322247    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/32264f6c-999b-4bad-bd2e-7664cadc0669-model-cache" pod "32264f6c-999b-4bad-bd2e-7664cadc0669" (UID: "32264f6c-999b-4bad-bd2e-7664cadc0669"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:14:49.322673 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:14:49.322296    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/4812c56a-c9f8-42fb-b68a-b9de077eb943-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4812c56a-c9f8-42fb-b68a-b9de077eb943-istiod-ca-cert\") pod \"4812c56a-c9f8-42fb-b68a-b9de077eb943\" (UID: \"4812c56a-c9f8-42fb-b68a-b9de077eb943\") "
Oct 30 21:14:49.322673 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:14:49.322326    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/4812c56a-c9f8-42fb-b68a-b9de077eb943-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4812c56a-c9f8-42fb-b68a-b9de077eb943-workload-certs\") pod \"4812c56a-c9f8-42fb-b68a-b9de077eb943\" (UID: \"4812c56a-c9f8-42fb-b68a-b9de077eb943\") "
Oct 30 21:14:49.322673 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:14:49.322368    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/32264f6c-999b-4bad-bd2e-7664cadc0669-tls-certs\" (UniqueName: \"kubernetes.io/secret/32264f6c-999b-4bad-bd2e-7664cadc0669-tls-certs\") pod \"32264f6c-999b-4bad-bd2e-7664cadc0669\" (UID: \"32264f6c-999b-4bad-bd2e-7664cadc0669\") "
Oct 30 21:14:49.322673 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:14:49.322377    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/32264f6c-999b-4bad-bd2e-7664cadc0669-tmp-dir" pod "32264f6c-999b-4bad-bd2e-7664cadc0669" (UID: "32264f6c-999b-4bad-bd2e-7664cadc0669"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:14:49.322673 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:14:49.322406    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/4812c56a-c9f8-42fb-b68a-b9de077eb943-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4812c56a-c9f8-42fb-b68a-b9de077eb943-istio-data\") pod \"4812c56a-c9f8-42fb-b68a-b9de077eb943\" (UID: \"4812c56a-c9f8-42fb-b68a-b9de077eb943\") "
Oct 30 21:14:49.322673 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:14:49.322448    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/4812c56a-c9f8-42fb-b68a-b9de077eb943-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4812c56a-c9f8-42fb-b68a-b9de077eb943-workload-socket\") pod \"4812c56a-c9f8-42fb-b68a-b9de077eb943\" (UID: \"4812c56a-c9f8-42fb-b68a-b9de077eb943\") "
Oct 30 21:14:49.322673 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:14:49.322478    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/769fd172-1d4c-4cd3-8eda-e8d4850c0f67-dshm\" (UniqueName: \"kubernetes.io/empty-dir/769fd172-1d4c-4cd3-8eda-e8d4850c0f67-dshm\") pod \"769fd172-1d4c-4cd3-8eda-e8d4850c0f67\" (UID: \"769fd172-1d4c-4cd3-8eda-e8d4850c0f67\") "
Oct 30 21:14:49.322673 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:14:49.322580    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/769fd172-1d4c-4cd3-8eda-e8d4850c0f67-kube-api-access-b9lk9\" (UniqueName: \"kubernetes.io/projected/769fd172-1d4c-4cd3-8eda-e8d4850c0f67-kube-api-access-b9lk9\") pod \"769fd172-1d4c-4cd3-8eda-e8d4850c0f67\" (UID: \"769fd172-1d4c-4cd3-8eda-e8d4850c0f67\") "
Oct 30 21:14:49.322673 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:14:49.322616    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/769fd172-1d4c-4cd3-8eda-e8d4850c0f67-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/769fd172-1d4c-4cd3-8eda-e8d4850c0f67-tmp-dir\") pod \"769fd172-1d4c-4cd3-8eda-e8d4850c0f67\" (UID: \"769fd172-1d4c-4cd3-8eda-e8d4850c0f67\") "
Oct 30 21:14:49.323214 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:14:49.322750    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4812c56a-c9f8-42fb-b68a-b9de077eb943-credential-socket" pod "4812c56a-c9f8-42fb-b68a-b9de077eb943" (UID: "4812c56a-c9f8-42fb-b68a-b9de077eb943"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:14:49.323412 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:14:49.323378    6004 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/32264f6c-999b-4bad-bd2e-7664cadc0669-home\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:14:49.323412 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:14:49.323406    6004 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/769fd172-1d4c-4cd3-8eda-e8d4850c0f67-model-cache\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:14:49.323611 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:14:49.323421    6004 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/32264f6c-999b-4bad-bd2e-7664cadc0669-tmp-dir\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:14:49.323611 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:14:49.323436    6004 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/32264f6c-999b-4bad-bd2e-7664cadc0669-model-cache\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:14:49.323611 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:14:49.323450    6004 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4812c56a-c9f8-42fb-b68a-b9de077eb943-credential-socket\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:14:49.324121 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:14:49.324019    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4812c56a-c9f8-42fb-b68a-b9de077eb943-istio-data" pod "4812c56a-c9f8-42fb-b68a-b9de077eb943" (UID: "4812c56a-c9f8-42fb-b68a-b9de077eb943"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:14:49.324354 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:14:49.324325    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4812c56a-c9f8-42fb-b68a-b9de077eb943-workload-socket" pod "4812c56a-c9f8-42fb-b68a-b9de077eb943" (UID: "4812c56a-c9f8-42fb-b68a-b9de077eb943"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:14:49.324699 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:14:49.324680    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4812c56a-c9f8-42fb-b68a-b9de077eb943-istio-envoy" pod "4812c56a-c9f8-42fb-b68a-b9de077eb943" (UID: "4812c56a-c9f8-42fb-b68a-b9de077eb943"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:14:49.324848 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:14:49.324820    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/4812c56a-c9f8-42fb-b68a-b9de077eb943-istio-podinfo" pod "4812c56a-c9f8-42fb-b68a-b9de077eb943" (UID: "4812c56a-c9f8-42fb-b68a-b9de077eb943"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 21:14:49.324961 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:14:49.324881    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/769fd172-1d4c-4cd3-8eda-e8d4850c0f67-home" pod "769fd172-1d4c-4cd3-8eda-e8d4850c0f67" (UID: "769fd172-1d4c-4cd3-8eda-e8d4850c0f67"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:14:49.325041 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:14:49.325017    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/32264f6c-999b-4bad-bd2e-7664cadc0669-kube-api-access-gsrvb" pod "32264f6c-999b-4bad-bd2e-7664cadc0669" (UID: "32264f6c-999b-4bad-bd2e-7664cadc0669"). InnerVolumeSpecName "kube-api-access-gsrvb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:14:49.325136 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:14:49.325023    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/769fd172-1d4c-4cd3-8eda-e8d4850c0f67-tmp-dir" pod "769fd172-1d4c-4cd3-8eda-e8d4850c0f67" (UID: "769fd172-1d4c-4cd3-8eda-e8d4850c0f67"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:14:49.325261 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:14:49.325212    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/769fd172-1d4c-4cd3-8eda-e8d4850c0f67-tls-certs" pod "769fd172-1d4c-4cd3-8eda-e8d4850c0f67" (UID: "769fd172-1d4c-4cd3-8eda-e8d4850c0f67"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:14:49.325424 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:14:49.325405    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4812c56a-c9f8-42fb-b68a-b9de077eb943-workload-certs" pod "4812c56a-c9f8-42fb-b68a-b9de077eb943" (UID: "4812c56a-c9f8-42fb-b68a-b9de077eb943"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:14:49.325518 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:14:49.325482    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4812c56a-c9f8-42fb-b68a-b9de077eb943-istiod-ca-cert" pod "4812c56a-c9f8-42fb-b68a-b9de077eb943" (UID: "4812c56a-c9f8-42fb-b68a-b9de077eb943"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:14:49.325814 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:14:49.325790    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/32264f6c-999b-4bad-bd2e-7664cadc0669-tls-certs" pod "32264f6c-999b-4bad-bd2e-7664cadc0669" (UID: "32264f6c-999b-4bad-bd2e-7664cadc0669"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:14:49.326259 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:14:49.326229    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/32264f6c-999b-4bad-bd2e-7664cadc0669-dshm" pod "32264f6c-999b-4bad-bd2e-7664cadc0669" (UID: "32264f6c-999b-4bad-bd2e-7664cadc0669"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:14:49.326398 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:14:49.326377    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/769fd172-1d4c-4cd3-8eda-e8d4850c0f67-dshm" pod "769fd172-1d4c-4cd3-8eda-e8d4850c0f67" (UID: "769fd172-1d4c-4cd3-8eda-e8d4850c0f67"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:14:49.326699 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:14:49.326677    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4812c56a-c9f8-42fb-b68a-b9de077eb943-kube-api-access-fd9sh" pod "4812c56a-c9f8-42fb-b68a-b9de077eb943" (UID: "4812c56a-c9f8-42fb-b68a-b9de077eb943"). InnerVolumeSpecName "kube-api-access-fd9sh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:14:49.327015 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:14:49.327000    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/769fd172-1d4c-4cd3-8eda-e8d4850c0f67-kube-api-access-b9lk9" pod "769fd172-1d4c-4cd3-8eda-e8d4850c0f67" (UID: "769fd172-1d4c-4cd3-8eda-e8d4850c0f67"). InnerVolumeSpecName "kube-api-access-b9lk9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:14:49.327336 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:14:49.327315    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4812c56a-c9f8-42fb-b68a-b9de077eb943-istio-token" pod "4812c56a-c9f8-42fb-b68a-b9de077eb943" (UID: "4812c56a-c9f8-42fb-b68a-b9de077eb943"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:14:49.425304 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:14:49.425264    6004 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4812c56a-c9f8-42fb-b68a-b9de077eb943-workload-certs\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:14:49.425304 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:14:49.425305    6004 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/32264f6c-999b-4bad-bd2e-7664cadc0669-tls-certs\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:14:49.425548 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:14:49.425319    6004 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4812c56a-c9f8-42fb-b68a-b9de077eb943-istio-data\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:14:49.425548 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:14:49.425335    6004 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4812c56a-c9f8-42fb-b68a-b9de077eb943-workload-socket\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:14:49.425548 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:14:49.425348    6004 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/769fd172-1d4c-4cd3-8eda-e8d4850c0f67-dshm\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:14:49.425548 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:14:49.425361    6004 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b9lk9\" (UniqueName: \"kubernetes.io/projected/769fd172-1d4c-4cd3-8eda-e8d4850c0f67-kube-api-access-b9lk9\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:14:49.425548 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:14:49.425376    6004 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/769fd172-1d4c-4cd3-8eda-e8d4850c0f67-tmp-dir\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:14:49.425548 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:14:49.425390    6004 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gsrvb\" (UniqueName: \"kubernetes.io/projected/32264f6c-999b-4bad-bd2e-7664cadc0669-kube-api-access-gsrvb\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:14:49.425548 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:14:49.425403    6004 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/32264f6c-999b-4bad-bd2e-7664cadc0669-dshm\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:14:49.425548 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:14:49.425416    6004 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4812c56a-c9f8-42fb-b68a-b9de077eb943-istio-envoy\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:14:49.425548 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:14:49.425429    6004 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fd9sh\" (UniqueName: \"kubernetes.io/projected/4812c56a-c9f8-42fb-b68a-b9de077eb943-kube-api-access-fd9sh\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:14:49.425548 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:14:49.425445    6004 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/769fd172-1d4c-4cd3-8eda-e8d4850c0f67-tls-certs\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:14:49.425548 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:14:49.425459    6004 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4812c56a-c9f8-42fb-b68a-b9de077eb943-istio-podinfo\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:14:49.425548 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:14:49.425472    6004 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4812c56a-c9f8-42fb-b68a-b9de077eb943-istio-token\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:14:49.425548 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:14:49.425486    6004 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/769fd172-1d4c-4cd3-8eda-e8d4850c0f67-home\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:14:49.425548 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:14:49.425499    6004 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4812c56a-c9f8-42fb-b68a-b9de077eb943-istiod-ca-cert\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:14:49.930446 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:14:49.930411    6004 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w2-d061d0/distinct-2-w2-d061d0-kserve-5c6bb99fbf-b4kqs"
Oct 30 21:14:49.930446 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:14:49.930435    6004 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w2-d061d0/distinct-2-w2-d061d0-kserve-5c6bb99fbf-b4kqs" event={"ID":"32264f6c-999b-4bad-bd2e-7664cadc0669","Type":"ContainerDied","Data":"35105c9951f4a64d017a190918428478611c8ccbbecd221d498bb3d15e81c285"}
Oct 30 21:14:49.930937 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:14:49.930491    6004 scope.go:122] "RemoveContainer" containerID="3d051582fdd4e9b6d4833cc86141078f4da888efa97f3523fdc03c039f0c4375"
Oct 30 21:14:49.931841 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:14:49.931820    6004 generic.go:356] "Generic (PLEG): container finished" podID="769fd172-1d4c-4cd3-8eda-e8d4850c0f67" containerID="1d28a880981a536930b6850dc783496d58f4d5e27a527ccd5ae89da8bfcd5a2a" exitCode=0
Oct 30 21:14:49.931990 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:14:49.931975    6004 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w2-d061d0/premium-w2-d061d0-kserve-5c589d8c9f-rt7v4" event={"ID":"769fd172-1d4c-4cd3-8eda-e8d4850c0f67","Type":"ContainerDied","Data":"1d28a880981a536930b6850dc783496d58f4d5e27a527ccd5ae89da8bfcd5a2a"}
Oct 30 21:14:49.932075 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:14:49.932004    6004 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w2-d061d0/premium-w2-d061d0-kserve-5c589d8c9f-rt7v4" event={"ID":"769fd172-1d4c-4cd3-8eda-e8d4850c0f67","Type":"ContainerDied","Data":"02e526181ecaadb012efd0c66434032ffea31ea1fcd0a17e748d268db5512a12"}
Oct 30 21:14:49.932132 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:14:49.932113    6004 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w2-d061d0/premium-w2-d061d0-kserve-5c589d8c9f-rt7v4"
Oct 30 21:14:49.933877 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:14:49.933842    6004 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-b888d0-openshift-default-65d785fbfc-gtmp2" event={"ID":"4812c56a-c9f8-42fb-b68a-b9de077eb943","Type":"ContainerDied","Data":"2fa0208faefb02dbe0a3e57d235d5debcd34e7fa78f45a2c87c9f35b9e57e308"}
Oct 30 21:14:49.933998 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:14:49.933922    6004 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-b888d0-openshift-default-65d785fbfc-gtmp2"
Oct 30 21:14:49.948115 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:14:49.943444    6004 scope.go:122] "RemoveContainer" containerID="1d28a880981a536930b6850dc783496d58f4d5e27a527ccd5ae89da8bfcd5a2a"
Oct 30 21:14:49.954357 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:14:49.954336    6004 scope.go:122] "RemoveContainer" containerID="1d28a880981a536930b6850dc783496d58f4d5e27a527ccd5ae89da8bfcd5a2a"
Oct 30 21:14:49.954641 ip-10-0-138-85 kubenswrapper[6004]: E1030 21:14:49.954613    6004 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1d28a880981a536930b6850dc783496d58f4d5e27a527ccd5ae89da8bfcd5a2a\": container with ID starting with 1d28a880981a536930b6850dc783496d58f4d5e27a527ccd5ae89da8bfcd5a2a not found: ID does not exist" containerID="1d28a880981a536930b6850dc783496d58f4d5e27a527ccd5ae89da8bfcd5a2a"
Oct 30 21:14:49.954745 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:14:49.954653    6004 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1d28a880981a536930b6850dc783496d58f4d5e27a527ccd5ae89da8bfcd5a2a"} err="failed to get container status \"1d28a880981a536930b6850dc783496d58f4d5e27a527ccd5ae89da8bfcd5a2a\": rpc error: code = NotFound desc = could not find container \"1d28a880981a536930b6850dc783496d58f4d5e27a527ccd5ae89da8bfcd5a2a\": container with ID starting with 1d28a880981a536930b6850dc783496d58f4d5e27a527ccd5ae89da8bfcd5a2a not found: ID does not exist"
Oct 30 21:14:49.954745 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:14:49.954680    6004 scope.go:122] "RemoveContainer" containerID="5e57505dd3e4cd98e71a90a685eb40f703ee964c5797fa7e4b8061c75d96586c"
Oct 30 21:14:50.098164 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:14:50.098075    6004 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w2-d061d0/premium-w2-d061d0-kserve-5c589d8c9f-rt7v4"]
Oct 30 21:14:50.103244 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:14:50.103217    6004 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w2-d061d0/premium-w2-d061d0-kserve-5c589d8c9f-rt7v4"]
Oct 30 21:14:50.137756 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:14:50.137720    6004 patch_prober.go:29] interesting pod/e2e-api-a-b888d0-openshift-default-65d785fbfc-gtmp2 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.101:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 30 21:14:50.137893 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:14:50.137784    6004 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-a-b888d0-openshift-default-65d785fbfc-gtmp2" podUID="4812c56a-c9f8-42fb-b68a-b9de077eb943" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.101:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:14:50.213595 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:14:50.213563    6004 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w2-d061d0/distinct-2-w2-d061d0-kserve-5c6bb99fbf-b4kqs"]
Oct 30 21:14:50.216871 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:14:50.216836    6004 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w2-d061d0/distinct-2-w2-d061d0-kserve-5c6bb99fbf-b4kqs"]
Oct 30 21:14:50.232355 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:14:50.232329    6004 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="32264f6c-999b-4bad-bd2e-7664cadc0669" path="/var/lib/kubelet/pods/32264f6c-999b-4bad-bd2e-7664cadc0669/volumes"
Oct 30 21:14:50.232797 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:14:50.232784    6004 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="769fd172-1d4c-4cd3-8eda-e8d4850c0f67" path="/var/lib/kubelet/pods/769fd172-1d4c-4cd3-8eda-e8d4850c0f67/volumes"
Oct 30 21:14:50.327862 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:14:50.327830    6004 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-b888d0-openshift-default-65d785fbfc-gtmp2"]
Oct 30 21:14:50.331803 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:14:50.331779    6004 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-a-b888d0-openshift-default-65d785fbfc-gtmp2"]
Oct 30 21:14:52.241559 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:14:52.241384    6004 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="4812c56a-c9f8-42fb-b68a-b9de077eb943" path="/var/lib/kubelet/pods/4812c56a-c9f8-42fb-b68a-b9de077eb943/volumes"
Oct 30 21:14:54.167087 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:14:54.167045    6004 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-769df7846c-r95sw container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.91:15021/healthz/ready\": dial tcp 10.132.0.91:15021: connect: connection refused" start-of-body=
Oct 30 21:14:54.167432 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:14:54.167115    6004 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-r95sw" podUID="230542f2-9ac3-4abe-83af-8f63a2c3c240" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.91:15021/healthz/ready\": dial tcp 10.132.0.91:15021: connect: connection refused"
Oct 30 21:14:54.393564 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:14:54.393506    6004 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-r95sw"
Oct 30 21:14:54.406743 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:14:54.406720    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/230542f2-9ac3-4abe-83af-8f63a2c3c240-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/230542f2-9ac3-4abe-83af-8f63a2c3c240-istio-data\") pod \"230542f2-9ac3-4abe-83af-8f63a2c3c240\" (UID: \"230542f2-9ac3-4abe-83af-8f63a2c3c240\") "
Oct 30 21:14:54.406879 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:14:54.406751    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/230542f2-9ac3-4abe-83af-8f63a2c3c240-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/230542f2-9ac3-4abe-83af-8f63a2c3c240-istio-envoy\") pod \"230542f2-9ac3-4abe-83af-8f63a2c3c240\" (UID: \"230542f2-9ac3-4abe-83af-8f63a2c3c240\") "
Oct 30 21:14:54.406879 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:14:54.406776    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/230542f2-9ac3-4abe-83af-8f63a2c3c240-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/230542f2-9ac3-4abe-83af-8f63a2c3c240-istiod-ca-cert\") pod \"230542f2-9ac3-4abe-83af-8f63a2c3c240\" (UID: \"230542f2-9ac3-4abe-83af-8f63a2c3c240\") "
Oct 30 21:14:54.406879 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:14:54.406808    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/230542f2-9ac3-4abe-83af-8f63a2c3c240-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/230542f2-9ac3-4abe-83af-8f63a2c3c240-istio-podinfo\") pod \"230542f2-9ac3-4abe-83af-8f63a2c3c240\" (UID: \"230542f2-9ac3-4abe-83af-8f63a2c3c240\") "
Oct 30 21:14:54.406879 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:14:54.406851    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/230542f2-9ac3-4abe-83af-8f63a2c3c240-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/230542f2-9ac3-4abe-83af-8f63a2c3c240-credential-socket\") pod \"230542f2-9ac3-4abe-83af-8f63a2c3c240\" (UID: \"230542f2-9ac3-4abe-83af-8f63a2c3c240\") "
Oct 30 21:14:54.407114 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:14:54.406945    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/230542f2-9ac3-4abe-83af-8f63a2c3c240-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/230542f2-9ac3-4abe-83af-8f63a2c3c240-workload-socket\") pod \"230542f2-9ac3-4abe-83af-8f63a2c3c240\" (UID: \"230542f2-9ac3-4abe-83af-8f63a2c3c240\") "
Oct 30 21:14:54.407114 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:14:54.406980    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/230542f2-9ac3-4abe-83af-8f63a2c3c240-istio-data" pod "230542f2-9ac3-4abe-83af-8f63a2c3c240" (UID: "230542f2-9ac3-4abe-83af-8f63a2c3c240"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:14:54.407114 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:14:54.407020    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/230542f2-9ac3-4abe-83af-8f63a2c3c240-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/230542f2-9ac3-4abe-83af-8f63a2c3c240-workload-certs\") pod \"230542f2-9ac3-4abe-83af-8f63a2c3c240\" (UID: \"230542f2-9ac3-4abe-83af-8f63a2c3c240\") "
Oct 30 21:14:54.407114 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:14:54.407063    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/230542f2-9ac3-4abe-83af-8f63a2c3c240-istio-token\" (UniqueName: \"kubernetes.io/projected/230542f2-9ac3-4abe-83af-8f63a2c3c240-istio-token\") pod \"230542f2-9ac3-4abe-83af-8f63a2c3c240\" (UID: \"230542f2-9ac3-4abe-83af-8f63a2c3c240\") "
Oct 30 21:14:54.407114 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:14:54.407109    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/230542f2-9ac3-4abe-83af-8f63a2c3c240-kube-api-access-tst9n\" (UniqueName: \"kubernetes.io/projected/230542f2-9ac3-4abe-83af-8f63a2c3c240-kube-api-access-tst9n\") pod \"230542f2-9ac3-4abe-83af-8f63a2c3c240\" (UID: \"230542f2-9ac3-4abe-83af-8f63a2c3c240\") "
Oct 30 21:14:54.407374 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:14:54.407214    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/230542f2-9ac3-4abe-83af-8f63a2c3c240-credential-socket" pod "230542f2-9ac3-4abe-83af-8f63a2c3c240" (UID: "230542f2-9ac3-4abe-83af-8f63a2c3c240"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:14:54.407374 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:14:54.407252    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/230542f2-9ac3-4abe-83af-8f63a2c3c240-workload-socket" pod "230542f2-9ac3-4abe-83af-8f63a2c3c240" (UID: "230542f2-9ac3-4abe-83af-8f63a2c3c240"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:14:54.407374 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:14:54.407276    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/230542f2-9ac3-4abe-83af-8f63a2c3c240-workload-certs" pod "230542f2-9ac3-4abe-83af-8f63a2c3c240" (UID: "230542f2-9ac3-4abe-83af-8f63a2c3c240"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:14:54.407374 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:14:54.407241    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/230542f2-9ac3-4abe-83af-8f63a2c3c240-istiod-ca-cert" pod "230542f2-9ac3-4abe-83af-8f63a2c3c240" (UID: "230542f2-9ac3-4abe-83af-8f63a2c3c240"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:14:54.407727 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:14:54.407701    6004 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/230542f2-9ac3-4abe-83af-8f63a2c3c240-workload-socket\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:14:54.407865 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:14:54.407729    6004 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/230542f2-9ac3-4abe-83af-8f63a2c3c240-workload-certs\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:14:54.407865 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:14:54.407745    6004 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/230542f2-9ac3-4abe-83af-8f63a2c3c240-istio-data\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:14:54.407865 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:14:54.407758    6004 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/230542f2-9ac3-4abe-83af-8f63a2c3c240-istiod-ca-cert\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:14:54.407865 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:14:54.407771    6004 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/230542f2-9ac3-4abe-83af-8f63a2c3c240-credential-socket\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:14:54.409222 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:14:54.409197    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/230542f2-9ac3-4abe-83af-8f63a2c3c240-istio-podinfo" pod "230542f2-9ac3-4abe-83af-8f63a2c3c240" (UID: "230542f2-9ac3-4abe-83af-8f63a2c3c240"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 21:14:54.409342 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:14:54.409222    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/230542f2-9ac3-4abe-83af-8f63a2c3c240-istio-envoy" pod "230542f2-9ac3-4abe-83af-8f63a2c3c240" (UID: "230542f2-9ac3-4abe-83af-8f63a2c3c240"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:14:54.409560 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:14:54.409535    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/230542f2-9ac3-4abe-83af-8f63a2c3c240-kube-api-access-tst9n" pod "230542f2-9ac3-4abe-83af-8f63a2c3c240" (UID: "230542f2-9ac3-4abe-83af-8f63a2c3c240"). InnerVolumeSpecName "kube-api-access-tst9n". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:14:54.409663 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:14:54.409561    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/230542f2-9ac3-4abe-83af-8f63a2c3c240-istio-token" pod "230542f2-9ac3-4abe-83af-8f63a2c3c240" (UID: "230542f2-9ac3-4abe-83af-8f63a2c3c240"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:14:54.508697 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:14:54.508667    6004 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/230542f2-9ac3-4abe-83af-8f63a2c3c240-istio-podinfo\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:14:54.508697 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:14:54.508693    6004 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/230542f2-9ac3-4abe-83af-8f63a2c3c240-istio-token\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:14:54.508697 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:14:54.508703    6004 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tst9n\" (UniqueName: \"kubernetes.io/projected/230542f2-9ac3-4abe-83af-8f63a2c3c240-kube-api-access-tst9n\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:14:54.508918 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:14:54.508714    6004 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/230542f2-9ac3-4abe-83af-8f63a2c3c240-istio-envoy\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:14:54.972236 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:14:54.972202    6004 generic.go:356] "Generic (PLEG): container finished" podID="230542f2-9ac3-4abe-83af-8f63a2c3c240" containerID="6869693d566b0b1bef8b7e86fd8681b794cf464dcb83852a4f715215705b15ff" exitCode=0
Oct 30 21:14:54.972396 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:14:54.972247    6004 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-r95sw"
Oct 30 21:14:54.972396 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:14:54.972284    6004 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-r95sw" event={"ID":"230542f2-9ac3-4abe-83af-8f63a2c3c240","Type":"ContainerDied","Data":"6869693d566b0b1bef8b7e86fd8681b794cf464dcb83852a4f715215705b15ff"}
Oct 30 21:14:54.972396 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:14:54.972342    6004 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-r95sw" event={"ID":"230542f2-9ac3-4abe-83af-8f63a2c3c240","Type":"ContainerDied","Data":"8804f87efee45c051ef310c9f9f8f7a7db904b4d4d5bf498a6eded8068f62413"}
Oct 30 21:14:54.972396 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:14:54.972368    6004 scope.go:122] "RemoveContainer" containerID="6869693d566b0b1bef8b7e86fd8681b794cf464dcb83852a4f715215705b15ff"
Oct 30 21:14:54.983598 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:14:54.983577    6004 scope.go:122] "RemoveContainer" containerID="6869693d566b0b1bef8b7e86fd8681b794cf464dcb83852a4f715215705b15ff"
Oct 30 21:14:54.983861 ip-10-0-138-85 kubenswrapper[6004]: E1030 21:14:54.983843    6004 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6869693d566b0b1bef8b7e86fd8681b794cf464dcb83852a4f715215705b15ff\": container with ID starting with 6869693d566b0b1bef8b7e86fd8681b794cf464dcb83852a4f715215705b15ff not found: ID does not exist" containerID="6869693d566b0b1bef8b7e86fd8681b794cf464dcb83852a4f715215705b15ff"
Oct 30 21:14:54.983924 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:14:54.983873    6004 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6869693d566b0b1bef8b7e86fd8681b794cf464dcb83852a4f715215705b15ff"} err="failed to get container status \"6869693d566b0b1bef8b7e86fd8681b794cf464dcb83852a4f715215705b15ff\": rpc error: code = NotFound desc = could not find container \"6869693d566b0b1bef8b7e86fd8681b794cf464dcb83852a4f715215705b15ff\": container with ID starting with 6869693d566b0b1bef8b7e86fd8681b794cf464dcb83852a4f715215705b15ff not found: ID does not exist"
Oct 30 21:14:55.155003 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:14:55.154962    6004 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-769df7846c-r95sw"]
Oct 30 21:14:55.205763 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:14:55.205735    6004 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-769df7846c-r95sw"]
Oct 30 21:14:56.233517 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:14:56.233484    6004 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="230542f2-9ac3-4abe-83af-8f63a2c3c240" path="/var/lib/kubelet/pods/230542f2-9ac3-4abe-83af-8f63a2c3c240/volumes"
Oct 30 21:15:08.847678 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:15:08.847613    6004 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w2-d061d0-openshift-default-86b87f495-w45rb"]
Oct 30 21:15:08.848541 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:15:08.848270    6004 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w2-d061d0-openshift-default-86b87f495-w45rb" podUID="9ad52be5-bae9-4663-a915-2d4374812459" containerName="istio-proxy" containerID="cri-o://0eb22303d9ff4545629ae98cec5e23bc7622a9c12d6b79abd21d2b7a25d1ca9f" gracePeriod=30
Oct 30 21:15:11.488341 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:15:11.488302    6004 patch_prober.go:29] interesting pod/e2e-worker-w2-d061d0-openshift-default-86b87f495-w45rb container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Oct 30 21:15:11.488737 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:15:11.488401    6004 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w2-d061d0-openshift-default-86b87f495-w45rb" podUID="9ad52be5-bae9-4663-a915-2d4374812459" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 30 21:15:14.133249 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:15:14.133181    6004 generic.go:356] "Generic (PLEG): container finished" podID="9ad52be5-bae9-4663-a915-2d4374812459" containerID="0eb22303d9ff4545629ae98cec5e23bc7622a9c12d6b79abd21d2b7a25d1ca9f" exitCode=0
Oct 30 21:15:14.133249 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:15:14.133239    6004 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-d061d0-openshift-default-86b87f495-w45rb" event={"ID":"9ad52be5-bae9-4663-a915-2d4374812459","Type":"ContainerDied","Data":"0eb22303d9ff4545629ae98cec5e23bc7622a9c12d6b79abd21d2b7a25d1ca9f"}
Oct 30 21:15:14.133635 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:15:14.133260    6004 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-d061d0-openshift-default-86b87f495-w45rb"
Oct 30 21:15:14.133635 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:15:14.133278    6004 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-d061d0-openshift-default-86b87f495-w45rb" event={"ID":"9ad52be5-bae9-4663-a915-2d4374812459","Type":"ContainerDied","Data":"3b2e9f22548d5f70e86314f5ff152924c97ec75969de1d1b76e8d97b2d4eb9a0"}
Oct 30 21:15:14.133635 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:15:14.133295    6004 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3b2e9f22548d5f70e86314f5ff152924c97ec75969de1d1b76e8d97b2d4eb9a0"
Oct 30 21:15:14.273722 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:15:14.273681    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/9ad52be5-bae9-4663-a915-2d4374812459-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9ad52be5-bae9-4663-a915-2d4374812459-istio-data\") pod \"9ad52be5-bae9-4663-a915-2d4374812459\" (UID: \"9ad52be5-bae9-4663-a915-2d4374812459\") "
Oct 30 21:15:14.273919 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:15:14.273832    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/9ad52be5-bae9-4663-a915-2d4374812459-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9ad52be5-bae9-4663-a915-2d4374812459-istiod-ca-cert\") pod \"9ad52be5-bae9-4663-a915-2d4374812459\" (UID: \"9ad52be5-bae9-4663-a915-2d4374812459\") "
Oct 30 21:15:14.273919 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:15:14.273875    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/9ad52be5-bae9-4663-a915-2d4374812459-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9ad52be5-bae9-4663-a915-2d4374812459-istio-envoy\") pod \"9ad52be5-bae9-4663-a915-2d4374812459\" (UID: \"9ad52be5-bae9-4663-a915-2d4374812459\") "
Oct 30 21:15:14.274035 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:15:14.273939    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/9ad52be5-bae9-4663-a915-2d4374812459-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9ad52be5-bae9-4663-a915-2d4374812459-workload-certs\") pod \"9ad52be5-bae9-4663-a915-2d4374812459\" (UID: \"9ad52be5-bae9-4663-a915-2d4374812459\") "
Oct 30 21:15:14.274035 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:15:14.273959    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9ad52be5-bae9-4663-a915-2d4374812459-istio-data" pod "9ad52be5-bae9-4663-a915-2d4374812459" (UID: "9ad52be5-bae9-4663-a915-2d4374812459"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:15:14.274035 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:15:14.274006    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/9ad52be5-bae9-4663-a915-2d4374812459-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9ad52be5-bae9-4663-a915-2d4374812459-workload-socket\") pod \"9ad52be5-bae9-4663-a915-2d4374812459\" (UID: \"9ad52be5-bae9-4663-a915-2d4374812459\") "
Oct 30 21:15:14.274223 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:15:14.274082    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/9ad52be5-bae9-4663-a915-2d4374812459-kube-api-access-rds2n\" (UniqueName: \"kubernetes.io/projected/9ad52be5-bae9-4663-a915-2d4374812459-kube-api-access-rds2n\") pod \"9ad52be5-bae9-4663-a915-2d4374812459\" (UID: \"9ad52be5-bae9-4663-a915-2d4374812459\") "
Oct 30 21:15:14.274223 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:15:14.274119    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/9ad52be5-bae9-4663-a915-2d4374812459-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9ad52be5-bae9-4663-a915-2d4374812459-istio-podinfo\") pod \"9ad52be5-bae9-4663-a915-2d4374812459\" (UID: \"9ad52be5-bae9-4663-a915-2d4374812459\") "
Oct 30 21:15:14.274223 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:15:14.274159    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/9ad52be5-bae9-4663-a915-2d4374812459-istio-token\" (UniqueName: \"kubernetes.io/projected/9ad52be5-bae9-4663-a915-2d4374812459-istio-token\") pod \"9ad52be5-bae9-4663-a915-2d4374812459\" (UID: \"9ad52be5-bae9-4663-a915-2d4374812459\") "
Oct 30 21:15:14.274223 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:15:14.274210    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/9ad52be5-bae9-4663-a915-2d4374812459-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9ad52be5-bae9-4663-a915-2d4374812459-credential-socket\") pod \"9ad52be5-bae9-4663-a915-2d4374812459\" (UID: \"9ad52be5-bae9-4663-a915-2d4374812459\") "
Oct 30 21:15:14.274446 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:15:14.274335    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9ad52be5-bae9-4663-a915-2d4374812459-workload-certs" pod "9ad52be5-bae9-4663-a915-2d4374812459" (UID: "9ad52be5-bae9-4663-a915-2d4374812459"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:15:14.274446 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:15:14.274342    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9ad52be5-bae9-4663-a915-2d4374812459-istiod-ca-cert" pod "9ad52be5-bae9-4663-a915-2d4374812459" (UID: "9ad52be5-bae9-4663-a915-2d4374812459"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:15:14.274854 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:15:14.274629    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9ad52be5-bae9-4663-a915-2d4374812459-credential-socket" pod "9ad52be5-bae9-4663-a915-2d4374812459" (UID: "9ad52be5-bae9-4663-a915-2d4374812459"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:15:14.274854 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:15:14.274788    6004 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9ad52be5-bae9-4663-a915-2d4374812459-istiod-ca-cert\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:15:14.274854 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:15:14.274805    6004 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9ad52be5-bae9-4663-a915-2d4374812459-workload-certs\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:15:14.274854 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:15:14.274819    6004 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9ad52be5-bae9-4663-a915-2d4374812459-credential-socket\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:15:14.274854 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:15:14.274832    6004 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9ad52be5-bae9-4663-a915-2d4374812459-istio-data\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:15:14.275215 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:15:14.274979    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9ad52be5-bae9-4663-a915-2d4374812459-workload-socket" pod "9ad52be5-bae9-4663-a915-2d4374812459" (UID: "9ad52be5-bae9-4663-a915-2d4374812459"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:15:14.276887 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:15:14.276861    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9ad52be5-bae9-4663-a915-2d4374812459-kube-api-access-rds2n" pod "9ad52be5-bae9-4663-a915-2d4374812459" (UID: "9ad52be5-bae9-4663-a915-2d4374812459"). InnerVolumeSpecName "kube-api-access-rds2n". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:15:14.277207 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:15:14.277187    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/9ad52be5-bae9-4663-a915-2d4374812459-istio-podinfo" pod "9ad52be5-bae9-4663-a915-2d4374812459" (UID: "9ad52be5-bae9-4663-a915-2d4374812459"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 21:15:14.277401 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:15:14.277379    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9ad52be5-bae9-4663-a915-2d4374812459-istio-token" pod "9ad52be5-bae9-4663-a915-2d4374812459" (UID: "9ad52be5-bae9-4663-a915-2d4374812459"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:15:14.278525 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:15:14.278498    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9ad52be5-bae9-4663-a915-2d4374812459-istio-envoy" pod "9ad52be5-bae9-4663-a915-2d4374812459" (UID: "9ad52be5-bae9-4663-a915-2d4374812459"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:15:14.293454 ip-10-0-138-85 kubenswrapper[6004]: E1030 21:15:14.293417    6004 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-zz4wr" containerName="extractor"
Oct 30 21:15:14.375877 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:15:14.375844    6004 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9ad52be5-bae9-4663-a915-2d4374812459-istio-envoy\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:15:14.375877 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:15:14.375874    6004 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9ad52be5-bae9-4663-a915-2d4374812459-workload-socket\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:15:14.375877 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:15:14.375884    6004 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rds2n\" (UniqueName: \"kubernetes.io/projected/9ad52be5-bae9-4663-a915-2d4374812459-kube-api-access-rds2n\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:15:14.376174 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:15:14.375895    6004 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9ad52be5-bae9-4663-a915-2d4374812459-istio-podinfo\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:15:14.376174 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:15:14.375908    6004 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9ad52be5-bae9-4663-a915-2d4374812459-istio-token\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:15:14.724490 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:15:14.724457    6004 scope.go:122] "RemoveContainer" containerID="0eb22303d9ff4545629ae98cec5e23bc7622a9c12d6b79abd21d2b7a25d1ca9f"
Oct 30 21:15:15.140758 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:15:15.140672    6004 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-d061d0-openshift-default-86b87f495-w45rb"
Oct 30 21:15:15.447312 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:15:15.447258    6004 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w2-d061d0-openshift-default-86b87f495-w45rb"]
Oct 30 21:15:15.452649 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:15:15.452615    6004 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w2-d061d0-openshift-default-86b87f495-w45rb"]
Oct 30 21:15:16.235345 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:15:16.235297    6004 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="9ad52be5-bae9-4663-a915-2d4374812459" path="/var/lib/kubelet/pods/9ad52be5-bae9-4663-a915-2d4374812459/volumes"
Oct 30 21:15:23.267496 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:15:23.267458    6004 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w6-7eaf74-6f597b8c87-jjsw8"]
Oct 30 21:15:23.267934 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:15:23.267674    6004 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w6-7eaf74-6f597b8c87-jjsw8" podUID="118ff52d-4872-4408-b3d2-feab54040b8b" containerName="maas-api" containerID="cri-o://8969577b56dbcac51c4220e7165f13676afba6d0f4f4a3be134e9f377bf54809" gracePeriod=30
Oct 30 21:15:23.618500 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:15:23.618469    6004 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w6-7eaf74-6f597b8c87-jjsw8"
Oct 30 21:15:23.757020 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:15:23.755536    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/118ff52d-4872-4408-b3d2-feab54040b8b-metrics-certs\" (UniqueName: \"kubernetes.io/secret/118ff52d-4872-4408-b3d2-feab54040b8b-metrics-certs\") pod \"118ff52d-4872-4408-b3d2-feab54040b8b\" (UID: \"118ff52d-4872-4408-b3d2-feab54040b8b\") "
Oct 30 21:15:23.757020 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:15:23.755628    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/118ff52d-4872-4408-b3d2-feab54040b8b-kube-api-access-2fj4c\" (UniqueName: \"kubernetes.io/projected/118ff52d-4872-4408-b3d2-feab54040b8b-kube-api-access-2fj4c\") pod \"118ff52d-4872-4408-b3d2-feab54040b8b\" (UID: \"118ff52d-4872-4408-b3d2-feab54040b8b\") "
Oct 30 21:15:23.757020 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:15:23.755747    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/118ff52d-4872-4408-b3d2-feab54040b8b-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/118ff52d-4872-4408-b3d2-feab54040b8b-openshift-service-ca\") pod \"118ff52d-4872-4408-b3d2-feab54040b8b\" (UID: \"118ff52d-4872-4408-b3d2-feab54040b8b\") "
Oct 30 21:15:23.757020 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:15:23.755855    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/118ff52d-4872-4408-b3d2-feab54040b8b-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/118ff52d-4872-4408-b3d2-feab54040b8b-maas-api-tls\") pod \"118ff52d-4872-4408-b3d2-feab54040b8b\" (UID: \"118ff52d-4872-4408-b3d2-feab54040b8b\") "
Oct 30 21:15:23.757516 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:15:23.757490    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/118ff52d-4872-4408-b3d2-feab54040b8b-openshift-service-ca" pod "118ff52d-4872-4408-b3d2-feab54040b8b" (UID: "118ff52d-4872-4408-b3d2-feab54040b8b"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:15:23.760682 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:15:23.759574    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/118ff52d-4872-4408-b3d2-feab54040b8b-maas-api-tls" pod "118ff52d-4872-4408-b3d2-feab54040b8b" (UID: "118ff52d-4872-4408-b3d2-feab54040b8b"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:15:23.760976 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:15:23.760950    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/118ff52d-4872-4408-b3d2-feab54040b8b-metrics-certs" pod "118ff52d-4872-4408-b3d2-feab54040b8b" (UID: "118ff52d-4872-4408-b3d2-feab54040b8b"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:15:23.761408 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:15:23.761386    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/118ff52d-4872-4408-b3d2-feab54040b8b-kube-api-access-2fj4c" pod "118ff52d-4872-4408-b3d2-feab54040b8b" (UID: "118ff52d-4872-4408-b3d2-feab54040b8b"). InnerVolumeSpecName "kube-api-access-2fj4c". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:15:23.860126 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:15:23.858694    6004 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/118ff52d-4872-4408-b3d2-feab54040b8b-openshift-service-ca\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:15:23.860126 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:15:23.858737    6004 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/118ff52d-4872-4408-b3d2-feab54040b8b-maas-api-tls\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:15:23.860126 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:15:23.858752    6004 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/118ff52d-4872-4408-b3d2-feab54040b8b-metrics-certs\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:15:23.860126 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:15:23.858768    6004 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2fj4c\" (UniqueName: \"kubernetes.io/projected/118ff52d-4872-4408-b3d2-feab54040b8b-kube-api-access-2fj4c\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:15:24.312162 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:15:24.312122    6004 generic.go:356] "Generic (PLEG): container finished" podID="118ff52d-4872-4408-b3d2-feab54040b8b" containerID="8969577b56dbcac51c4220e7165f13676afba6d0f4f4a3be134e9f377bf54809" exitCode=0
Oct 30 21:15:24.312771 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:15:24.312736    6004 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w6-7eaf74-6f597b8c87-jjsw8" event={"ID":"118ff52d-4872-4408-b3d2-feab54040b8b","Type":"ContainerDied","Data":"8969577b56dbcac51c4220e7165f13676afba6d0f4f4a3be134e9f377bf54809"}
Oct 30 21:15:24.312929 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:15:24.312809    6004 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w6-7eaf74-6f597b8c87-jjsw8" event={"ID":"118ff52d-4872-4408-b3d2-feab54040b8b","Type":"ContainerDied","Data":"0045683d77851249ff562ce2c654e64a736f6999fcfedaf010c3395619dd3d95"}
Oct 30 21:15:24.312929 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:15:24.312841    6004 scope.go:122] "RemoveContainer" containerID="8969577b56dbcac51c4220e7165f13676afba6d0f4f4a3be134e9f377bf54809"
Oct 30 21:15:24.313082 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:15:24.313031    6004 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w6-7eaf74-6f597b8c87-jjsw8"
Oct 30 21:15:24.359858 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:15:24.359827    6004 scope.go:122] "RemoveContainer" containerID="8969577b56dbcac51c4220e7165f13676afba6d0f4f4a3be134e9f377bf54809"
Oct 30 21:15:24.360301 ip-10-0-138-85 kubenswrapper[6004]: E1030 21:15:24.360237    6004 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8969577b56dbcac51c4220e7165f13676afba6d0f4f4a3be134e9f377bf54809\": container with ID starting with 8969577b56dbcac51c4220e7165f13676afba6d0f4f4a3be134e9f377bf54809 not found: ID does not exist" containerID="8969577b56dbcac51c4220e7165f13676afba6d0f4f4a3be134e9f377bf54809"
Oct 30 21:15:24.360390 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:15:24.360311    6004 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8969577b56dbcac51c4220e7165f13676afba6d0f4f4a3be134e9f377bf54809"} err="failed to get container status \"8969577b56dbcac51c4220e7165f13676afba6d0f4f4a3be134e9f377bf54809\": rpc error: code = NotFound desc = could not find container \"8969577b56dbcac51c4220e7165f13676afba6d0f4f4a3be134e9f377bf54809\": container with ID starting with 8969577b56dbcac51c4220e7165f13676afba6d0f4f4a3be134e9f377bf54809 not found: ID does not exist"
Oct 30 21:15:24.486221 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:15:24.486182    6004 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w6-7eaf74-6f597b8c87-jjsw8"]
Oct 30 21:15:24.534769 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:15:24.534733    6004 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w6-7eaf74-6f597b8c87-jjsw8"]
Oct 30 21:15:26.232406 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:15:26.232369    6004 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="118ff52d-4872-4408-b3d2-feab54040b8b" path="/var/lib/kubelet/pods/118ff52d-4872-4408-b3d2-feab54040b8b/volumes"
Oct 30 21:15:33.092706 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:15:33.092672    6004 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-w6-7eaf74-openshift-default-69c8f48765-7b8mx"]
Oct 30 21:15:33.093180 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:15:33.092902    6004 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-w6-7eaf74-openshift-default-69c8f48765-7b8mx" podUID="51fcc016-5ad8-4bdd-9720-49a1b448c19e" containerName="istio-proxy" containerID="cri-o://2a6e2a592889f92900be2d9ee9f55274ab06cdc352dc7ee70e85be6582a12e7a" gracePeriod=30
Oct 30 21:15:33.126341 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:15:33.126299    6004 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-w6-7eaf74-openshift-default-69c8f48765-2rvzl"]
Oct 30 21:15:33.126778 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:15:33.126735    6004 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-w6-7eaf74-openshift-default-69c8f48765-2rvzl" podUID="18f44298-4c12-4e81-942d-f8fdee2e968f" containerName="istio-proxy" containerID="cri-o://0e4a327889265b84693b9c76a0100c5b0653e180cdbf3c2010b45a6d6a38dd25" gracePeriod=30
Oct 30 21:15:35.486612 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:15:35.486579    6004 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w1-677b45-589b4db885-9lrlm"]
Oct 30 21:15:35.487390 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:15:35.487357    6004 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w1-677b45-589b4db885-9lrlm" podUID="801ac95e-5a0b-4e42-a632-33fa0536fc44" containerName="maas-api" containerID="cri-o://ef4e4747c7ad294b9b8866ca8ea26697c0be0931a102892a5f858a8198fdc268" gracePeriod=30
Oct 30 21:15:35.852638 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:15:35.852610    6004 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w1-677b45-589b4db885-9lrlm"
Oct 30 21:15:35.953590 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:15:35.944854    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/801ac95e-5a0b-4e42-a632-33fa0536fc44-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/801ac95e-5a0b-4e42-a632-33fa0536fc44-openshift-service-ca\") pod \"801ac95e-5a0b-4e42-a632-33fa0536fc44\" (UID: \"801ac95e-5a0b-4e42-a632-33fa0536fc44\") "
Oct 30 21:15:35.953590 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:15:35.944953    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/801ac95e-5a0b-4e42-a632-33fa0536fc44-kube-api-access-zm8mb\" (UniqueName: \"kubernetes.io/projected/801ac95e-5a0b-4e42-a632-33fa0536fc44-kube-api-access-zm8mb\") pod \"801ac95e-5a0b-4e42-a632-33fa0536fc44\" (UID: \"801ac95e-5a0b-4e42-a632-33fa0536fc44\") "
Oct 30 21:15:35.953590 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:15:35.945123    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/801ac95e-5a0b-4e42-a632-33fa0536fc44-metrics-certs\" (UniqueName: \"kubernetes.io/secret/801ac95e-5a0b-4e42-a632-33fa0536fc44-metrics-certs\") pod \"801ac95e-5a0b-4e42-a632-33fa0536fc44\" (UID: \"801ac95e-5a0b-4e42-a632-33fa0536fc44\") "
Oct 30 21:15:35.953590 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:15:35.945225    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/801ac95e-5a0b-4e42-a632-33fa0536fc44-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/801ac95e-5a0b-4e42-a632-33fa0536fc44-maas-api-tls\") pod \"801ac95e-5a0b-4e42-a632-33fa0536fc44\" (UID: \"801ac95e-5a0b-4e42-a632-33fa0536fc44\") "
Oct 30 21:15:35.953590 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:15:35.949004    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/801ac95e-5a0b-4e42-a632-33fa0536fc44-openshift-service-ca" pod "801ac95e-5a0b-4e42-a632-33fa0536fc44" (UID: "801ac95e-5a0b-4e42-a632-33fa0536fc44"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:15:35.962223 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:15:35.962158    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/801ac95e-5a0b-4e42-a632-33fa0536fc44-maas-api-tls" pod "801ac95e-5a0b-4e42-a632-33fa0536fc44" (UID: "801ac95e-5a0b-4e42-a632-33fa0536fc44"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:15:35.962223 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:15:35.962187    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/801ac95e-5a0b-4e42-a632-33fa0536fc44-metrics-certs" pod "801ac95e-5a0b-4e42-a632-33fa0536fc44" (UID: "801ac95e-5a0b-4e42-a632-33fa0536fc44"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:15:35.962438 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:15:35.962197    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/801ac95e-5a0b-4e42-a632-33fa0536fc44-kube-api-access-zm8mb" pod "801ac95e-5a0b-4e42-a632-33fa0536fc44" (UID: "801ac95e-5a0b-4e42-a632-33fa0536fc44"). InnerVolumeSpecName "kube-api-access-zm8mb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:15:36.047103 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:15:36.047035    6004 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/801ac95e-5a0b-4e42-a632-33fa0536fc44-maas-api-tls\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:15:36.047344 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:15:36.047327    6004 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/801ac95e-5a0b-4e42-a632-33fa0536fc44-openshift-service-ca\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:15:36.047454 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:15:36.047440    6004 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zm8mb\" (UniqueName: \"kubernetes.io/projected/801ac95e-5a0b-4e42-a632-33fa0536fc44-kube-api-access-zm8mb\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:15:36.047539 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:15:36.047528    6004 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/801ac95e-5a0b-4e42-a632-33fa0536fc44-metrics-certs\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:15:36.407556 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:15:36.407524    6004 generic.go:356] "Generic (PLEG): container finished" podID="801ac95e-5a0b-4e42-a632-33fa0536fc44" containerID="ef4e4747c7ad294b9b8866ca8ea26697c0be0931a102892a5f858a8198fdc268" exitCode=0
Oct 30 21:15:36.407746 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:15:36.407589    6004 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w1-677b45-589b4db885-9lrlm"
Oct 30 21:15:36.407746 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:15:36.407609    6004 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w1-677b45-589b4db885-9lrlm" event={"ID":"801ac95e-5a0b-4e42-a632-33fa0536fc44","Type":"ContainerDied","Data":"ef4e4747c7ad294b9b8866ca8ea26697c0be0931a102892a5f858a8198fdc268"}
Oct 30 21:15:36.407746 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:15:36.407666    6004 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w1-677b45-589b4db885-9lrlm" event={"ID":"801ac95e-5a0b-4e42-a632-33fa0536fc44","Type":"ContainerDied","Data":"406534f8cd611b4ccf1109714a814a55e9ad8a4e1e57865c138d57a16e1a83f3"}
Oct 30 21:15:36.407746 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:15:36.407693    6004 scope.go:122] "RemoveContainer" containerID="ef4e4747c7ad294b9b8866ca8ea26697c0be0931a102892a5f858a8198fdc268"
Oct 30 21:15:36.419157 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:15:36.419138    6004 scope.go:122] "RemoveContainer" containerID="ef4e4747c7ad294b9b8866ca8ea26697c0be0931a102892a5f858a8198fdc268"
Oct 30 21:15:36.419461 ip-10-0-138-85 kubenswrapper[6004]: E1030 21:15:36.419439    6004 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ef4e4747c7ad294b9b8866ca8ea26697c0be0931a102892a5f858a8198fdc268\": container with ID starting with ef4e4747c7ad294b9b8866ca8ea26697c0be0931a102892a5f858a8198fdc268 not found: ID does not exist" containerID="ef4e4747c7ad294b9b8866ca8ea26697c0be0931a102892a5f858a8198fdc268"
Oct 30 21:15:36.419552 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:15:36.419472    6004 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ef4e4747c7ad294b9b8866ca8ea26697c0be0931a102892a5f858a8198fdc268"} err="failed to get container status \"ef4e4747c7ad294b9b8866ca8ea26697c0be0931a102892a5f858a8198fdc268\": rpc error: code = NotFound desc = could not find container \"ef4e4747c7ad294b9b8866ca8ea26697c0be0931a102892a5f858a8198fdc268\": container with ID starting with ef4e4747c7ad294b9b8866ca8ea26697c0be0931a102892a5f858a8198fdc268 not found: ID does not exist"
Oct 30 21:15:36.586161 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:15:36.585332    6004 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w1-677b45-589b4db885-9lrlm"]
Oct 30 21:15:36.592067 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:15:36.589168    6004 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w1-677b45-589b4db885-9lrlm"]
Oct 30 21:15:38.231450 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:15:38.231419    6004 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="801ac95e-5a0b-4e42-a632-33fa0536fc44" path="/var/lib/kubelet/pods/801ac95e-5a0b-4e42-a632-33fa0536fc44/volumes"
Oct 30 21:15:38.433670 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:15:38.433632    6004 generic.go:356] "Generic (PLEG): container finished" podID="51fcc016-5ad8-4bdd-9720-49a1b448c19e" containerID="2a6e2a592889f92900be2d9ee9f55274ab06cdc352dc7ee70e85be6582a12e7a" exitCode=0
Oct 30 21:15:38.433824 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:15:38.433755    6004 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w6-7eaf74-openshift-default-69c8f48765-7b8mx" event={"ID":"51fcc016-5ad8-4bdd-9720-49a1b448c19e","Type":"ContainerDied","Data":"2a6e2a592889f92900be2d9ee9f55274ab06cdc352dc7ee70e85be6582a12e7a"}
Oct 30 21:15:38.435554 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:15:38.435530    6004 generic.go:356] "Generic (PLEG): container finished" podID="18f44298-4c12-4e81-942d-f8fdee2e968f" containerID="0e4a327889265b84693b9c76a0100c5b0653e180cdbf3c2010b45a6d6a38dd25" exitCode=0
Oct 30 21:15:38.435679 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:15:38.435638    6004 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w6-7eaf74-openshift-default-69c8f48765-2rvzl" event={"ID":"18f44298-4c12-4e81-942d-f8fdee2e968f","Type":"ContainerDied","Data":"0e4a327889265b84693b9c76a0100c5b0653e180cdbf3c2010b45a6d6a38dd25"}
Oct 30 21:15:38.435740 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:15:38.435692    6004 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w6-7eaf74-openshift-default-69c8f48765-2rvzl" event={"ID":"18f44298-4c12-4e81-942d-f8fdee2e968f","Type":"ContainerDied","Data":"32a522c4d31d927f01bc9ff179088e536bd4f583dca9e1c510041c8d3084000e"}
Oct 30 21:15:38.435740 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:15:38.435727    6004 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="32a522c4d31d927f01bc9ff179088e536bd4f583dca9e1c510041c8d3084000e"
Oct 30 21:15:38.469761 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:15:38.469729    6004 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w6-7eaf74-openshift-default-69c8f48765-2rvzl"
Oct 30 21:15:38.476063 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:15:38.476029    6004 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w6-7eaf74-openshift-default-69c8f48765-7b8mx"
Oct 30 21:15:38.600206 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:15:38.600172    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/18f44298-4c12-4e81-942d-f8fdee2e968f-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/18f44298-4c12-4e81-942d-f8fdee2e968f-istio-envoy\") pod \"18f44298-4c12-4e81-942d-f8fdee2e968f\" (UID: \"18f44298-4c12-4e81-942d-f8fdee2e968f\") "
Oct 30 21:15:38.600377 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:15:38.600219    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/18f44298-4c12-4e81-942d-f8fdee2e968f-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/18f44298-4c12-4e81-942d-f8fdee2e968f-credential-socket\") pod \"18f44298-4c12-4e81-942d-f8fdee2e968f\" (UID: \"18f44298-4c12-4e81-942d-f8fdee2e968f\") "
Oct 30 21:15:38.600377 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:15:38.600254    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/51fcc016-5ad8-4bdd-9720-49a1b448c19e-istio-token\" (UniqueName: \"kubernetes.io/projected/51fcc016-5ad8-4bdd-9720-49a1b448c19e-istio-token\") pod \"51fcc016-5ad8-4bdd-9720-49a1b448c19e\" (UID: \"51fcc016-5ad8-4bdd-9720-49a1b448c19e\") "
Oct 30 21:15:38.600377 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:15:38.600284    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/51fcc016-5ad8-4bdd-9720-49a1b448c19e-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/51fcc016-5ad8-4bdd-9720-49a1b448c19e-istiod-ca-cert\") pod \"51fcc016-5ad8-4bdd-9720-49a1b448c19e\" (UID: \"51fcc016-5ad8-4bdd-9720-49a1b448c19e\") "
Oct 30 21:15:38.600377 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:15:38.600306    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/51fcc016-5ad8-4bdd-9720-49a1b448c19e-kube-api-access-l6h99\" (UniqueName: \"kubernetes.io/projected/51fcc016-5ad8-4bdd-9720-49a1b448c19e-kube-api-access-l6h99\") pod \"51fcc016-5ad8-4bdd-9720-49a1b448c19e\" (UID: \"51fcc016-5ad8-4bdd-9720-49a1b448c19e\") "
Oct 30 21:15:38.600377 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:15:38.600344    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/51fcc016-5ad8-4bdd-9720-49a1b448c19e-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/51fcc016-5ad8-4bdd-9720-49a1b448c19e-istio-envoy\") pod \"51fcc016-5ad8-4bdd-9720-49a1b448c19e\" (UID: \"51fcc016-5ad8-4bdd-9720-49a1b448c19e\") "
Oct 30 21:15:38.600656 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:15:38.600397    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/51fcc016-5ad8-4bdd-9720-49a1b448c19e-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/51fcc016-5ad8-4bdd-9720-49a1b448c19e-istio-podinfo\") pod \"51fcc016-5ad8-4bdd-9720-49a1b448c19e\" (UID: \"51fcc016-5ad8-4bdd-9720-49a1b448c19e\") "
Oct 30 21:15:38.600656 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:15:38.600468    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/18f44298-4c12-4e81-942d-f8fdee2e968f-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/18f44298-4c12-4e81-942d-f8fdee2e968f-istio-podinfo\") pod \"18f44298-4c12-4e81-942d-f8fdee2e968f\" (UID: \"18f44298-4c12-4e81-942d-f8fdee2e968f\") "
Oct 30 21:15:38.600656 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:15:38.600528    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/18f44298-4c12-4e81-942d-f8fdee2e968f-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/18f44298-4c12-4e81-942d-f8fdee2e968f-workload-certs\") pod \"18f44298-4c12-4e81-942d-f8fdee2e968f\" (UID: \"18f44298-4c12-4e81-942d-f8fdee2e968f\") "
Oct 30 21:15:38.600656 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:15:38.600576    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/51fcc016-5ad8-4bdd-9720-49a1b448c19e-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/51fcc016-5ad8-4bdd-9720-49a1b448c19e-credential-socket\") pod \"51fcc016-5ad8-4bdd-9720-49a1b448c19e\" (UID: \"51fcc016-5ad8-4bdd-9720-49a1b448c19e\") "
Oct 30 21:15:38.600656 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:15:38.600620    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/18f44298-4c12-4e81-942d-f8fdee2e968f-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/18f44298-4c12-4e81-942d-f8fdee2e968f-istiod-ca-cert\") pod \"18f44298-4c12-4e81-942d-f8fdee2e968f\" (UID: \"18f44298-4c12-4e81-942d-f8fdee2e968f\") "
Oct 30 21:15:38.600656 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:15:38.600600    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/18f44298-4c12-4e81-942d-f8fdee2e968f-credential-socket" pod "18f44298-4c12-4e81-942d-f8fdee2e968f" (UID: "18f44298-4c12-4e81-942d-f8fdee2e968f"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:15:38.600968 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:15:38.600686    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/51fcc016-5ad8-4bdd-9720-49a1b448c19e-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/51fcc016-5ad8-4bdd-9720-49a1b448c19e-workload-certs\") pod \"51fcc016-5ad8-4bdd-9720-49a1b448c19e\" (UID: \"51fcc016-5ad8-4bdd-9720-49a1b448c19e\") "
Oct 30 21:15:38.600968 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:15:38.600721    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/51fcc016-5ad8-4bdd-9720-49a1b448c19e-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/51fcc016-5ad8-4bdd-9720-49a1b448c19e-istio-data\") pod \"51fcc016-5ad8-4bdd-9720-49a1b448c19e\" (UID: \"51fcc016-5ad8-4bdd-9720-49a1b448c19e\") "
Oct 30 21:15:38.600968 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:15:38.600745    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/18f44298-4c12-4e81-942d-f8fdee2e968f-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/18f44298-4c12-4e81-942d-f8fdee2e968f-workload-socket\") pod \"18f44298-4c12-4e81-942d-f8fdee2e968f\" (UID: \"18f44298-4c12-4e81-942d-f8fdee2e968f\") "
Oct 30 21:15:38.600968 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:15:38.600747    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/51fcc016-5ad8-4bdd-9720-49a1b448c19e-istiod-ca-cert" pod "51fcc016-5ad8-4bdd-9720-49a1b448c19e" (UID: "51fcc016-5ad8-4bdd-9720-49a1b448c19e"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:15:38.600968 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:15:38.600779    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/18f44298-4c12-4e81-942d-f8fdee2e968f-istio-token\" (UniqueName: \"kubernetes.io/projected/18f44298-4c12-4e81-942d-f8fdee2e968f-istio-token\") pod \"18f44298-4c12-4e81-942d-f8fdee2e968f\" (UID: \"18f44298-4c12-4e81-942d-f8fdee2e968f\") "
Oct 30 21:15:38.600968 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:15:38.600819    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/18f44298-4c12-4e81-942d-f8fdee2e968f-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/18f44298-4c12-4e81-942d-f8fdee2e968f-istio-data\") pod \"18f44298-4c12-4e81-942d-f8fdee2e968f\" (UID: \"18f44298-4c12-4e81-942d-f8fdee2e968f\") "
Oct 30 21:15:38.600968 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:15:38.600847    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/18f44298-4c12-4e81-942d-f8fdee2e968f-kube-api-access-wswfm\" (UniqueName: \"kubernetes.io/projected/18f44298-4c12-4e81-942d-f8fdee2e968f-kube-api-access-wswfm\") pod \"18f44298-4c12-4e81-942d-f8fdee2e968f\" (UID: \"18f44298-4c12-4e81-942d-f8fdee2e968f\") "
Oct 30 21:15:38.600968 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:15:38.600869    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/51fcc016-5ad8-4bdd-9720-49a1b448c19e-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/51fcc016-5ad8-4bdd-9720-49a1b448c19e-workload-socket\") pod \"51fcc016-5ad8-4bdd-9720-49a1b448c19e\" (UID: \"51fcc016-5ad8-4bdd-9720-49a1b448c19e\") "
Oct 30 21:15:38.601481 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:15:38.601457    6004 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/18f44298-4c12-4e81-942d-f8fdee2e968f-credential-socket\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:15:38.601555 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:15:38.601488    6004 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/51fcc016-5ad8-4bdd-9720-49a1b448c19e-istiod-ca-cert\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:15:38.601773 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:15:38.601712    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/51fcc016-5ad8-4bdd-9720-49a1b448c19e-workload-socket" pod "51fcc016-5ad8-4bdd-9720-49a1b448c19e" (UID: "51fcc016-5ad8-4bdd-9720-49a1b448c19e"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:15:38.601959 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:15:38.601927    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/18f44298-4c12-4e81-942d-f8fdee2e968f-istio-data" pod "18f44298-4c12-4e81-942d-f8fdee2e968f" (UID: "18f44298-4c12-4e81-942d-f8fdee2e968f"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:15:38.602111 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:15:38.602042    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/18f44298-4c12-4e81-942d-f8fdee2e968f-workload-certs" pod "18f44298-4c12-4e81-942d-f8fdee2e968f" (UID: "18f44298-4c12-4e81-942d-f8fdee2e968f"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:15:38.602293 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:15:38.602258    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/18f44298-4c12-4e81-942d-f8fdee2e968f-workload-socket" pod "18f44298-4c12-4e81-942d-f8fdee2e968f" (UID: "18f44298-4c12-4e81-942d-f8fdee2e968f"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:15:38.602379 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:15:38.602294    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/51fcc016-5ad8-4bdd-9720-49a1b448c19e-credential-socket" pod "51fcc016-5ad8-4bdd-9720-49a1b448c19e" (UID: "51fcc016-5ad8-4bdd-9720-49a1b448c19e"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:15:38.602379 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:15:38.602314    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/51fcc016-5ad8-4bdd-9720-49a1b448c19e-istio-data" pod "51fcc016-5ad8-4bdd-9720-49a1b448c19e" (UID: "51fcc016-5ad8-4bdd-9720-49a1b448c19e"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:15:38.602519 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:15:38.602499    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/51fcc016-5ad8-4bdd-9720-49a1b448c19e-workload-certs" pod "51fcc016-5ad8-4bdd-9720-49a1b448c19e" (UID: "51fcc016-5ad8-4bdd-9720-49a1b448c19e"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:15:38.602596 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:15:38.602579    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/18f44298-4c12-4e81-942d-f8fdee2e968f-istiod-ca-cert" pod "18f44298-4c12-4e81-942d-f8fdee2e968f" (UID: "18f44298-4c12-4e81-942d-f8fdee2e968f"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:15:38.604253 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:15:38.604228    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/18f44298-4c12-4e81-942d-f8fdee2e968f-kube-api-access-wswfm" pod "18f44298-4c12-4e81-942d-f8fdee2e968f" (UID: "18f44298-4c12-4e81-942d-f8fdee2e968f"). InnerVolumeSpecName "kube-api-access-wswfm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:15:38.604792 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:15:38.604740    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/51fcc016-5ad8-4bdd-9720-49a1b448c19e-istio-podinfo" pod "51fcc016-5ad8-4bdd-9720-49a1b448c19e" (UID: "51fcc016-5ad8-4bdd-9720-49a1b448c19e"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 21:15:38.604792 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:15:38.604746    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/18f44298-4c12-4e81-942d-f8fdee2e968f-istio-token" pod "18f44298-4c12-4e81-942d-f8fdee2e968f" (UID: "18f44298-4c12-4e81-942d-f8fdee2e968f"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:15:38.606008 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:15:38.605988    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/18f44298-4c12-4e81-942d-f8fdee2e968f-istio-envoy" pod "18f44298-4c12-4e81-942d-f8fdee2e968f" (UID: "18f44298-4c12-4e81-942d-f8fdee2e968f"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:15:38.610940 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:15:38.610918    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/18f44298-4c12-4e81-942d-f8fdee2e968f-istio-podinfo" pod "18f44298-4c12-4e81-942d-f8fdee2e968f" (UID: "18f44298-4c12-4e81-942d-f8fdee2e968f"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 21:15:38.610940 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:15:38.610932    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/51fcc016-5ad8-4bdd-9720-49a1b448c19e-istio-envoy" pod "51fcc016-5ad8-4bdd-9720-49a1b448c19e" (UID: "51fcc016-5ad8-4bdd-9720-49a1b448c19e"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:15:38.611073 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:15:38.610971    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/51fcc016-5ad8-4bdd-9720-49a1b448c19e-istio-token" pod "51fcc016-5ad8-4bdd-9720-49a1b448c19e" (UID: "51fcc016-5ad8-4bdd-9720-49a1b448c19e"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:15:38.612187 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:15:38.612163    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/51fcc016-5ad8-4bdd-9720-49a1b448c19e-kube-api-access-l6h99" pod "51fcc016-5ad8-4bdd-9720-49a1b448c19e" (UID: "51fcc016-5ad8-4bdd-9720-49a1b448c19e"). InnerVolumeSpecName "kube-api-access-l6h99". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:15:38.703187 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:15:38.703153    6004 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/18f44298-4c12-4e81-942d-f8fdee2e968f-istio-token\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:15:38.703187 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:15:38.703184    6004 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/18f44298-4c12-4e81-942d-f8fdee2e968f-istio-data\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:15:38.703187 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:15:38.703194    6004 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wswfm\" (UniqueName: \"kubernetes.io/projected/18f44298-4c12-4e81-942d-f8fdee2e968f-kube-api-access-wswfm\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:15:38.703424 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:15:38.703205    6004 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/51fcc016-5ad8-4bdd-9720-49a1b448c19e-workload-socket\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:15:38.703424 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:15:38.703218    6004 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/18f44298-4c12-4e81-942d-f8fdee2e968f-istio-envoy\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:15:38.703424 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:15:38.703232    6004 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/51fcc016-5ad8-4bdd-9720-49a1b448c19e-istio-token\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:15:38.703424 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:15:38.703244    6004 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l6h99\" (UniqueName: \"kubernetes.io/projected/51fcc016-5ad8-4bdd-9720-49a1b448c19e-kube-api-access-l6h99\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:15:38.703424 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:15:38.703256    6004 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/51fcc016-5ad8-4bdd-9720-49a1b448c19e-istio-envoy\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:15:38.703424 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:15:38.703267    6004 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/51fcc016-5ad8-4bdd-9720-49a1b448c19e-istio-podinfo\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:15:38.703424 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:15:38.703275    6004 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/18f44298-4c12-4e81-942d-f8fdee2e968f-istio-podinfo\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:15:38.703424 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:15:38.703284    6004 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/18f44298-4c12-4e81-942d-f8fdee2e968f-workload-certs\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:15:38.703424 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:15:38.703292    6004 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/51fcc016-5ad8-4bdd-9720-49a1b448c19e-credential-socket\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:15:38.703424 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:15:38.703300    6004 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/18f44298-4c12-4e81-942d-f8fdee2e968f-istiod-ca-cert\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:15:38.703424 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:15:38.703319    6004 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/51fcc016-5ad8-4bdd-9720-49a1b448c19e-workload-certs\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:15:38.703424 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:15:38.703328    6004 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/51fcc016-5ad8-4bdd-9720-49a1b448c19e-istio-data\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:15:38.703424 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:15:38.703336    6004 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/18f44298-4c12-4e81-942d-f8fdee2e968f-workload-socket\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:15:39.445852 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:15:39.445820    6004 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w6-7eaf74-openshift-default-69c8f48765-7b8mx"
Oct 30 21:15:39.446272 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:15:39.445854    6004 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w6-7eaf74-openshift-default-69c8f48765-7b8mx" event={"ID":"51fcc016-5ad8-4bdd-9720-49a1b448c19e","Type":"ContainerDied","Data":"2cd620cbafc8b4a1047e8c287794185b257e1d728595d9d40edd64a851546239"}
Oct 30 21:15:39.446272 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:15:39.445916    6004 scope.go:122] "RemoveContainer" containerID="2a6e2a592889f92900be2d9ee9f55274ab06cdc352dc7ee70e85be6582a12e7a"
Oct 30 21:15:39.446350 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:15:39.446298    6004 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w6-7eaf74-openshift-default-69c8f48765-2rvzl"
Oct 30 21:15:39.665958 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:15:39.665918    6004 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-w6-7eaf74-openshift-default-69c8f48765-2rvzl"]
Oct 30 21:15:39.714609 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:15:39.714524    6004 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-w6-7eaf74-openshift-default-69c8f48765-2rvzl"]
Oct 30 21:15:39.826647 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:15:39.826613    6004 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-w6-7eaf74-openshift-default-69c8f48765-7b8mx"]
Oct 30 21:15:39.834463 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:15:39.834430    6004 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-w6-7eaf74-openshift-default-69c8f48765-7b8mx"]
Oct 30 21:15:40.231741 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:15:40.231711    6004 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="18f44298-4c12-4e81-942d-f8fdee2e968f" path="/var/lib/kubelet/pods/18f44298-4c12-4e81-942d-f8fdee2e968f/volumes"
Oct 30 21:15:40.232233 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:15:40.232218    6004 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="51fcc016-5ad8-4bdd-9720-49a1b448c19e" path="/var/lib/kubelet/pods/51fcc016-5ad8-4bdd-9720-49a1b448c19e/volumes"
Oct 30 21:15:44.306310 ip-10-0-138-85 kubenswrapper[6004]: E1030 21:15:44.306224    6004 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-zz4wr" containerName="extractor"
Oct 30 21:15:52.877531 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:15:52.877493    6004 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w2-d061d0-5967747b86-mkwwq"]
Oct 30 21:15:52.878164 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:15:52.877746    6004 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-d061d0-5967747b86-mkwwq" podUID="2193d3b6-6d8c-4060-8337-7d3d431179a9" containerName="maas-api" containerID="cri-o://ae65d3386d3a951222fb76599f00cbc37f05bf9535ba61047203cfe99e5a0227" gracePeriod=30
Oct 30 21:15:53.229833 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:15:53.229800    6004 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-d061d0-5967747b86-mkwwq"
Oct 30 21:15:53.360824 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:15:53.359639    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/2193d3b6-6d8c-4060-8337-7d3d431179a9-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2193d3b6-6d8c-4060-8337-7d3d431179a9-maas-api-tls\") pod \"2193d3b6-6d8c-4060-8337-7d3d431179a9\" (UID: \"2193d3b6-6d8c-4060-8337-7d3d431179a9\") "
Oct 30 21:15:53.360824 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:15:53.359789    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/2193d3b6-6d8c-4060-8337-7d3d431179a9-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2193d3b6-6d8c-4060-8337-7d3d431179a9-openshift-service-ca\") pod \"2193d3b6-6d8c-4060-8337-7d3d431179a9\" (UID: \"2193d3b6-6d8c-4060-8337-7d3d431179a9\") "
Oct 30 21:15:53.360824 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:15:53.359890    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/2193d3b6-6d8c-4060-8337-7d3d431179a9-metrics-certs\" (UniqueName: \"kubernetes.io/secret/2193d3b6-6d8c-4060-8337-7d3d431179a9-metrics-certs\") pod \"2193d3b6-6d8c-4060-8337-7d3d431179a9\" (UID: \"2193d3b6-6d8c-4060-8337-7d3d431179a9\") "
Oct 30 21:15:53.360824 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:15:53.359962    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/2193d3b6-6d8c-4060-8337-7d3d431179a9-kube-api-access-x64c8\" (UniqueName: \"kubernetes.io/projected/2193d3b6-6d8c-4060-8337-7d3d431179a9-kube-api-access-x64c8\") pod \"2193d3b6-6d8c-4060-8337-7d3d431179a9\" (UID: \"2193d3b6-6d8c-4060-8337-7d3d431179a9\") "
Oct 30 21:15:53.361820 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:15:53.361788    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2193d3b6-6d8c-4060-8337-7d3d431179a9-openshift-service-ca" pod "2193d3b6-6d8c-4060-8337-7d3d431179a9" (UID: "2193d3b6-6d8c-4060-8337-7d3d431179a9"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:15:53.386339 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:15:53.369639    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2193d3b6-6d8c-4060-8337-7d3d431179a9-metrics-certs" pod "2193d3b6-6d8c-4060-8337-7d3d431179a9" (UID: "2193d3b6-6d8c-4060-8337-7d3d431179a9"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:15:53.386339 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:15:53.384261    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2193d3b6-6d8c-4060-8337-7d3d431179a9-maas-api-tls" pod "2193d3b6-6d8c-4060-8337-7d3d431179a9" (UID: "2193d3b6-6d8c-4060-8337-7d3d431179a9"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:15:53.386339 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:15:53.386297    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2193d3b6-6d8c-4060-8337-7d3d431179a9-kube-api-access-x64c8" pod "2193d3b6-6d8c-4060-8337-7d3d431179a9" (UID: "2193d3b6-6d8c-4060-8337-7d3d431179a9"). InnerVolumeSpecName "kube-api-access-x64c8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:15:53.462230 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:15:53.462138    6004 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2193d3b6-6d8c-4060-8337-7d3d431179a9-maas-api-tls\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:15:53.462230 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:15:53.462179    6004 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2193d3b6-6d8c-4060-8337-7d3d431179a9-openshift-service-ca\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:15:53.462230 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:15:53.462194    6004 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2193d3b6-6d8c-4060-8337-7d3d431179a9-metrics-certs\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:15:53.462230 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:15:53.462208    6004 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x64c8\" (UniqueName: \"kubernetes.io/projected/2193d3b6-6d8c-4060-8337-7d3d431179a9-kube-api-access-x64c8\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:15:53.582005 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:15:53.581964    6004 generic.go:356] "Generic (PLEG): container finished" podID="2193d3b6-6d8c-4060-8337-7d3d431179a9" containerID="ae65d3386d3a951222fb76599f00cbc37f05bf9535ba61047203cfe99e5a0227" exitCode=0
Oct 30 21:15:53.582217 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:15:53.582023    6004 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-d061d0-5967747b86-mkwwq"
Oct 30 21:15:53.582217 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:15:53.582060    6004 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-d061d0-5967747b86-mkwwq" event={"ID":"2193d3b6-6d8c-4060-8337-7d3d431179a9","Type":"ContainerDied","Data":"ae65d3386d3a951222fb76599f00cbc37f05bf9535ba61047203cfe99e5a0227"}
Oct 30 21:15:53.582217 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:15:53.582131    6004 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-d061d0-5967747b86-mkwwq" event={"ID":"2193d3b6-6d8c-4060-8337-7d3d431179a9","Type":"ContainerDied","Data":"4a61a0162c656fcb86b7746b9886621702ecd8b0c11be2e6d9b4e245bae06242"}
Oct 30 21:15:53.582217 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:15:53.582162    6004 scope.go:122] "RemoveContainer" containerID="ae65d3386d3a951222fb76599f00cbc37f05bf9535ba61047203cfe99e5a0227"
Oct 30 21:15:53.593259 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:15:53.593241    6004 scope.go:122] "RemoveContainer" containerID="ae65d3386d3a951222fb76599f00cbc37f05bf9535ba61047203cfe99e5a0227"
Oct 30 21:15:53.593530 ip-10-0-138-85 kubenswrapper[6004]: E1030 21:15:53.593511    6004 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ae65d3386d3a951222fb76599f00cbc37f05bf9535ba61047203cfe99e5a0227\": container with ID starting with ae65d3386d3a951222fb76599f00cbc37f05bf9535ba61047203cfe99e5a0227 not found: ID does not exist" containerID="ae65d3386d3a951222fb76599f00cbc37f05bf9535ba61047203cfe99e5a0227"
Oct 30 21:15:53.593596 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:15:53.593542    6004 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ae65d3386d3a951222fb76599f00cbc37f05bf9535ba61047203cfe99e5a0227"} err="failed to get container status \"ae65d3386d3a951222fb76599f00cbc37f05bf9535ba61047203cfe99e5a0227\": rpc error: code = NotFound desc = could not find container \"ae65d3386d3a951222fb76599f00cbc37f05bf9535ba61047203cfe99e5a0227\": container with ID starting with ae65d3386d3a951222fb76599f00cbc37f05bf9535ba61047203cfe99e5a0227 not found: ID does not exist"
Oct 30 21:15:53.749225 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:15:53.749148    6004 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w2-d061d0-5967747b86-mkwwq"]
Oct 30 21:15:53.799999 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:15:53.799969    6004 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w2-d061d0-5967747b86-mkwwq"]
Oct 30 21:15:54.233315 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:15:54.233285    6004 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="2193d3b6-6d8c-4060-8337-7d3d431179a9" path="/var/lib/kubelet/pods/2193d3b6-6d8c-4060-8337-7d3d431179a9/volumes"
Oct 30 21:15:59.376118 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:15:59.375998    6004 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-b888d0-openshift-default-65d785fbfc-wgpfl"]
Oct 30 21:15:59.376579 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:15:59.376236    6004 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-api-a-b888d0-openshift-default-65d785fbfc-wgpfl" podUID="9303d324-812e-4154-907e-63865d73600f" containerName="istio-proxy" containerID="cri-o://87638f5c802f78c4083a89691d97e9abd9b173ce015022cb8b15e823d261d1b6" gracePeriod=30
Oct 30 21:16:02.498559 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:16:02.498523    6004 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w2-d061d0-openshift-default-86b87f495-rlgwt"]
Oct 30 21:16:02.499079 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:16:02.498847    6004 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w2-d061d0-openshift-default-86b87f495-rlgwt" podUID="f2a479c8-1fe5-4264-b6cd-dafa68621543" containerName="istio-proxy" containerID="cri-o://20df18f4a46a47959d4e7dd2ce70a219163e05c85d5a53c51b4466873d901ae4" gracePeriod=30
Oct 30 21:16:04.233925 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:16:04.233891    6004 patch_prober.go:29] interesting pod/e2e-api-a-b888d0-openshift-default-65d785fbfc-wgpfl container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Oct 30 21:16:04.234318 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:16:04.233970    6004 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-a-b888d0-openshift-default-65d785fbfc-wgpfl" podUID="9303d324-812e-4154-907e-63865d73600f" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 30 21:16:04.651523 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:16:04.651497    6004 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-b888d0-openshift-default-65d785fbfc-wgpfl"
Oct 30 21:16:04.685464 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:16:04.685418    6004 generic.go:356] "Generic (PLEG): container finished" podID="9303d324-812e-4154-907e-63865d73600f" containerID="87638f5c802f78c4083a89691d97e9abd9b173ce015022cb8b15e823d261d1b6" exitCode=0
Oct 30 21:16:04.685674 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:16:04.685521    6004 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-b888d0-openshift-default-65d785fbfc-wgpfl"
Oct 30 21:16:04.685674 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:16:04.685549    6004 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-b888d0-openshift-default-65d785fbfc-wgpfl" event={"ID":"9303d324-812e-4154-907e-63865d73600f","Type":"ContainerDied","Data":"87638f5c802f78c4083a89691d97e9abd9b173ce015022cb8b15e823d261d1b6"}
Oct 30 21:16:04.685674 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:16:04.685621    6004 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-b888d0-openshift-default-65d785fbfc-wgpfl" event={"ID":"9303d324-812e-4154-907e-63865d73600f","Type":"ContainerDied","Data":"49f175a89e5b76bfdba4dcd4b2f0a457093292727bca5a16fc09ee1c00a969a2"}
Oct 30 21:16:04.685674 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:16:04.685653    6004 scope.go:122] "RemoveContainer" containerID="87638f5c802f78c4083a89691d97e9abd9b173ce015022cb8b15e823d261d1b6"
Oct 30 21:16:04.696741 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:16:04.696717    6004 scope.go:122] "RemoveContainer" containerID="87638f5c802f78c4083a89691d97e9abd9b173ce015022cb8b15e823d261d1b6"
Oct 30 21:16:04.697120 ip-10-0-138-85 kubenswrapper[6004]: E1030 21:16:04.697101    6004 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"87638f5c802f78c4083a89691d97e9abd9b173ce015022cb8b15e823d261d1b6\": container with ID starting with 87638f5c802f78c4083a89691d97e9abd9b173ce015022cb8b15e823d261d1b6 not found: ID does not exist" containerID="87638f5c802f78c4083a89691d97e9abd9b173ce015022cb8b15e823d261d1b6"
Oct 30 21:16:04.697186 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:16:04.697131    6004 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"87638f5c802f78c4083a89691d97e9abd9b173ce015022cb8b15e823d261d1b6"} err="failed to get container status \"87638f5c802f78c4083a89691d97e9abd9b173ce015022cb8b15e823d261d1b6\": rpc error: code = NotFound desc = could not find container \"87638f5c802f78c4083a89691d97e9abd9b173ce015022cb8b15e823d261d1b6\": container with ID starting with 87638f5c802f78c4083a89691d97e9abd9b173ce015022cb8b15e823d261d1b6 not found: ID does not exist"
Oct 30 21:16:04.702474 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:16:04.702450    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/9303d324-812e-4154-907e-63865d73600f-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9303d324-812e-4154-907e-63865d73600f-istio-envoy\") pod \"9303d324-812e-4154-907e-63865d73600f\" (UID: \"9303d324-812e-4154-907e-63865d73600f\") "
Oct 30 21:16:04.702582 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:16:04.702518    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/9303d324-812e-4154-907e-63865d73600f-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9303d324-812e-4154-907e-63865d73600f-istiod-ca-cert\") pod \"9303d324-812e-4154-907e-63865d73600f\" (UID: \"9303d324-812e-4154-907e-63865d73600f\") "
Oct 30 21:16:04.702582 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:16:04.702549    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/9303d324-812e-4154-907e-63865d73600f-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9303d324-812e-4154-907e-63865d73600f-workload-certs\") pod \"9303d324-812e-4154-907e-63865d73600f\" (UID: \"9303d324-812e-4154-907e-63865d73600f\") "
Oct 30 21:16:04.702718 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:16:04.702694    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/9303d324-812e-4154-907e-63865d73600f-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9303d324-812e-4154-907e-63865d73600f-istio-podinfo\") pod \"9303d324-812e-4154-907e-63865d73600f\" (UID: \"9303d324-812e-4154-907e-63865d73600f\") "
Oct 30 21:16:04.702775 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:16:04.702752    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/9303d324-812e-4154-907e-63865d73600f-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9303d324-812e-4154-907e-63865d73600f-workload-socket\") pod \"9303d324-812e-4154-907e-63865d73600f\" (UID: \"9303d324-812e-4154-907e-63865d73600f\") "
Oct 30 21:16:04.702857 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:16:04.702837    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9303d324-812e-4154-907e-63865d73600f-workload-certs" pod "9303d324-812e-4154-907e-63865d73600f" (UID: "9303d324-812e-4154-907e-63865d73600f"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:16:04.702906 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:16:04.702874    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/9303d324-812e-4154-907e-63865d73600f-istio-token\" (UniqueName: \"kubernetes.io/projected/9303d324-812e-4154-907e-63865d73600f-istio-token\") pod \"9303d324-812e-4154-907e-63865d73600f\" (UID: \"9303d324-812e-4154-907e-63865d73600f\") "
Oct 30 21:16:04.702955 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:16:04.702915    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9303d324-812e-4154-907e-63865d73600f-istiod-ca-cert" pod "9303d324-812e-4154-907e-63865d73600f" (UID: "9303d324-812e-4154-907e-63865d73600f"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:16:04.702955 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:16:04.702920    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/9303d324-812e-4154-907e-63865d73600f-kube-api-access-q52px\" (UniqueName: \"kubernetes.io/projected/9303d324-812e-4154-907e-63865d73600f-kube-api-access-q52px\") pod \"9303d324-812e-4154-907e-63865d73600f\" (UID: \"9303d324-812e-4154-907e-63865d73600f\") "
Oct 30 21:16:04.703064 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:16:04.702975    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/9303d324-812e-4154-907e-63865d73600f-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9303d324-812e-4154-907e-63865d73600f-istio-data\") pod \"9303d324-812e-4154-907e-63865d73600f\" (UID: \"9303d324-812e-4154-907e-63865d73600f\") "
Oct 30 21:16:04.703133 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:16:04.703093    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/9303d324-812e-4154-907e-63865d73600f-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9303d324-812e-4154-907e-63865d73600f-credential-socket\") pod \"9303d324-812e-4154-907e-63865d73600f\" (UID: \"9303d324-812e-4154-907e-63865d73600f\") "
Oct 30 21:16:04.703133 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:16:04.703104    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9303d324-812e-4154-907e-63865d73600f-workload-socket" pod "9303d324-812e-4154-907e-63865d73600f" (UID: "9303d324-812e-4154-907e-63865d73600f"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:16:04.703341 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:16:04.703291    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9303d324-812e-4154-907e-63865d73600f-istio-data" pod "9303d324-812e-4154-907e-63865d73600f" (UID: "9303d324-812e-4154-907e-63865d73600f"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:16:04.703477 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:16:04.703354    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9303d324-812e-4154-907e-63865d73600f-credential-socket" pod "9303d324-812e-4154-907e-63865d73600f" (UID: "9303d324-812e-4154-907e-63865d73600f"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:16:04.703715 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:16:04.703694    6004 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9303d324-812e-4154-907e-63865d73600f-workload-socket\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:16:04.703791 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:16:04.703721    6004 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9303d324-812e-4154-907e-63865d73600f-istio-data\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:16:04.703791 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:16:04.703737    6004 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9303d324-812e-4154-907e-63865d73600f-credential-socket\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:16:04.703791 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:16:04.703752    6004 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9303d324-812e-4154-907e-63865d73600f-istiod-ca-cert\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:16:04.703791 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:16:04.703766    6004 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9303d324-812e-4154-907e-63865d73600f-workload-certs\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:16:04.704831 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:16:04.704803    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9303d324-812e-4154-907e-63865d73600f-istio-envoy" pod "9303d324-812e-4154-907e-63865d73600f" (UID: "9303d324-812e-4154-907e-63865d73600f"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:16:04.705008 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:16:04.704984    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9303d324-812e-4154-907e-63865d73600f-istio-token" pod "9303d324-812e-4154-907e-63865d73600f" (UID: "9303d324-812e-4154-907e-63865d73600f"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:16:04.705138 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:16:04.705117    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/9303d324-812e-4154-907e-63865d73600f-istio-podinfo" pod "9303d324-812e-4154-907e-63865d73600f" (UID: "9303d324-812e-4154-907e-63865d73600f"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 21:16:04.705253 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:16:04.705235    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9303d324-812e-4154-907e-63865d73600f-kube-api-access-q52px" pod "9303d324-812e-4154-907e-63865d73600f" (UID: "9303d324-812e-4154-907e-63865d73600f"). InnerVolumeSpecName "kube-api-access-q52px". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:16:04.804810 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:16:04.804727    6004 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9303d324-812e-4154-907e-63865d73600f-istio-envoy\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:16:04.804810 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:16:04.804759    6004 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9303d324-812e-4154-907e-63865d73600f-istio-podinfo\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:16:04.804810 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:16:04.804770    6004 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9303d324-812e-4154-907e-63865d73600f-istio-token\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:16:04.804810 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:16:04.804780    6004 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q52px\" (UniqueName: \"kubernetes.io/projected/9303d324-812e-4154-907e-63865d73600f-kube-api-access-q52px\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:16:05.111222 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:16:05.111141    6004 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-b888d0-openshift-default-65d785fbfc-wgpfl"]
Oct 30 21:16:05.116876 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:16:05.116842    6004 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-a-b888d0-openshift-default-65d785fbfc-wgpfl"]
Oct 30 21:16:06.240817 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:16:06.240745    6004 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="9303d324-812e-4154-907e-63865d73600f" path="/var/lib/kubelet/pods/9303d324-812e-4154-907e-63865d73600f/volumes"
Oct 30 21:16:07.713188 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:16:07.713045    6004 generic.go:356] "Generic (PLEG): container finished" podID="f2a479c8-1fe5-4264-b6cd-dafa68621543" containerID="20df18f4a46a47959d4e7dd2ce70a219163e05c85d5a53c51b4466873d901ae4" exitCode=0
Oct 30 21:16:07.713661 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:16:07.713339    6004 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-d061d0-openshift-default-86b87f495-rlgwt" event={"ID":"f2a479c8-1fe5-4264-b6cd-dafa68621543","Type":"ContainerDied","Data":"20df18f4a46a47959d4e7dd2ce70a219163e05c85d5a53c51b4466873d901ae4"}
Oct 30 21:16:07.804321 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:16:07.804289    6004 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-d061d0-openshift-default-86b87f495-rlgwt"
Oct 30 21:16:07.842762 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:16:07.842723    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/f2a479c8-1fe5-4264-b6cd-dafa68621543-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f2a479c8-1fe5-4264-b6cd-dafa68621543-istiod-ca-cert\") pod \"f2a479c8-1fe5-4264-b6cd-dafa68621543\" (UID: \"f2a479c8-1fe5-4264-b6cd-dafa68621543\") "
Oct 30 21:16:07.842932 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:16:07.842811    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/f2a479c8-1fe5-4264-b6cd-dafa68621543-kube-api-access-9hzfh\" (UniqueName: \"kubernetes.io/projected/f2a479c8-1fe5-4264-b6cd-dafa68621543-kube-api-access-9hzfh\") pod \"f2a479c8-1fe5-4264-b6cd-dafa68621543\" (UID: \"f2a479c8-1fe5-4264-b6cd-dafa68621543\") "
Oct 30 21:16:07.842932 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:16:07.842901    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/f2a479c8-1fe5-4264-b6cd-dafa68621543-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f2a479c8-1fe5-4264-b6cd-dafa68621543-credential-socket\") pod \"f2a479c8-1fe5-4264-b6cd-dafa68621543\" (UID: \"f2a479c8-1fe5-4264-b6cd-dafa68621543\") "
Oct 30 21:16:07.843013 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:16:07.842982    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/f2a479c8-1fe5-4264-b6cd-dafa68621543-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f2a479c8-1fe5-4264-b6cd-dafa68621543-istio-envoy\") pod \"f2a479c8-1fe5-4264-b6cd-dafa68621543\" (UID: \"f2a479c8-1fe5-4264-b6cd-dafa68621543\") "
Oct 30 21:16:07.843136 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:16:07.843119    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/f2a479c8-1fe5-4264-b6cd-dafa68621543-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f2a479c8-1fe5-4264-b6cd-dafa68621543-istio-data\") pod \"f2a479c8-1fe5-4264-b6cd-dafa68621543\" (UID: \"f2a479c8-1fe5-4264-b6cd-dafa68621543\") "
Oct 30 21:16:07.843221 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:16:07.843179    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/f2a479c8-1fe5-4264-b6cd-dafa68621543-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f2a479c8-1fe5-4264-b6cd-dafa68621543-workload-certs\") pod \"f2a479c8-1fe5-4264-b6cd-dafa68621543\" (UID: \"f2a479c8-1fe5-4264-b6cd-dafa68621543\") "
Oct 30 21:16:07.843275 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:16:07.843240    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/f2a479c8-1fe5-4264-b6cd-dafa68621543-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f2a479c8-1fe5-4264-b6cd-dafa68621543-istio-podinfo\") pod \"f2a479c8-1fe5-4264-b6cd-dafa68621543\" (UID: \"f2a479c8-1fe5-4264-b6cd-dafa68621543\") "
Oct 30 21:16:07.843340 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:16:07.843302    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/f2a479c8-1fe5-4264-b6cd-dafa68621543-istio-token\" (UniqueName: \"kubernetes.io/projected/f2a479c8-1fe5-4264-b6cd-dafa68621543-istio-token\") pod \"f2a479c8-1fe5-4264-b6cd-dafa68621543\" (UID: \"f2a479c8-1fe5-4264-b6cd-dafa68621543\") "
Oct 30 21:16:07.843393 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:16:07.843178    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f2a479c8-1fe5-4264-b6cd-dafa68621543-credential-socket" pod "f2a479c8-1fe5-4264-b6cd-dafa68621543" (UID: "f2a479c8-1fe5-4264-b6cd-dafa68621543"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:16:07.843393 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:16:07.843369    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f2a479c8-1fe5-4264-b6cd-dafa68621543-istio-data" pod "f2a479c8-1fe5-4264-b6cd-dafa68621543" (UID: "f2a479c8-1fe5-4264-b6cd-dafa68621543"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:16:07.843393 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:16:07.843246    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f2a479c8-1fe5-4264-b6cd-dafa68621543-istiod-ca-cert" pod "f2a479c8-1fe5-4264-b6cd-dafa68621543" (UID: "f2a479c8-1fe5-4264-b6cd-dafa68621543"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:16:07.843559 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:16:07.843482    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/f2a479c8-1fe5-4264-b6cd-dafa68621543-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f2a479c8-1fe5-4264-b6cd-dafa68621543-workload-socket\") pod \"f2a479c8-1fe5-4264-b6cd-dafa68621543\" (UID: \"f2a479c8-1fe5-4264-b6cd-dafa68621543\") "
Oct 30 21:16:07.843559 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:16:07.843524    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f2a479c8-1fe5-4264-b6cd-dafa68621543-workload-certs" pod "f2a479c8-1fe5-4264-b6cd-dafa68621543" (UID: "f2a479c8-1fe5-4264-b6cd-dafa68621543"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:16:07.844111 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:16:07.843815    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f2a479c8-1fe5-4264-b6cd-dafa68621543-workload-socket" pod "f2a479c8-1fe5-4264-b6cd-dafa68621543" (UID: "f2a479c8-1fe5-4264-b6cd-dafa68621543"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:16:07.844111 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:16:07.843993    6004 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f2a479c8-1fe5-4264-b6cd-dafa68621543-workload-socket\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:16:07.844111 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:16:07.844013    6004 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f2a479c8-1fe5-4264-b6cd-dafa68621543-istiod-ca-cert\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:16:07.844111 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:16:07.844028    6004 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f2a479c8-1fe5-4264-b6cd-dafa68621543-credential-socket\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:16:07.844111 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:16:07.844042    6004 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f2a479c8-1fe5-4264-b6cd-dafa68621543-istio-data\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:16:07.844111 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:16:07.844088    6004 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f2a479c8-1fe5-4264-b6cd-dafa68621543-workload-certs\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:16:07.845689 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:16:07.845667    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f2a479c8-1fe5-4264-b6cd-dafa68621543-istio-token" pod "f2a479c8-1fe5-4264-b6cd-dafa68621543" (UID: "f2a479c8-1fe5-4264-b6cd-dafa68621543"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:16:07.845783 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:16:07.845701    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f2a479c8-1fe5-4264-b6cd-dafa68621543-kube-api-access-9hzfh" pod "f2a479c8-1fe5-4264-b6cd-dafa68621543" (UID: "f2a479c8-1fe5-4264-b6cd-dafa68621543"). InnerVolumeSpecName "kube-api-access-9hzfh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:16:07.845946 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:16:07.845925    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/f2a479c8-1fe5-4264-b6cd-dafa68621543-istio-podinfo" pod "f2a479c8-1fe5-4264-b6cd-dafa68621543" (UID: "f2a479c8-1fe5-4264-b6cd-dafa68621543"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 21:16:07.846009 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:16:07.845993    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f2a479c8-1fe5-4264-b6cd-dafa68621543-istio-envoy" pod "f2a479c8-1fe5-4264-b6cd-dafa68621543" (UID: "f2a479c8-1fe5-4264-b6cd-dafa68621543"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:16:07.945268 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:16:07.945224    6004 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9hzfh\" (UniqueName: \"kubernetes.io/projected/f2a479c8-1fe5-4264-b6cd-dafa68621543-kube-api-access-9hzfh\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:16:07.945268 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:16:07.945257    6004 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f2a479c8-1fe5-4264-b6cd-dafa68621543-istio-envoy\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:16:07.945268 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:16:07.945271    6004 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f2a479c8-1fe5-4264-b6cd-dafa68621543-istio-podinfo\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:16:07.945588 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:16:07.945285    6004 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f2a479c8-1fe5-4264-b6cd-dafa68621543-istio-token\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:16:08.721862 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:16:08.721830    6004 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-d061d0-openshift-default-86b87f495-rlgwt"
Oct 30 21:16:08.722399 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:16:08.721830    6004 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-d061d0-openshift-default-86b87f495-rlgwt" event={"ID":"f2a479c8-1fe5-4264-b6cd-dafa68621543","Type":"ContainerDied","Data":"dab6a4de056b702cab489c009bb5a1805663f5bd84b4ad971ad4be8179afd1e1"}
Oct 30 21:16:08.722399 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:16:08.721970    6004 scope.go:122] "RemoveContainer" containerID="20df18f4a46a47959d4e7dd2ce70a219163e05c85d5a53c51b4466873d901ae4"
Oct 30 21:16:08.955163 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:16:08.955132    6004 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w2-d061d0-openshift-default-86b87f495-rlgwt"]
Oct 30 21:16:09.004602 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:16:09.004523    6004 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w2-d061d0-openshift-default-86b87f495-rlgwt"]
Oct 30 21:16:10.231716 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:16:10.231681    6004 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="f2a479c8-1fe5-4264-b6cd-dafa68621543" path="/var/lib/kubelet/pods/f2a479c8-1fe5-4264-b6cd-dafa68621543/volumes"
Oct 30 21:16:14.287010 ip-10-0-138-85 kubenswrapper[6004]: E1030 21:16:14.286970    6004 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-zz4wr" containerName="extractor"
Oct 30 21:16:27.118310 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:16:27.118272    6004 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-b888d0-7c4bb7ffc9-l6dd9"]
Oct 30 21:16:27.118881 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:16:27.118510    6004 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-b888d0-7c4bb7ffc9-l6dd9" podUID="67b159b6-480b-4764-ac2d-5c97a8fee67b" containerName="maas-api" containerID="cri-o://1d9e9150d86749827aedfec3200362a8b5c6175f4b19da10b4babc86221fbaf3" gracePeriod=30
Oct 30 21:16:27.829780 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:16:27.829754    6004 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-b888d0-7c4bb7ffc9-l6dd9"
Oct 30 21:16:27.835182 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:16:27.835143    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/67b159b6-480b-4764-ac2d-5c97a8fee67b-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/67b159b6-480b-4764-ac2d-5c97a8fee67b-maas-api-tls\") pod \"67b159b6-480b-4764-ac2d-5c97a8fee67b\" (UID: \"67b159b6-480b-4764-ac2d-5c97a8fee67b\") "
Oct 30 21:16:27.835347 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:16:27.835258    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/67b159b6-480b-4764-ac2d-5c97a8fee67b-metrics-certs\" (UniqueName: \"kubernetes.io/secret/67b159b6-480b-4764-ac2d-5c97a8fee67b-metrics-certs\") pod \"67b159b6-480b-4764-ac2d-5c97a8fee67b\" (UID: \"67b159b6-480b-4764-ac2d-5c97a8fee67b\") "
Oct 30 21:16:27.836102 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:16:27.835410    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/67b159b6-480b-4764-ac2d-5c97a8fee67b-kube-api-access-4l6j2\" (UniqueName: \"kubernetes.io/projected/67b159b6-480b-4764-ac2d-5c97a8fee67b-kube-api-access-4l6j2\") pod \"67b159b6-480b-4764-ac2d-5c97a8fee67b\" (UID: \"67b159b6-480b-4764-ac2d-5c97a8fee67b\") "
Oct 30 21:16:27.836102 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:16:27.835501    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/67b159b6-480b-4764-ac2d-5c97a8fee67b-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/67b159b6-480b-4764-ac2d-5c97a8fee67b-openshift-service-ca\") pod \"67b159b6-480b-4764-ac2d-5c97a8fee67b\" (UID: \"67b159b6-480b-4764-ac2d-5c97a8fee67b\") "
Oct 30 21:16:27.836377 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:16:27.836348    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/67b159b6-480b-4764-ac2d-5c97a8fee67b-openshift-service-ca" pod "67b159b6-480b-4764-ac2d-5c97a8fee67b" (UID: "67b159b6-480b-4764-ac2d-5c97a8fee67b"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:16:27.842223 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:16:27.842192    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/67b159b6-480b-4764-ac2d-5c97a8fee67b-kube-api-access-4l6j2" pod "67b159b6-480b-4764-ac2d-5c97a8fee67b" (UID: "67b159b6-480b-4764-ac2d-5c97a8fee67b"). InnerVolumeSpecName "kube-api-access-4l6j2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:16:27.844102 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:16:27.843811    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/67b159b6-480b-4764-ac2d-5c97a8fee67b-maas-api-tls" pod "67b159b6-480b-4764-ac2d-5c97a8fee67b" (UID: "67b159b6-480b-4764-ac2d-5c97a8fee67b"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:16:27.848933 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:16:27.848879    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/67b159b6-480b-4764-ac2d-5c97a8fee67b-metrics-certs" pod "67b159b6-480b-4764-ac2d-5c97a8fee67b" (UID: "67b159b6-480b-4764-ac2d-5c97a8fee67b"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:16:27.881104 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:16:27.880673    6004 generic.go:356] "Generic (PLEG): container finished" podID="67b159b6-480b-4764-ac2d-5c97a8fee67b" containerID="1d9e9150d86749827aedfec3200362a8b5c6175f4b19da10b4babc86221fbaf3" exitCode=0
Oct 30 21:16:27.881104 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:16:27.880855    6004 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-b888d0-7c4bb7ffc9-l6dd9" event={"ID":"67b159b6-480b-4764-ac2d-5c97a8fee67b","Type":"ContainerDied","Data":"1d9e9150d86749827aedfec3200362a8b5c6175f4b19da10b4babc86221fbaf3"}
Oct 30 21:16:27.881104 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:16:27.880907    6004 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-b888d0-7c4bb7ffc9-l6dd9" event={"ID":"67b159b6-480b-4764-ac2d-5c97a8fee67b","Type":"ContainerDied","Data":"66f3aef80d6fac31dcb6418a213121c51b4b47ba9494bf74137e5bcd86021199"}
Oct 30 21:16:27.881104 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:16:27.880940    6004 scope.go:122] "RemoveContainer" containerID="1d9e9150d86749827aedfec3200362a8b5c6175f4b19da10b4babc86221fbaf3"
Oct 30 21:16:27.881742 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:16:27.881679    6004 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-b888d0-7c4bb7ffc9-l6dd9"
Oct 30 21:16:27.909627 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:16:27.909597    6004 scope.go:122] "RemoveContainer" containerID="1d9e9150d86749827aedfec3200362a8b5c6175f4b19da10b4babc86221fbaf3"
Oct 30 21:16:27.909991 ip-10-0-138-85 kubenswrapper[6004]: E1030 21:16:27.909961    6004 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1d9e9150d86749827aedfec3200362a8b5c6175f4b19da10b4babc86221fbaf3\": container with ID starting with 1d9e9150d86749827aedfec3200362a8b5c6175f4b19da10b4babc86221fbaf3 not found: ID does not exist" containerID="1d9e9150d86749827aedfec3200362a8b5c6175f4b19da10b4babc86221fbaf3"
Oct 30 21:16:27.910109 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:16:27.910007    6004 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1d9e9150d86749827aedfec3200362a8b5c6175f4b19da10b4babc86221fbaf3"} err="failed to get container status \"1d9e9150d86749827aedfec3200362a8b5c6175f4b19da10b4babc86221fbaf3\": rpc error: code = NotFound desc = could not find container \"1d9e9150d86749827aedfec3200362a8b5c6175f4b19da10b4babc86221fbaf3\": container with ID starting with 1d9e9150d86749827aedfec3200362a8b5c6175f4b19da10b4babc86221fbaf3 not found: ID does not exist"
Oct 30 21:16:27.942072 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:16:27.938891    6004 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4l6j2\" (UniqueName: \"kubernetes.io/projected/67b159b6-480b-4764-ac2d-5c97a8fee67b-kube-api-access-4l6j2\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:16:27.942072 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:16:27.938930    6004 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/67b159b6-480b-4764-ac2d-5c97a8fee67b-openshift-service-ca\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:16:27.942072 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:16:27.938946    6004 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/67b159b6-480b-4764-ac2d-5c97a8fee67b-maas-api-tls\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:16:27.942072 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:16:27.938960    6004 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/67b159b6-480b-4764-ac2d-5c97a8fee67b-metrics-certs\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:16:28.091139 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:16:28.087448    6004 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-b888d0-7c4bb7ffc9-l6dd9"]
Oct 30 21:16:28.091514 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:16:28.091488    6004 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-b888d0-7c4bb7ffc9-l6dd9"]
Oct 30 21:16:28.252101 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:16:28.251193    6004 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="67b159b6-480b-4764-ac2d-5c97a8fee67b" path="/var/lib/kubelet/pods/67b159b6-480b-4764-ac2d-5c97a8fee67b/volumes"
Oct 30 21:16:36.928242 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:16:36.928201    6004 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-b888d0-openshift-default-65d785fbfc-q2g4z"]
Oct 30 21:16:36.928732 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:16:36.928431    6004 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-api-a-b888d0-openshift-default-65d785fbfc-q2g4z" podUID="b3ca1b55-1094-43ae-851a-58441b3cbb66" containerName="istio-proxy" containerID="cri-o://d59ec281660ec50fa0597ca05f39d8c79f598b3fd7318b52d91a66b60dff6202" gracePeriod=30
Oct 30 21:16:42.216056 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:16:42.215988    6004 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-b888d0-openshift-default-65d785fbfc-q2g4z"
Oct 30 21:16:42.313179 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:16:42.313149    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/b3ca1b55-1094-43ae-851a-58441b3cbb66-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b3ca1b55-1094-43ae-851a-58441b3cbb66-istio-envoy\") pod \"b3ca1b55-1094-43ae-851a-58441b3cbb66\" (UID: \"b3ca1b55-1094-43ae-851a-58441b3cbb66\") "
Oct 30 21:16:42.313346 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:16:42.313210    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/b3ca1b55-1094-43ae-851a-58441b3cbb66-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b3ca1b55-1094-43ae-851a-58441b3cbb66-istiod-ca-cert\") pod \"b3ca1b55-1094-43ae-851a-58441b3cbb66\" (UID: \"b3ca1b55-1094-43ae-851a-58441b3cbb66\") "
Oct 30 21:16:42.313346 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:16:42.313232    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/b3ca1b55-1094-43ae-851a-58441b3cbb66-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b3ca1b55-1094-43ae-851a-58441b3cbb66-workload-socket\") pod \"b3ca1b55-1094-43ae-851a-58441b3cbb66\" (UID: \"b3ca1b55-1094-43ae-851a-58441b3cbb66\") "
Oct 30 21:16:42.313346 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:16:42.313263    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/b3ca1b55-1094-43ae-851a-58441b3cbb66-kube-api-access-mfmjc\" (UniqueName: \"kubernetes.io/projected/b3ca1b55-1094-43ae-851a-58441b3cbb66-kube-api-access-mfmjc\") pod \"b3ca1b55-1094-43ae-851a-58441b3cbb66\" (UID: \"b3ca1b55-1094-43ae-851a-58441b3cbb66\") "
Oct 30 21:16:42.313346 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:16:42.313327    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/b3ca1b55-1094-43ae-851a-58441b3cbb66-istio-token\" (UniqueName: \"kubernetes.io/projected/b3ca1b55-1094-43ae-851a-58441b3cbb66-istio-token\") pod \"b3ca1b55-1094-43ae-851a-58441b3cbb66\" (UID: \"b3ca1b55-1094-43ae-851a-58441b3cbb66\") "
Oct 30 21:16:42.313530 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:16:42.313398    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/b3ca1b55-1094-43ae-851a-58441b3cbb66-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b3ca1b55-1094-43ae-851a-58441b3cbb66-istio-data\") pod \"b3ca1b55-1094-43ae-851a-58441b3cbb66\" (UID: \"b3ca1b55-1094-43ae-851a-58441b3cbb66\") "
Oct 30 21:16:42.313530 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:16:42.313442    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/b3ca1b55-1094-43ae-851a-58441b3cbb66-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b3ca1b55-1094-43ae-851a-58441b3cbb66-credential-socket\") pod \"b3ca1b55-1094-43ae-851a-58441b3cbb66\" (UID: \"b3ca1b55-1094-43ae-851a-58441b3cbb66\") "
Oct 30 21:16:42.313630 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:16:42.313524    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b3ca1b55-1094-43ae-851a-58441b3cbb66-workload-socket" pod "b3ca1b55-1094-43ae-851a-58441b3cbb66" (UID: "b3ca1b55-1094-43ae-851a-58441b3cbb66"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:16:42.313630 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:16:42.313550    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/b3ca1b55-1094-43ae-851a-58441b3cbb66-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b3ca1b55-1094-43ae-851a-58441b3cbb66-istio-podinfo\") pod \"b3ca1b55-1094-43ae-851a-58441b3cbb66\" (UID: \"b3ca1b55-1094-43ae-851a-58441b3cbb66\") "
Oct 30 21:16:42.313630 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:16:42.313615    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/b3ca1b55-1094-43ae-851a-58441b3cbb66-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b3ca1b55-1094-43ae-851a-58441b3cbb66-workload-certs\") pod \"b3ca1b55-1094-43ae-851a-58441b3cbb66\" (UID: \"b3ca1b55-1094-43ae-851a-58441b3cbb66\") "
Oct 30 21:16:42.313847 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:16:42.313754    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b3ca1b55-1094-43ae-851a-58441b3cbb66-credential-socket" pod "b3ca1b55-1094-43ae-851a-58441b3cbb66" (UID: "b3ca1b55-1094-43ae-851a-58441b3cbb66"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:16:42.313847 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:16:42.313773    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b3ca1b55-1094-43ae-851a-58441b3cbb66-istio-data" pod "b3ca1b55-1094-43ae-851a-58441b3cbb66" (UID: "b3ca1b55-1094-43ae-851a-58441b3cbb66"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:16:42.313983 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:16:42.313956    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b3ca1b55-1094-43ae-851a-58441b3cbb66-workload-certs" pod "b3ca1b55-1094-43ae-851a-58441b3cbb66" (UID: "b3ca1b55-1094-43ae-851a-58441b3cbb66"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:16:42.314068 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:16:42.313981    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b3ca1b55-1094-43ae-851a-58441b3cbb66-istiod-ca-cert" pod "b3ca1b55-1094-43ae-851a-58441b3cbb66" (UID: "b3ca1b55-1094-43ae-851a-58441b3cbb66"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:16:42.314196 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:16:42.314181    6004 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b3ca1b55-1094-43ae-851a-58441b3cbb66-istiod-ca-cert\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:16:42.314264 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:16:42.314197    6004 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b3ca1b55-1094-43ae-851a-58441b3cbb66-workload-socket\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:16:42.314264 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:16:42.314207    6004 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b3ca1b55-1094-43ae-851a-58441b3cbb66-istio-data\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:16:42.314264 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:16:42.314216    6004 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b3ca1b55-1094-43ae-851a-58441b3cbb66-credential-socket\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:16:42.314264 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:16:42.314224    6004 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b3ca1b55-1094-43ae-851a-58441b3cbb66-workload-certs\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:16:42.315476 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:16:42.315451    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b3ca1b55-1094-43ae-851a-58441b3cbb66-istio-envoy" pod "b3ca1b55-1094-43ae-851a-58441b3cbb66" (UID: "b3ca1b55-1094-43ae-851a-58441b3cbb66"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:16:42.315804 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:16:42.315776    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b3ca1b55-1094-43ae-851a-58441b3cbb66-kube-api-access-mfmjc" pod "b3ca1b55-1094-43ae-851a-58441b3cbb66" (UID: "b3ca1b55-1094-43ae-851a-58441b3cbb66"). InnerVolumeSpecName "kube-api-access-mfmjc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:16:42.315937 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:16:42.315918    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/b3ca1b55-1094-43ae-851a-58441b3cbb66-istio-podinfo" pod "b3ca1b55-1094-43ae-851a-58441b3cbb66" (UID: "b3ca1b55-1094-43ae-851a-58441b3cbb66"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 21:16:42.315984 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:16:42.315921    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b3ca1b55-1094-43ae-851a-58441b3cbb66-istio-token" pod "b3ca1b55-1094-43ae-851a-58441b3cbb66" (UID: "b3ca1b55-1094-43ae-851a-58441b3cbb66"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:16:42.415418 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:16:42.415370    6004 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b3ca1b55-1094-43ae-851a-58441b3cbb66-istio-envoy\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:16:42.415418 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:16:42.415413    6004 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mfmjc\" (UniqueName: \"kubernetes.io/projected/b3ca1b55-1094-43ae-851a-58441b3cbb66-kube-api-access-mfmjc\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:16:42.415418 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:16:42.415423    6004 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b3ca1b55-1094-43ae-851a-58441b3cbb66-istio-token\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:16:42.415712 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:16:42.415432    6004 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b3ca1b55-1094-43ae-851a-58441b3cbb66-istio-podinfo\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:16:42.735908 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:16:42.735872    6004 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w5-2b425d/distinct-w5-2b425d-kserve-dd4dcf7f-b227k"]
Oct 30 21:16:43.008897 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:16:43.008809    6004 generic.go:356] "Generic (PLEG): container finished" podID="b3ca1b55-1094-43ae-851a-58441b3cbb66" containerID="d59ec281660ec50fa0597ca05f39d8c79f598b3fd7318b52d91a66b60dff6202" exitCode=0
Oct 30 21:16:43.008897 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:16:43.008858    6004 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-b888d0-openshift-default-65d785fbfc-q2g4z"
Oct 30 21:16:43.009112 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:16:43.008892    6004 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-b888d0-openshift-default-65d785fbfc-q2g4z" event={"ID":"b3ca1b55-1094-43ae-851a-58441b3cbb66","Type":"ContainerDied","Data":"d59ec281660ec50fa0597ca05f39d8c79f598b3fd7318b52d91a66b60dff6202"}
Oct 30 21:16:43.009112 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:16:43.008943    6004 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-b888d0-openshift-default-65d785fbfc-q2g4z" event={"ID":"b3ca1b55-1094-43ae-851a-58441b3cbb66","Type":"ContainerDied","Data":"cd2f39189d39e7735de7773672eea3eef5e3662a844ec24c17c865c887a8b719"}
Oct 30 21:16:43.009112 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:16:43.008965    6004 scope.go:122] "RemoveContainer" containerID="d59ec281660ec50fa0597ca05f39d8c79f598b3fd7318b52d91a66b60dff6202"
Oct 30 21:16:43.019995 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:16:43.019976    6004 scope.go:122] "RemoveContainer" containerID="d59ec281660ec50fa0597ca05f39d8c79f598b3fd7318b52d91a66b60dff6202"
Oct 30 21:16:43.020277 ip-10-0-138-85 kubenswrapper[6004]: E1030 21:16:43.020256    6004 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d59ec281660ec50fa0597ca05f39d8c79f598b3fd7318b52d91a66b60dff6202\": container with ID starting with d59ec281660ec50fa0597ca05f39d8c79f598b3fd7318b52d91a66b60dff6202 not found: ID does not exist" containerID="d59ec281660ec50fa0597ca05f39d8c79f598b3fd7318b52d91a66b60dff6202"
Oct 30 21:16:43.020377 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:16:43.020284    6004 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d59ec281660ec50fa0597ca05f39d8c79f598b3fd7318b52d91a66b60dff6202"} err="failed to get container status \"d59ec281660ec50fa0597ca05f39d8c79f598b3fd7318b52d91a66b60dff6202\": rpc error: code = NotFound desc = could not find container \"d59ec281660ec50fa0597ca05f39d8c79f598b3fd7318b52d91a66b60dff6202\": container with ID starting with d59ec281660ec50fa0597ca05f39d8c79f598b3fd7318b52d91a66b60dff6202 not found: ID does not exist"
Oct 30 21:16:43.179236 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:16:43.179198    6004 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-b888d0-openshift-default-65d785fbfc-q2g4z"]
Oct 30 21:16:43.227757 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:16:43.227721    6004 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-a-b888d0-openshift-default-65d785fbfc-q2g4z"]
Oct 30 21:16:44.232325 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:16:44.232284    6004 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="b3ca1b55-1094-43ae-851a-58441b3cbb66" path="/var/lib/kubelet/pods/b3ca1b55-1094-43ae-851a-58441b3cbb66/volumes"
Oct 30 21:16:44.289334 ip-10-0-138-85 kubenswrapper[6004]: E1030 21:16:44.289290    6004 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-zz4wr" containerName="extractor"
Oct 30 21:16:50.131512 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:16:50.131460    6004 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-769df7846c-r8vgx"]
Oct 30 21:16:50.132317 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:16:50.132287    6004 cpu_manager.go:414] "containerMap: removing container" podUID="79165cd4-9579-48e3-99e3-8b6a63c9379c" containerName="maas-api"
Oct 30 21:16:50.132317 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:16:50.132312    6004 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="79165cd4-9579-48e3-99e3-8b6a63c9379c" containerName="maas-api"
Oct 30 21:16:50.132529 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:16:50.132344    6004 cpu_manager.go:414] "containerMap: removing container" podUID="230542f2-9ac3-4abe-83af-8f63a2c3c240" containerName="istio-proxy"
Oct 30 21:16:50.132529 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:16:50.132352    6004 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="230542f2-9ac3-4abe-83af-8f63a2c3c240" containerName="istio-proxy"
Oct 30 21:16:50.132529 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:16:50.132365    6004 cpu_manager.go:414] "containerMap: removing container" podUID="d4242313-4c6a-409c-a1ed-8c7885206928" containerName="maas-api"
Oct 30 21:16:50.132529 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:16:50.132373    6004 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="d4242313-4c6a-409c-a1ed-8c7885206928" containerName="maas-api"
Oct 30 21:16:50.132529 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:16:50.132386    6004 cpu_manager.go:414] "containerMap: removing container" podUID="18f44298-4c12-4e81-942d-f8fdee2e968f" containerName="istio-proxy"
Oct 30 21:16:50.132529 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:16:50.132393    6004 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="18f44298-4c12-4e81-942d-f8fdee2e968f" containerName="istio-proxy"
Oct 30 21:16:50.132529 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:16:50.132407    6004 cpu_manager.go:414] "containerMap: removing container" podUID="118ff52d-4872-4408-b3d2-feab54040b8b" containerName="maas-api"
Oct 30 21:16:50.132529 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:16:50.132414    6004 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="118ff52d-4872-4408-b3d2-feab54040b8b" containerName="maas-api"
Oct 30 21:16:50.132529 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:16:50.132426    6004 cpu_manager.go:414] "containerMap: removing container" podUID="f3c5de2e-a210-4383-932a-3655559a2297" containerName="maas-api"
Oct 30 21:16:50.132529 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:16:50.132432    6004 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="f3c5de2e-a210-4383-932a-3655559a2297" containerName="maas-api"
Oct 30 21:16:50.132529 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:16:50.132443    6004 cpu_manager.go:414] "containerMap: removing container" podUID="67b159b6-480b-4764-ac2d-5c97a8fee67b" containerName="maas-api"
Oct 30 21:16:50.132529 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:16:50.132451    6004 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="67b159b6-480b-4764-ac2d-5c97a8fee67b" containerName="maas-api"
Oct 30 21:16:50.132529 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:16:50.132468    6004 cpu_manager.go:414] "containerMap: removing container" podUID="32264f6c-999b-4bad-bd2e-7664cadc0669" containerName="main"
Oct 30 21:16:50.132529 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:16:50.132475    6004 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="32264f6c-999b-4bad-bd2e-7664cadc0669" containerName="main"
Oct 30 21:16:50.132529 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:16:50.132488    6004 cpu_manager.go:414] "containerMap: removing container" podUID="9303d324-812e-4154-907e-63865d73600f" containerName="istio-proxy"
Oct 30 21:16:50.132529 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:16:50.132495    6004 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="9303d324-812e-4154-907e-63865d73600f" containerName="istio-proxy"
Oct 30 21:16:50.132529 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:16:50.132505    6004 cpu_manager.go:414] "containerMap: removing container" podUID="2193d3b6-6d8c-4060-8337-7d3d431179a9" containerName="maas-api"
Oct 30 21:16:50.132529 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:16:50.132512    6004 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="2193d3b6-6d8c-4060-8337-7d3d431179a9" containerName="maas-api"
Oct 30 21:16:50.132529 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:16:50.132521    6004 cpu_manager.go:414] "containerMap: removing container" podUID="b3ca1b55-1094-43ae-851a-58441b3cbb66" containerName="istio-proxy"
Oct 30 21:16:50.132529 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:16:50.132527    6004 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="b3ca1b55-1094-43ae-851a-58441b3cbb66" containerName="istio-proxy"
Oct 30 21:16:50.132529 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:16:50.132539    6004 cpu_manager.go:414] "containerMap: removing container" podUID="51fcc016-5ad8-4bdd-9720-49a1b448c19e" containerName="istio-proxy"
Oct 30 21:16:50.133861 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:16:50.132546    6004 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="51fcc016-5ad8-4bdd-9720-49a1b448c19e" containerName="istio-proxy"
Oct 30 21:16:50.133861 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:16:50.132558    6004 cpu_manager.go:414] "containerMap: removing container" podUID="f2a479c8-1fe5-4264-b6cd-dafa68621543" containerName="istio-proxy"
Oct 30 21:16:50.133861 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:16:50.132568    6004 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="f2a479c8-1fe5-4264-b6cd-dafa68621543" containerName="istio-proxy"
Oct 30 21:16:50.133861 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:16:50.132578    6004 cpu_manager.go:414] "containerMap: removing container" podUID="552ce26c-3856-42d4-a079-0b9d2309a83c" containerName="maas-api"
Oct 30 21:16:50.133861 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:16:50.132586    6004 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="552ce26c-3856-42d4-a079-0b9d2309a83c" containerName="maas-api"
Oct 30 21:16:50.133861 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:16:50.132603    6004 cpu_manager.go:414] "containerMap: removing container" podUID="769fd172-1d4c-4cd3-8eda-e8d4850c0f67" containerName="main"
Oct 30 21:16:50.133861 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:16:50.132612    6004 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="769fd172-1d4c-4cd3-8eda-e8d4850c0f67" containerName="main"
Oct 30 21:16:50.133861 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:16:50.132623    6004 cpu_manager.go:414] "containerMap: removing container" podUID="f2d38836-68af-4498-a047-ae6e99704b53" containerName="maas-api"
Oct 30 21:16:50.133861 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:16:50.132630    6004 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="f2d38836-68af-4498-a047-ae6e99704b53" containerName="maas-api"
Oct 30 21:16:50.133861 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:16:50.132645    6004 cpu_manager.go:414] "containerMap: removing container" podUID="4812c56a-c9f8-42fb-b68a-b9de077eb943" containerName="istio-proxy"
Oct 30 21:16:50.133861 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:16:50.132651    6004 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="4812c56a-c9f8-42fb-b68a-b9de077eb943" containerName="istio-proxy"
Oct 30 21:16:50.133861 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:16:50.132662    6004 cpu_manager.go:414] "containerMap: removing container" podUID="21c116c2-4862-424a-bedf-41fba3b2612d" containerName="istio-proxy"
Oct 30 21:16:50.133861 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:16:50.132669    6004 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="21c116c2-4862-424a-bedf-41fba3b2612d" containerName="istio-proxy"
Oct 30 21:16:50.133861 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:16:50.132696    6004 cpu_manager.go:414] "containerMap: removing container" podUID="9ad52be5-bae9-4663-a915-2d4374812459" containerName="istio-proxy"
Oct 30 21:16:50.133861 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:16:50.132703    6004 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="9ad52be5-bae9-4663-a915-2d4374812459" containerName="istio-proxy"
Oct 30 21:16:50.133861 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:16:50.132713    6004 cpu_manager.go:414] "containerMap: removing container" podUID="801ac95e-5a0b-4e42-a632-33fa0536fc44" containerName="maas-api"
Oct 30 21:16:50.133861 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:16:50.132720    6004 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="801ac95e-5a0b-4e42-a632-33fa0536fc44" containerName="maas-api"
Oct 30 21:16:50.133861 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:16:50.132847    6004 memory_manager.go:365] "RemoveStaleState removing state" podUID="9ad52be5-bae9-4663-a915-2d4374812459" containerName="istio-proxy"
Oct 30 21:16:50.133861 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:16:50.132858    6004 memory_manager.go:365] "RemoveStaleState removing state" podUID="801ac95e-5a0b-4e42-a632-33fa0536fc44" containerName="maas-api"
Oct 30 21:16:50.133861 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:16:50.132871    6004 memory_manager.go:365] "RemoveStaleState removing state" podUID="79165cd4-9579-48e3-99e3-8b6a63c9379c" containerName="maas-api"
Oct 30 21:16:50.133861 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:16:50.132881    6004 memory_manager.go:365] "RemoveStaleState removing state" podUID="230542f2-9ac3-4abe-83af-8f63a2c3c240" containerName="istio-proxy"
Oct 30 21:16:50.133861 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:16:50.132890    6004 memory_manager.go:365] "RemoveStaleState removing state" podUID="d4242313-4c6a-409c-a1ed-8c7885206928" containerName="maas-api"
Oct 30 21:16:50.133861 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:16:50.132898    6004 memory_manager.go:365] "RemoveStaleState removing state" podUID="18f44298-4c12-4e81-942d-f8fdee2e968f" containerName="istio-proxy"
Oct 30 21:16:50.133861 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:16:50.132909    6004 memory_manager.go:365] "RemoveStaleState removing state" podUID="118ff52d-4872-4408-b3d2-feab54040b8b" containerName="maas-api"
Oct 30 21:16:50.133861 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:16:50.132918    6004 memory_manager.go:365] "RemoveStaleState removing state" podUID="f3c5de2e-a210-4383-932a-3655559a2297" containerName="maas-api"
Oct 30 21:16:50.133861 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:16:50.132926    6004 memory_manager.go:365] "RemoveStaleState removing state" podUID="67b159b6-480b-4764-ac2d-5c97a8fee67b" containerName="maas-api"
Oct 30 21:16:50.133861 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:16:50.132937    6004 memory_manager.go:365] "RemoveStaleState removing state" podUID="32264f6c-999b-4bad-bd2e-7664cadc0669" containerName="main"
Oct 30 21:16:50.133861 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:16:50.132945    6004 memory_manager.go:365] "RemoveStaleState removing state" podUID="9303d324-812e-4154-907e-63865d73600f" containerName="istio-proxy"
Oct 30 21:16:50.133861 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:16:50.132954    6004 memory_manager.go:365] "RemoveStaleState removing state" podUID="2193d3b6-6d8c-4060-8337-7d3d431179a9" containerName="maas-api"
Oct 30 21:16:50.133861 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:16:50.132962    6004 memory_manager.go:365] "RemoveStaleState removing state" podUID="b3ca1b55-1094-43ae-851a-58441b3cbb66" containerName="istio-proxy"
Oct 30 21:16:50.133861 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:16:50.132970    6004 memory_manager.go:365] "RemoveStaleState removing state" podUID="51fcc016-5ad8-4bdd-9720-49a1b448c19e" containerName="istio-proxy"
Oct 30 21:16:50.133861 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:16:50.132980    6004 memory_manager.go:365] "RemoveStaleState removing state" podUID="f2a479c8-1fe5-4264-b6cd-dafa68621543" containerName="istio-proxy"
Oct 30 21:16:50.133861 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:16:50.132988    6004 memory_manager.go:365] "RemoveStaleState removing state" podUID="552ce26c-3856-42d4-a079-0b9d2309a83c" containerName="maas-api"
Oct 30 21:16:50.133861 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:16:50.132999    6004 memory_manager.go:365] "RemoveStaleState removing state" podUID="769fd172-1d4c-4cd3-8eda-e8d4850c0f67" containerName="main"
Oct 30 21:16:50.133861 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:16:50.133007    6004 memory_manager.go:365] "RemoveStaleState removing state" podUID="f2d38836-68af-4498-a047-ae6e99704b53" containerName="maas-api"
Oct 30 21:16:50.133861 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:16:50.133016    6004 memory_manager.go:365] "RemoveStaleState removing state" podUID="4812c56a-c9f8-42fb-b68a-b9de077eb943" containerName="istio-proxy"
Oct 30 21:16:50.133861 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:16:50.133024    6004 memory_manager.go:365] "RemoveStaleState removing state" podUID="21c116c2-4862-424a-bedf-41fba3b2612d" containerName="istio-proxy"
Oct 30 21:16:50.138541 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:16:50.138517    6004 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-r8vgx"
Oct 30 21:16:50.245371 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:16:50.245333    6004 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-769df7846c-r8vgx"]
Oct 30 21:16:50.309884 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:16:50.309848    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bb7251a5-aa97-4ee2-a00d-27083704dc60-istio-envoy\") pod \"maas-default-gateway-openshift-default-769df7846c-r8vgx\" (UID: \"bb7251a5-aa97-4ee2-a00d-27083704dc60\") " pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-r8vgx"
Oct 30 21:16:50.309884 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:16:50.309888    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bb7251a5-aa97-4ee2-a00d-27083704dc60-istio-podinfo\") pod \"maas-default-gateway-openshift-default-769df7846c-r8vgx\" (UID: \"bb7251a5-aa97-4ee2-a00d-27083704dc60\") " pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-r8vgx"
Oct 30 21:16:50.310125 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:16:50.309976    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bb7251a5-aa97-4ee2-a00d-27083704dc60-credential-socket\") pod \"maas-default-gateway-openshift-default-769df7846c-r8vgx\" (UID: \"bb7251a5-aa97-4ee2-a00d-27083704dc60\") " pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-r8vgx"
Oct 30 21:16:50.310125 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:16:50.310041    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bb7251a5-aa97-4ee2-a00d-27083704dc60-istio-data\") pod \"maas-default-gateway-openshift-default-769df7846c-r8vgx\" (UID: \"bb7251a5-aa97-4ee2-a00d-27083704dc60\") " pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-r8vgx"
Oct 30 21:16:50.310269 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:16:50.310157    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g748t\" (UniqueName: \"kubernetes.io/projected/bb7251a5-aa97-4ee2-a00d-27083704dc60-kube-api-access-g748t\") pod \"maas-default-gateway-openshift-default-769df7846c-r8vgx\" (UID: \"bb7251a5-aa97-4ee2-a00d-27083704dc60\") " pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-r8vgx"
Oct 30 21:16:50.310269 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:16:50.310198    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bb7251a5-aa97-4ee2-a00d-27083704dc60-workload-socket\") pod \"maas-default-gateway-openshift-default-769df7846c-r8vgx\" (UID: \"bb7251a5-aa97-4ee2-a00d-27083704dc60\") " pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-r8vgx"
Oct 30 21:16:50.310376 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:16:50.310332    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bb7251a5-aa97-4ee2-a00d-27083704dc60-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-769df7846c-r8vgx\" (UID: \"bb7251a5-aa97-4ee2-a00d-27083704dc60\") " pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-r8vgx"
Oct 30 21:16:50.310431 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:16:50.310378    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bb7251a5-aa97-4ee2-a00d-27083704dc60-istio-token\") pod \"maas-default-gateway-openshift-default-769df7846c-r8vgx\" (UID: \"bb7251a5-aa97-4ee2-a00d-27083704dc60\") " pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-r8vgx"
Oct 30 21:16:50.310468 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:16:50.310449    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bb7251a5-aa97-4ee2-a00d-27083704dc60-workload-certs\") pod \"maas-default-gateway-openshift-default-769df7846c-r8vgx\" (UID: \"bb7251a5-aa97-4ee2-a00d-27083704dc60\") " pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-r8vgx"
Oct 30 21:16:50.411891 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:16:50.411811    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bb7251a5-aa97-4ee2-a00d-27083704dc60-istio-envoy\") pod \"maas-default-gateway-openshift-default-769df7846c-r8vgx\" (UID: \"bb7251a5-aa97-4ee2-a00d-27083704dc60\") " pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-r8vgx"
Oct 30 21:16:50.411891 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:16:50.411851    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bb7251a5-aa97-4ee2-a00d-27083704dc60-istio-podinfo\") pod \"maas-default-gateway-openshift-default-769df7846c-r8vgx\" (UID: \"bb7251a5-aa97-4ee2-a00d-27083704dc60\") " pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-r8vgx"
Oct 30 21:16:50.411891 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:16:50.411887    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bb7251a5-aa97-4ee2-a00d-27083704dc60-credential-socket\") pod \"maas-default-gateway-openshift-default-769df7846c-r8vgx\" (UID: \"bb7251a5-aa97-4ee2-a00d-27083704dc60\") " pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-r8vgx"
Oct 30 21:16:50.412190 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:16:50.411925    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bb7251a5-aa97-4ee2-a00d-27083704dc60-istio-data\") pod \"maas-default-gateway-openshift-default-769df7846c-r8vgx\" (UID: \"bb7251a5-aa97-4ee2-a00d-27083704dc60\") " pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-r8vgx"
Oct 30 21:16:50.412190 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:16:50.411998    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g748t\" (UniqueName: \"kubernetes.io/projected/bb7251a5-aa97-4ee2-a00d-27083704dc60-kube-api-access-g748t\") pod \"maas-default-gateway-openshift-default-769df7846c-r8vgx\" (UID: \"bb7251a5-aa97-4ee2-a00d-27083704dc60\") " pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-r8vgx"
Oct 30 21:16:50.412190 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:16:50.412037    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bb7251a5-aa97-4ee2-a00d-27083704dc60-workload-socket\") pod \"maas-default-gateway-openshift-default-769df7846c-r8vgx\" (UID: \"bb7251a5-aa97-4ee2-a00d-27083704dc60\") " pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-r8vgx"
Oct 30 21:16:50.412190 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:16:50.412124    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bb7251a5-aa97-4ee2-a00d-27083704dc60-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-769df7846c-r8vgx\" (UID: \"bb7251a5-aa97-4ee2-a00d-27083704dc60\") " pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-r8vgx"
Oct 30 21:16:50.412190 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:16:50.412154    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bb7251a5-aa97-4ee2-a00d-27083704dc60-istio-token\") pod \"maas-default-gateway-openshift-default-769df7846c-r8vgx\" (UID: \"bb7251a5-aa97-4ee2-a00d-27083704dc60\") " pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-r8vgx"
Oct 30 21:16:50.412439 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:16:50.412195    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bb7251a5-aa97-4ee2-a00d-27083704dc60-workload-certs\") pod \"maas-default-gateway-openshift-default-769df7846c-r8vgx\" (UID: \"bb7251a5-aa97-4ee2-a00d-27083704dc60\") " pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-r8vgx"
Oct 30 21:16:50.412439 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:16:50.412346    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bb7251a5-aa97-4ee2-a00d-27083704dc60-credential-socket\") pod \"maas-default-gateway-openshift-default-769df7846c-r8vgx\" (UID: \"bb7251a5-aa97-4ee2-a00d-27083704dc60\") " pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-r8vgx"
Oct 30 21:16:50.412439 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:16:50.412419    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bb7251a5-aa97-4ee2-a00d-27083704dc60-istio-data\") pod \"maas-default-gateway-openshift-default-769df7846c-r8vgx\" (UID: \"bb7251a5-aa97-4ee2-a00d-27083704dc60\") " pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-r8vgx"
Oct 30 21:16:50.412601 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:16:50.412477    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bb7251a5-aa97-4ee2-a00d-27083704dc60-workload-socket\") pod \"maas-default-gateway-openshift-default-769df7846c-r8vgx\" (UID: \"bb7251a5-aa97-4ee2-a00d-27083704dc60\") " pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-r8vgx"
Oct 30 21:16:50.412601 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:16:50.412573    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bb7251a5-aa97-4ee2-a00d-27083704dc60-workload-certs\") pod \"maas-default-gateway-openshift-default-769df7846c-r8vgx\" (UID: \"bb7251a5-aa97-4ee2-a00d-27083704dc60\") " pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-r8vgx"
Oct 30 21:16:50.412897 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:16:50.412879    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bb7251a5-aa97-4ee2-a00d-27083704dc60-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-769df7846c-r8vgx\" (UID: \"bb7251a5-aa97-4ee2-a00d-27083704dc60\") " pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-r8vgx"
Oct 30 21:16:50.414274 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:16:50.414247    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bb7251a5-aa97-4ee2-a00d-27083704dc60-istio-envoy\") pod \"maas-default-gateway-openshift-default-769df7846c-r8vgx\" (UID: \"bb7251a5-aa97-4ee2-a00d-27083704dc60\") " pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-r8vgx"
Oct 30 21:16:50.414517 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:16:50.414497    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bb7251a5-aa97-4ee2-a00d-27083704dc60-istio-podinfo\") pod \"maas-default-gateway-openshift-default-769df7846c-r8vgx\" (UID: \"bb7251a5-aa97-4ee2-a00d-27083704dc60\") " pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-r8vgx"
Oct 30 21:16:50.471377 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:16:50.471348    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g748t\" (UniqueName: \"kubernetes.io/projected/bb7251a5-aa97-4ee2-a00d-27083704dc60-kube-api-access-g748t\") pod \"maas-default-gateway-openshift-default-769df7846c-r8vgx\" (UID: \"bb7251a5-aa97-4ee2-a00d-27083704dc60\") " pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-r8vgx"
Oct 30 21:16:50.471606 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:16:50.471585    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bb7251a5-aa97-4ee2-a00d-27083704dc60-istio-token\") pod \"maas-default-gateway-openshift-default-769df7846c-r8vgx\" (UID: \"bb7251a5-aa97-4ee2-a00d-27083704dc60\") " pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-r8vgx"
Oct 30 21:16:50.752265 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:16:50.752215    6004 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-r8vgx"
Oct 30 21:16:50.926547 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:16:50.926514    6004 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-d1b889bd-7849b458b6-fqhk7"]
Oct 30 21:16:50.931617 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:16:50.931600    6004 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-d1b889bd-7849b458b6-fqhk7"
Oct 30 21:16:50.986601 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:16:50.986569    6004 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-d1b889bd-serving-cert\""
Oct 30 21:16:50.999652 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:16:50.999611    6004 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-d1b889bd-7849b458b6-fqhk7"]
Oct 30 21:16:51.020231 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:16:51.020152    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e9682eea-c9d5-45ea-b421-587f14489dcf-maas-api-tls\") pod \"maas-api-e2e-mt-d1b889bd-7849b458b6-fqhk7\" (UID: \"e9682eea-c9d5-45ea-b421-587f14489dcf\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-d1b889bd-7849b458b6-fqhk7"
Oct 30 21:16:51.020375 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:16:51.020263    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7bnpw\" (UniqueName: \"kubernetes.io/projected/e9682eea-c9d5-45ea-b421-587f14489dcf-kube-api-access-7bnpw\") pod \"maas-api-e2e-mt-d1b889bd-7849b458b6-fqhk7\" (UID: \"e9682eea-c9d5-45ea-b421-587f14489dcf\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-d1b889bd-7849b458b6-fqhk7"
Oct 30 21:16:51.020458 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:16:51.020432    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e9682eea-c9d5-45ea-b421-587f14489dcf-metrics-certs\") pod \"maas-api-e2e-mt-d1b889bd-7849b458b6-fqhk7\" (UID: \"e9682eea-c9d5-45ea-b421-587f14489dcf\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-d1b889bd-7849b458b6-fqhk7"
Oct 30 21:16:51.020525 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:16:51.020504    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e9682eea-c9d5-45ea-b421-587f14489dcf-openshift-service-ca\") pod \"maas-api-e2e-mt-d1b889bd-7849b458b6-fqhk7\" (UID: \"e9682eea-c9d5-45ea-b421-587f14489dcf\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-d1b889bd-7849b458b6-fqhk7"
Oct 30 21:16:51.122362 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:16:51.122319    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e9682eea-c9d5-45ea-b421-587f14489dcf-metrics-certs\") pod \"maas-api-e2e-mt-d1b889bd-7849b458b6-fqhk7\" (UID: \"e9682eea-c9d5-45ea-b421-587f14489dcf\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-d1b889bd-7849b458b6-fqhk7"
Oct 30 21:16:51.122519 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:16:51.122388    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e9682eea-c9d5-45ea-b421-587f14489dcf-openshift-service-ca\") pod \"maas-api-e2e-mt-d1b889bd-7849b458b6-fqhk7\" (UID: \"e9682eea-c9d5-45ea-b421-587f14489dcf\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-d1b889bd-7849b458b6-fqhk7"
Oct 30 21:16:51.122592 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:16:51.122547    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e9682eea-c9d5-45ea-b421-587f14489dcf-maas-api-tls\") pod \"maas-api-e2e-mt-d1b889bd-7849b458b6-fqhk7\" (UID: \"e9682eea-c9d5-45ea-b421-587f14489dcf\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-d1b889bd-7849b458b6-fqhk7"
Oct 30 21:16:51.122592 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:16:51.122575    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7bnpw\" (UniqueName: \"kubernetes.io/projected/e9682eea-c9d5-45ea-b421-587f14489dcf-kube-api-access-7bnpw\") pod \"maas-api-e2e-mt-d1b889bd-7849b458b6-fqhk7\" (UID: \"e9682eea-c9d5-45ea-b421-587f14489dcf\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-d1b889bd-7849b458b6-fqhk7"
Oct 30 21:16:51.144553 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:16:51.142379    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e9682eea-c9d5-45ea-b421-587f14489dcf-openshift-service-ca\") pod \"maas-api-e2e-mt-d1b889bd-7849b458b6-fqhk7\" (UID: \"e9682eea-c9d5-45ea-b421-587f14489dcf\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-d1b889bd-7849b458b6-fqhk7"
Oct 30 21:16:51.149966 ip-10-0-138-85 kubenswrapper[6004]: E1030 21:16:51.142566    6004 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-mt-d1b889bd-serving-cert: secret "maas-api-e2e-mt-d1b889bd-serving-cert" not found
Oct 30 21:16:51.150408 ip-10-0-138-85 kubenswrapper[6004]: E1030 21:16:51.150390    6004 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e9682eea-c9d5-45ea-b421-587f14489dcf-maas-api-tls podName:e9682eea-c9d5-45ea-b421-587f14489dcf nodeName:}" failed. No retries permitted until 2026-10-30 21:16:51.650360124 +0000 UTC m=+2317.570146242 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/e9682eea-c9d5-45ea-b421-587f14489dcf-maas-api-tls") pod "maas-api-e2e-mt-d1b889bd-7849b458b6-fqhk7" (UID: "e9682eea-c9d5-45ea-b421-587f14489dcf") : secret "maas-api-e2e-mt-d1b889bd-serving-cert" not found
Oct 30 21:16:51.170138 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:16:51.170107    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e9682eea-c9d5-45ea-b421-587f14489dcf-metrics-certs\") pod \"maas-api-e2e-mt-d1b889bd-7849b458b6-fqhk7\" (UID: \"e9682eea-c9d5-45ea-b421-587f14489dcf\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-d1b889bd-7849b458b6-fqhk7"
Oct 30 21:16:51.180469 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:16:51.180437    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7bnpw\" (UniqueName: \"kubernetes.io/projected/e9682eea-c9d5-45ea-b421-587f14489dcf-kube-api-access-7bnpw\") pod \"maas-api-e2e-mt-d1b889bd-7849b458b6-fqhk7\" (UID: \"e9682eea-c9d5-45ea-b421-587f14489dcf\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-d1b889bd-7849b458b6-fqhk7"
Oct 30 21:16:51.219688 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:16:51.219658    6004 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-769df7846c-r8vgx"]
Oct 30 21:16:51.220835 ip-10-0-138-85 kubenswrapper[6004]: W1030 21:16:51.220810    6004 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbb7251a5_aa97_4ee2_a00d_27083704dc60.slice/crio-c20d51ae6995e02cceb59eabb40b679b700792f666239c5952eb0921b9db44c9 WatchSource:0}: Error finding container c20d51ae6995e02cceb59eabb40b679b700792f666239c5952eb0921b9db44c9: Status 404 returned error can't find the container with id c20d51ae6995e02cceb59eabb40b679b700792f666239c5952eb0921b9db44c9
Oct 30 21:16:51.223294 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:16:51.223262    6004 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 21:16:51.223409 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:16:51.223368    6004 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 21:16:51.223478 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:16:51.223419    6004 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 21:16:51.735432 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:16:51.735398    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e9682eea-c9d5-45ea-b421-587f14489dcf-maas-api-tls\") pod \"maas-api-e2e-mt-d1b889bd-7849b458b6-fqhk7\" (UID: \"e9682eea-c9d5-45ea-b421-587f14489dcf\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-d1b889bd-7849b458b6-fqhk7"
Oct 30 21:16:51.738026 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:16:51.737999    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e9682eea-c9d5-45ea-b421-587f14489dcf-maas-api-tls\") pod \"maas-api-e2e-mt-d1b889bd-7849b458b6-fqhk7\" (UID: \"e9682eea-c9d5-45ea-b421-587f14489dcf\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-d1b889bd-7849b458b6-fqhk7"
Oct 30 21:16:51.849094 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:16:51.846769    6004 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-d1b889bd-7849b458b6-fqhk7"
Oct 30 21:16:52.079856 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:16:52.079767    6004 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-r8vgx" event={"ID":"bb7251a5-aa97-4ee2-a00d-27083704dc60","Type":"ContainerStarted","Data":"7a8411a35ea8f25307fe951149291b6a46fa3ff692de68f3154aa196266845e8"}
Oct 30 21:16:52.079856 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:16:52.079828    6004 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-r8vgx" event={"ID":"bb7251a5-aa97-4ee2-a00d-27083704dc60","Type":"ContainerStarted","Data":"c20d51ae6995e02cceb59eabb40b679b700792f666239c5952eb0921b9db44c9"}
Oct 30 21:16:52.253307 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:16:52.252335    6004 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-d1b889bd-7849b458b6-fqhk7"]
Oct 30 21:16:52.262854 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:16:52.262828    6004 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Oct 30 21:16:52.282562 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:16:52.282500    6004 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-r8vgx" podStartSLOduration=2.282481958 podStartE2EDuration="2.282481958s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:16:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:16:52.25428779 +0000 UTC m=+2318.174073909" watchObservedRunningTime="2026-10-30 21:16:52.282481958 +0000 UTC m=+2318.202268076"
Oct 30 21:16:52.755075 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:16:52.753422    6004 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-r8vgx"
Oct 30 21:16:52.760070 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:16:52.759165    6004 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-769df7846c-r8vgx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.112:15021/healthz/ready\": dial tcp 10.132.0.112:15021: connect: connection refused" start-of-body=
Oct 30 21:16:52.760070 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:16:52.759225    6004 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-r8vgx" podUID="bb7251a5-aa97-4ee2-a00d-27083704dc60" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.112:15021/healthz/ready\": dial tcp 10.132.0.112:15021: connect: connection refused"
Oct 30 21:16:53.090406 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:16:53.090371    6004 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-d1b889bd-7849b458b6-fqhk7" event={"ID":"e9682eea-c9d5-45ea-b421-587f14489dcf","Type":"ContainerStarted","Data":"e906219d78e3f9c57796c9b486954de5e7c42d91a0c10e32675df8123f62cebf"}
Oct 30 21:16:53.760555 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:16:53.760518    6004 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-769df7846c-r8vgx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.112:15021/healthz/ready\": dial tcp 10.132.0.112:15021: connect: connection refused" start-of-body=
Oct 30 21:16:53.761192 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:16:53.761150    6004 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-r8vgx" podUID="bb7251a5-aa97-4ee2-a00d-27083704dc60" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.112:15021/healthz/ready\": dial tcp 10.132.0.112:15021: connect: connection refused"
Oct 30 21:16:54.098358 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:16:54.098270    6004 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-d1b889bd-7849b458b6-fqhk7" event={"ID":"e9682eea-c9d5-45ea-b421-587f14489dcf","Type":"ContainerStarted","Data":"c51fdd919f15b347d65bb973bc6e545a99be5612638c3104b16c3073d2e89d15"}
Oct 30 21:16:54.223601 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:16:54.223545    6004 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-d1b889bd-7849b458b6-fqhk7" podStartSLOduration=3.420920013 podStartE2EDuration="4.223530865s" totalImagesPullingTime="802.610852ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:16:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:16:54.221066931 +0000 UTC m=+2320.140853041" watchObservedRunningTime="2026-10-30 21:16:54.223530865 +0000 UTC m=+2320.143316983"
Oct 30 21:16:54.614023 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:16:54.613987    6004 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-cb6404-58c85d58f9-25k64"]
Oct 30 21:16:54.753902 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:16:54.753442    6004 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-769df7846c-r8vgx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.112:15021/healthz/ready\": dial tcp 10.132.0.112:15021: connect: connection refused" start-of-body=
Oct 30 21:16:54.753902 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:16:54.753516    6004 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-r8vgx" podUID="bb7251a5-aa97-4ee2-a00d-27083704dc60" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.112:15021/healthz/ready\": dial tcp 10.132.0.112:15021: connect: connection refused"
Oct 30 21:16:55.105734 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:16:55.105707    6004 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-d1b889bd-7849b458b6-fqhk7"
Oct 30 21:16:55.756472 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:16:55.756436    6004 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-769df7846c-r8vgx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.112:15021/healthz/ready\": dial tcp 10.132.0.112:15021: connect: connection refused" start-of-body=
Oct 30 21:16:55.756750 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:16:55.756723    6004 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-r8vgx" podUID="bb7251a5-aa97-4ee2-a00d-27083704dc60" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.112:15021/healthz/ready\": dial tcp 10.132.0.112:15021: connect: connection refused"
Oct 30 21:16:56.757504 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:16:56.757467    6004 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-769df7846c-r8vgx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.112:15021/healthz/ready\": dial tcp 10.132.0.112:15021: connect: connection refused" start-of-body=
Oct 30 21:16:56.758172 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:16:56.758139    6004 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-r8vgx" podUID="bb7251a5-aa97-4ee2-a00d-27083704dc60" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.112:15021/healthz/ready\": dial tcp 10.132.0.112:15021: connect: connection refused"
Oct 30 21:16:57.752706 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:16:57.752663    6004 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-769df7846c-r8vgx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.112:15021/healthz/ready\": dial tcp 10.132.0.112:15021: connect: connection refused" start-of-body=
Oct 30 21:16:57.752922 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:16:57.752749    6004 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-r8vgx" podUID="bb7251a5-aa97-4ee2-a00d-27083704dc60" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.112:15021/healthz/ready\": dial tcp 10.132.0.112:15021: connect: connection refused"
Oct 30 21:16:57.758925 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:16:57.758888    6004 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-models-e2e-worker-w5-2b425d/distinct-w5-2b425d-kserve-dd4dcf7f-b227k" podUID="802e5037-d6f5-4a37-a95f-b49dda7f8b1b" containerName="main" containerID="cri-o://ad121a89ef0a6902a78c2bc7bd588a38d35dbb834e72cf1672c0417c7211c12e" gracePeriod=45
Oct 30 21:16:58.037836 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:16:58.037803    6004 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w5-2b425d/distinct-w5-2b425d-kserve-dd4dcf7f-b227k"
Oct 30 21:16:58.143764 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:16:58.143724    6004 generic.go:356] "Generic (PLEG): container finished" podID="802e5037-d6f5-4a37-a95f-b49dda7f8b1b" containerID="ad121a89ef0a6902a78c2bc7bd588a38d35dbb834e72cf1672c0417c7211c12e" exitCode=0
Oct 30 21:16:58.144103 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:16:58.143785    6004 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w5-2b425d/distinct-w5-2b425d-kserve-dd4dcf7f-b227k"
Oct 30 21:16:58.144103 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:16:58.143814    6004 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w5-2b425d/distinct-w5-2b425d-kserve-dd4dcf7f-b227k" event={"ID":"802e5037-d6f5-4a37-a95f-b49dda7f8b1b","Type":"ContainerDied","Data":"ad121a89ef0a6902a78c2bc7bd588a38d35dbb834e72cf1672c0417c7211c12e"}
Oct 30 21:16:58.144103 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:16:58.143858    6004 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w5-2b425d/distinct-w5-2b425d-kserve-dd4dcf7f-b227k" event={"ID":"802e5037-d6f5-4a37-a95f-b49dda7f8b1b","Type":"ContainerDied","Data":"f14d0f6e9e2da9de53b047e205a5b8038575b99c21d25a7c366d5044e2a7b378"}
Oct 30 21:16:58.144103 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:16:58.143877    6004 scope.go:122] "RemoveContainer" containerID="ad121a89ef0a6902a78c2bc7bd588a38d35dbb834e72cf1672c0417c7211c12e"
Oct 30 21:16:58.149497 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:16:58.149475    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/802e5037-d6f5-4a37-a95f-b49dda7f8b1b-home\" (UniqueName: \"kubernetes.io/empty-dir/802e5037-d6f5-4a37-a95f-b49dda7f8b1b-home\") pod \"802e5037-d6f5-4a37-a95f-b49dda7f8b1b\" (UID: \"802e5037-d6f5-4a37-a95f-b49dda7f8b1b\") "
Oct 30 21:16:58.149634 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:16:58.149571    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/802e5037-d6f5-4a37-a95f-b49dda7f8b1b-dshm\" (UniqueName: \"kubernetes.io/empty-dir/802e5037-d6f5-4a37-a95f-b49dda7f8b1b-dshm\") pod \"802e5037-d6f5-4a37-a95f-b49dda7f8b1b\" (UID: \"802e5037-d6f5-4a37-a95f-b49dda7f8b1b\") "
Oct 30 21:16:58.149634 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:16:58.149629    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/802e5037-d6f5-4a37-a95f-b49dda7f8b1b-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/802e5037-d6f5-4a37-a95f-b49dda7f8b1b-model-cache\") pod \"802e5037-d6f5-4a37-a95f-b49dda7f8b1b\" (UID: \"802e5037-d6f5-4a37-a95f-b49dda7f8b1b\") "
Oct 30 21:16:58.149784 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:16:58.149685    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/802e5037-d6f5-4a37-a95f-b49dda7f8b1b-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/802e5037-d6f5-4a37-a95f-b49dda7f8b1b-tmp-dir\") pod \"802e5037-d6f5-4a37-a95f-b49dda7f8b1b\" (UID: \"802e5037-d6f5-4a37-a95f-b49dda7f8b1b\") "
Oct 30 21:16:58.149784 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:16:58.149739    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/802e5037-d6f5-4a37-a95f-b49dda7f8b1b-kube-api-access-cq8rq\" (UniqueName: \"kubernetes.io/projected/802e5037-d6f5-4a37-a95f-b49dda7f8b1b-kube-api-access-cq8rq\") pod \"802e5037-d6f5-4a37-a95f-b49dda7f8b1b\" (UID: \"802e5037-d6f5-4a37-a95f-b49dda7f8b1b\") "
Oct 30 21:16:58.149905 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:16:58.149785    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/802e5037-d6f5-4a37-a95f-b49dda7f8b1b-tls-certs\" (UniqueName: \"kubernetes.io/secret/802e5037-d6f5-4a37-a95f-b49dda7f8b1b-tls-certs\") pod \"802e5037-d6f5-4a37-a95f-b49dda7f8b1b\" (UID: \"802e5037-d6f5-4a37-a95f-b49dda7f8b1b\") "
Oct 30 21:16:58.149905 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:16:58.149791    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/802e5037-d6f5-4a37-a95f-b49dda7f8b1b-home" pod "802e5037-d6f5-4a37-a95f-b49dda7f8b1b" (UID: "802e5037-d6f5-4a37-a95f-b49dda7f8b1b"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:16:58.150491 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:16:58.150193    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/802e5037-d6f5-4a37-a95f-b49dda7f8b1b-model-cache" pod "802e5037-d6f5-4a37-a95f-b49dda7f8b1b" (UID: "802e5037-d6f5-4a37-a95f-b49dda7f8b1b"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:16:58.150491 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:16:58.150263    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/802e5037-d6f5-4a37-a95f-b49dda7f8b1b-tmp-dir" pod "802e5037-d6f5-4a37-a95f-b49dda7f8b1b" (UID: "802e5037-d6f5-4a37-a95f-b49dda7f8b1b"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:16:58.150491 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:16:58.150296    6004 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/802e5037-d6f5-4a37-a95f-b49dda7f8b1b-model-cache\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:16:58.150491 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:16:58.150317    6004 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/802e5037-d6f5-4a37-a95f-b49dda7f8b1b-home\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:16:58.152833 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:16:58.152799    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/802e5037-d6f5-4a37-a95f-b49dda7f8b1b-kube-api-access-cq8rq" pod "802e5037-d6f5-4a37-a95f-b49dda7f8b1b" (UID: "802e5037-d6f5-4a37-a95f-b49dda7f8b1b"). InnerVolumeSpecName "kube-api-access-cq8rq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:16:58.153148 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:16:58.153125    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/802e5037-d6f5-4a37-a95f-b49dda7f8b1b-dshm" pod "802e5037-d6f5-4a37-a95f-b49dda7f8b1b" (UID: "802e5037-d6f5-4a37-a95f-b49dda7f8b1b"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:16:58.154468 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:16:58.154434    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/802e5037-d6f5-4a37-a95f-b49dda7f8b1b-tls-certs" pod "802e5037-d6f5-4a37-a95f-b49dda7f8b1b" (UID: "802e5037-d6f5-4a37-a95f-b49dda7f8b1b"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:16:58.156404 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:16:58.156377    6004 scope.go:122] "RemoveContainer" containerID="ad121a89ef0a6902a78c2bc7bd588a38d35dbb834e72cf1672c0417c7211c12e"
Oct 30 21:16:58.161443 ip-10-0-138-85 kubenswrapper[6004]: E1030 21:16:58.161339    6004 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ad121a89ef0a6902a78c2bc7bd588a38d35dbb834e72cf1672c0417c7211c12e\": container with ID starting with ad121a89ef0a6902a78c2bc7bd588a38d35dbb834e72cf1672c0417c7211c12e not found: ID does not exist" containerID="ad121a89ef0a6902a78c2bc7bd588a38d35dbb834e72cf1672c0417c7211c12e"
Oct 30 21:16:58.161560 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:16:58.161456    6004 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ad121a89ef0a6902a78c2bc7bd588a38d35dbb834e72cf1672c0417c7211c12e"} err="failed to get container status \"ad121a89ef0a6902a78c2bc7bd588a38d35dbb834e72cf1672c0417c7211c12e\": rpc error: code = NotFound desc = could not find container \"ad121a89ef0a6902a78c2bc7bd588a38d35dbb834e72cf1672c0417c7211c12e\": container with ID starting with ad121a89ef0a6902a78c2bc7bd588a38d35dbb834e72cf1672c0417c7211c12e not found: ID does not exist"
Oct 30 21:16:58.253192 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:16:58.251853    6004 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/802e5037-d6f5-4a37-a95f-b49dda7f8b1b-dshm\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:16:58.253192 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:16:58.251910    6004 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/802e5037-d6f5-4a37-a95f-b49dda7f8b1b-tmp-dir\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:16:58.253192 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:16:58.251925    6004 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cq8rq\" (UniqueName: \"kubernetes.io/projected/802e5037-d6f5-4a37-a95f-b49dda7f8b1b-kube-api-access-cq8rq\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:16:58.253192 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:16:58.251939    6004 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/802e5037-d6f5-4a37-a95f-b49dda7f8b1b-tls-certs\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:16:58.563090 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:16:58.563029    6004 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w5-2b425d/distinct-w5-2b425d-kserve-dd4dcf7f-b227k"]
Oct 30 21:16:58.567116 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:16:58.567082    6004 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w5-2b425d/distinct-w5-2b425d-kserve-dd4dcf7f-b227k"]
Oct 30 21:16:58.753001 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:16:58.752958    6004 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-769df7846c-r8vgx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.112:15021/healthz/ready\": dial tcp 10.132.0.112:15021: connect: connection refused" start-of-body=
Oct 30 21:16:58.753210 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:16:58.753029    6004 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-r8vgx" podUID="bb7251a5-aa97-4ee2-a00d-27083704dc60" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.112:15021/healthz/ready\": dial tcp 10.132.0.112:15021: connect: connection refused"
Oct 30 21:16:59.614744 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:16:59.614685    6004 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-api-b-cb6404-58c85d58f9-25k64" podUID="32c8cf2d-a21e-46da-97a4-dacb149d0f7a" containerName="payload-pre-processing" containerID="cri-o://bacb7ff74876143c747f46ccb807df48e7c4e8d284ca60ff1812631bbe9b25f6" gracePeriod=25
Oct 30 21:16:59.964791 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:16:59.959437    6004 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-cb6404-58c85d58f9-25k64"
Oct 30 21:16:59.987130 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:16:59.987087    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/32c8cf2d-a21e-46da-97a4-dacb149d0f7a-kube-api-access-z4t5l\" (UniqueName: \"kubernetes.io/projected/32c8cf2d-a21e-46da-97a4-dacb149d0f7a-kube-api-access-z4t5l\") pod \"32c8cf2d-a21e-46da-97a4-dacb149d0f7a\" (UID: \"32c8cf2d-a21e-46da-97a4-dacb149d0f7a\") "
Oct 30 21:16:59.987298 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:16:59.987180    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/32c8cf2d-a21e-46da-97a4-dacb149d0f7a-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/32c8cf2d-a21e-46da-97a4-dacb149d0f7a-plugins-config-volume\") pod \"32c8cf2d-a21e-46da-97a4-dacb149d0f7a\" (UID: \"32c8cf2d-a21e-46da-97a4-dacb149d0f7a\") "
Oct 30 21:16:59.988122 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:16:59.988092    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/32c8cf2d-a21e-46da-97a4-dacb149d0f7a-plugins-config-volume" pod "32c8cf2d-a21e-46da-97a4-dacb149d0f7a" (UID: "32c8cf2d-a21e-46da-97a4-dacb149d0f7a"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:16:59.992103 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:16:59.992075    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/32c8cf2d-a21e-46da-97a4-dacb149d0f7a-kube-api-access-z4t5l" pod "32c8cf2d-a21e-46da-97a4-dacb149d0f7a" (UID: "32c8cf2d-a21e-46da-97a4-dacb149d0f7a"). InnerVolumeSpecName "kube-api-access-z4t5l". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:17:00.088580 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:17:00.088544    6004 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-r8vgx"
Oct 30 21:17:00.097092 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:17:00.089674    6004 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z4t5l\" (UniqueName: \"kubernetes.io/projected/32c8cf2d-a21e-46da-97a4-dacb149d0f7a-kube-api-access-z4t5l\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:17:00.097092 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:17:00.089707    6004 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/32c8cf2d-a21e-46da-97a4-dacb149d0f7a-plugins-config-volume\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:17:00.097092 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:17:00.090748    6004 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-r8vgx"
Oct 30 21:17:00.097092 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:17:00.091585    6004 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-r8vgx"
Oct 30 21:17:00.171129 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:17:00.170298    6004 generic.go:356] "Generic (PLEG): container finished" podID="32c8cf2d-a21e-46da-97a4-dacb149d0f7a" containerID="bacb7ff74876143c747f46ccb807df48e7c4e8d284ca60ff1812631bbe9b25f6" exitCode=0
Oct 30 21:17:00.171129 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:17:00.170339    6004 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-cb6404-58c85d58f9-25k64"
Oct 30 21:17:00.171376 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:17:00.171323    6004 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-cb6404-58c85d58f9-25k64" event={"ID":"32c8cf2d-a21e-46da-97a4-dacb149d0f7a","Type":"ContainerDied","Data":"bacb7ff74876143c747f46ccb807df48e7c4e8d284ca60ff1812631bbe9b25f6"}
Oct 30 21:17:00.171376 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:17:00.171364    6004 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-cb6404-58c85d58f9-25k64" event={"ID":"32c8cf2d-a21e-46da-97a4-dacb149d0f7a","Type":"ContainerDied","Data":"2bfb66d103e6e2a834a778cdf561e971ab355db55864c54eb3f63b387bb99ace"}
Oct 30 21:17:00.171489 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:17:00.171404    6004 scope.go:122] "RemoveContainer" containerID="bacb7ff74876143c747f46ccb807df48e7c4e8d284ca60ff1812631bbe9b25f6"
Oct 30 21:17:00.185259 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:17:00.185118    6004 scope.go:122] "RemoveContainer" containerID="bacb7ff74876143c747f46ccb807df48e7c4e8d284ca60ff1812631bbe9b25f6"
Oct 30 21:17:00.185513 ip-10-0-138-85 kubenswrapper[6004]: E1030 21:17:00.185489    6004 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bacb7ff74876143c747f46ccb807df48e7c4e8d284ca60ff1812631bbe9b25f6\": container with ID starting with bacb7ff74876143c747f46ccb807df48e7c4e8d284ca60ff1812631bbe9b25f6 not found: ID does not exist" containerID="bacb7ff74876143c747f46ccb807df48e7c4e8d284ca60ff1812631bbe9b25f6"
Oct 30 21:17:00.185610 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:17:00.185526    6004 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bacb7ff74876143c747f46ccb807df48e7c4e8d284ca60ff1812631bbe9b25f6"} err="failed to get container status \"bacb7ff74876143c747f46ccb807df48e7c4e8d284ca60ff1812631bbe9b25f6\": rpc error: code = NotFound desc = could not find container \"bacb7ff74876143c747f46ccb807df48e7c4e8d284ca60ff1812631bbe9b25f6\": container with ID starting with bacb7ff74876143c747f46ccb807df48e7c4e8d284ca60ff1812631bbe9b25f6 not found: ID does not exist"
Oct 30 21:17:00.231670 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:17:00.231638    6004 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="802e5037-d6f5-4a37-a95f-b49dda7f8b1b" path="/var/lib/kubelet/pods/802e5037-d6f5-4a37-a95f-b49dda7f8b1b/volumes"
Oct 30 21:17:00.446526 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:17:00.446491    6004 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-cb6404-58c85d58f9-25k64"]
Oct 30 21:17:00.448845 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:17:00.448819    6004 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-cb6404-58c85d58f9-25k64"]
Oct 30 21:17:01.146666 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:17:01.146627    6004 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-d1b889bd-7849b458b6-fqhk7"
Oct 30 21:17:02.231510 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:17:02.231477    6004 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="32c8cf2d-a21e-46da-97a4-dacb149d0f7a" path="/var/lib/kubelet/pods/32c8cf2d-a21e-46da-97a4-dacb149d0f7a/volumes"
Oct 30 21:17:14.288258 ip-10-0-138-85 kubenswrapper[6004]: E1030 21:17:14.288211    6004 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-zz4wr" containerName="extractor"
Oct 30 21:17:14.824161 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:17:14.824128    6004 scope.go:122] "RemoveContainer" containerID="0e4a327889265b84693b9c76a0100c5b0653e180cdbf3c2010b45a6d6a38dd25"
Oct 30 21:17:21.049358 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:17:21.049323    6004 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w1-f9f277/distinct-w1-f9f277-kserve-f947bc879-lzs6w"]
Oct 30 21:17:36.039898 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:17:36.039813    6004 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-cb6404-5b8885c785-vhrvl"]
Oct 30 21:17:36.040448 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:17:36.040060    6004 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-cb6404-5b8885c785-vhrvl" podUID="f70ac5fb-9ac9-4cb2-b2aa-4d37bfc117ee" containerName="maas-api" containerID="cri-o://bb4e6a4aa50dbf74fb29b2c7a0a56ab503699e6325903ae7a4acd7c14eac3b56" gracePeriod=30
Oct 30 21:17:36.071142 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:17:36.071094    6004 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-models-e2e-worker-w1-f9f277/distinct-w1-f9f277-kserve-f947bc879-lzs6w" podUID="f4ab8826-a6f1-41e6-897f-b808635017c5" containerName="main" containerID="cri-o://484fab5b5a419492e7bed18994e40d23d984685d3e8de6075310329447b9468d" gracePeriod=45
Oct 30 21:17:36.375618 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:17:36.375514    6004 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-f9f277/distinct-w1-f9f277-kserve-f947bc879-lzs6w" podUID="f4ab8826-a6f1-41e6-897f-b808635017c5" containerName="main" probeResult="failure" output="Get \"https://10.132.0.68:8000/ready\": dial tcp 10.132.0.68:8000: connect: connection refused"
Oct 30 21:17:36.422557 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:17:36.422501    6004 generic.go:356] "Generic (PLEG): container finished" podID="f4ab8826-a6f1-41e6-897f-b808635017c5" containerID="484fab5b5a419492e7bed18994e40d23d984685d3e8de6075310329447b9468d" exitCode=0
Oct 30 21:17:36.423277 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:17:36.422803    6004 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w1-f9f277/distinct-w1-f9f277-kserve-f947bc879-lzs6w" event={"ID":"f4ab8826-a6f1-41e6-897f-b808635017c5","Type":"ContainerDied","Data":"484fab5b5a419492e7bed18994e40d23d984685d3e8de6075310329447b9468d"}
Oct 30 21:17:36.426147 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:17:36.426114    6004 generic.go:356] "Generic (PLEG): container finished" podID="f70ac5fb-9ac9-4cb2-b2aa-4d37bfc117ee" containerID="bb4e6a4aa50dbf74fb29b2c7a0a56ab503699e6325903ae7a4acd7c14eac3b56" exitCode=0
Oct 30 21:17:36.426280 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:17:36.426213    6004 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-cb6404-5b8885c785-vhrvl" event={"ID":"f70ac5fb-9ac9-4cb2-b2aa-4d37bfc117ee","Type":"ContainerDied","Data":"bb4e6a4aa50dbf74fb29b2c7a0a56ab503699e6325903ae7a4acd7c14eac3b56"}
Oct 30 21:17:36.426352 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:17:36.426337    6004 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-cb6404-5b8885c785-vhrvl" event={"ID":"f70ac5fb-9ac9-4cb2-b2aa-4d37bfc117ee","Type":"ContainerDied","Data":"1c8d222db1ed680e5134815715a4e1d023837ba700ba711ce1f466cedfbc6ee1"}
Oct 30 21:17:36.426409 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:17:36.426368    6004 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1c8d222db1ed680e5134815715a4e1d023837ba700ba711ce1f466cedfbc6ee1"
Oct 30 21:17:36.444082 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:17:36.442011    6004 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-cb6404-5b8885c785-vhrvl"
Oct 30 21:17:36.544933 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:17:36.544896    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/f70ac5fb-9ac9-4cb2-b2aa-4d37bfc117ee-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f70ac5fb-9ac9-4cb2-b2aa-4d37bfc117ee-maas-api-tls\") pod \"f70ac5fb-9ac9-4cb2-b2aa-4d37bfc117ee\" (UID: \"f70ac5fb-9ac9-4cb2-b2aa-4d37bfc117ee\") "
Oct 30 21:17:36.545178 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:17:36.544959    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/f70ac5fb-9ac9-4cb2-b2aa-4d37bfc117ee-metrics-certs\" (UniqueName: \"kubernetes.io/secret/f70ac5fb-9ac9-4cb2-b2aa-4d37bfc117ee-metrics-certs\") pod \"f70ac5fb-9ac9-4cb2-b2aa-4d37bfc117ee\" (UID: \"f70ac5fb-9ac9-4cb2-b2aa-4d37bfc117ee\") "
Oct 30 21:17:36.545178 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:17:36.545023    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/f70ac5fb-9ac9-4cb2-b2aa-4d37bfc117ee-kube-api-access-lrmcl\" (UniqueName: \"kubernetes.io/projected/f70ac5fb-9ac9-4cb2-b2aa-4d37bfc117ee-kube-api-access-lrmcl\") pod \"f70ac5fb-9ac9-4cb2-b2aa-4d37bfc117ee\" (UID: \"f70ac5fb-9ac9-4cb2-b2aa-4d37bfc117ee\") "
Oct 30 21:17:36.545178 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:17:36.545142    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/f70ac5fb-9ac9-4cb2-b2aa-4d37bfc117ee-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f70ac5fb-9ac9-4cb2-b2aa-4d37bfc117ee-openshift-service-ca\") pod \"f70ac5fb-9ac9-4cb2-b2aa-4d37bfc117ee\" (UID: \"f70ac5fb-9ac9-4cb2-b2aa-4d37bfc117ee\") "
Oct 30 21:17:36.545850 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:17:36.545818    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f70ac5fb-9ac9-4cb2-b2aa-4d37bfc117ee-openshift-service-ca" pod "f70ac5fb-9ac9-4cb2-b2aa-4d37bfc117ee" (UID: "f70ac5fb-9ac9-4cb2-b2aa-4d37bfc117ee"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:17:36.547910 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:17:36.547867    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f70ac5fb-9ac9-4cb2-b2aa-4d37bfc117ee-metrics-certs" pod "f70ac5fb-9ac9-4cb2-b2aa-4d37bfc117ee" (UID: "f70ac5fb-9ac9-4cb2-b2aa-4d37bfc117ee"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:17:36.549146 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:17:36.549122    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f70ac5fb-9ac9-4cb2-b2aa-4d37bfc117ee-kube-api-access-lrmcl" pod "f70ac5fb-9ac9-4cb2-b2aa-4d37bfc117ee" (UID: "f70ac5fb-9ac9-4cb2-b2aa-4d37bfc117ee"). InnerVolumeSpecName "kube-api-access-lrmcl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:17:36.550400 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:17:36.550376    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f70ac5fb-9ac9-4cb2-b2aa-4d37bfc117ee-maas-api-tls" pod "f70ac5fb-9ac9-4cb2-b2aa-4d37bfc117ee" (UID: "f70ac5fb-9ac9-4cb2-b2aa-4d37bfc117ee"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:17:36.619390 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:17:36.619363    6004 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w1-f9f277/distinct-w1-f9f277-kserve-f947bc879-lzs6w"
Oct 30 21:17:36.647530 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:17:36.647442    6004 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f70ac5fb-9ac9-4cb2-b2aa-4d37bfc117ee-metrics-certs\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:17:36.647530 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:17:36.647485    6004 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lrmcl\" (UniqueName: \"kubernetes.io/projected/f70ac5fb-9ac9-4cb2-b2aa-4d37bfc117ee-kube-api-access-lrmcl\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:17:36.647530 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:17:36.647502    6004 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f70ac5fb-9ac9-4cb2-b2aa-4d37bfc117ee-openshift-service-ca\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:17:36.647530 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:17:36.647516    6004 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f70ac5fb-9ac9-4cb2-b2aa-4d37bfc117ee-maas-api-tls\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:17:36.748833 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:17:36.748796    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/f4ab8826-a6f1-41e6-897f-b808635017c5-home\" (UniqueName: \"kubernetes.io/empty-dir/f4ab8826-a6f1-41e6-897f-b808635017c5-home\") pod \"f4ab8826-a6f1-41e6-897f-b808635017c5\" (UID: \"f4ab8826-a6f1-41e6-897f-b808635017c5\") "
Oct 30 21:17:36.749033 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:17:36.748902    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/f4ab8826-a6f1-41e6-897f-b808635017c5-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f4ab8826-a6f1-41e6-897f-b808635017c5-tmp-dir\") pod \"f4ab8826-a6f1-41e6-897f-b808635017c5\" (UID: \"f4ab8826-a6f1-41e6-897f-b808635017c5\") "
Oct 30 21:17:36.749033 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:17:36.748957    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/f4ab8826-a6f1-41e6-897f-b808635017c5-kube-api-access-pfchm\" (UniqueName: \"kubernetes.io/projected/f4ab8826-a6f1-41e6-897f-b808635017c5-kube-api-access-pfchm\") pod \"f4ab8826-a6f1-41e6-897f-b808635017c5\" (UID: \"f4ab8826-a6f1-41e6-897f-b808635017c5\") "
Oct 30 21:17:36.749033 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:17:36.749026    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/f4ab8826-a6f1-41e6-897f-b808635017c5-tls-certs\" (UniqueName: \"kubernetes.io/secret/f4ab8826-a6f1-41e6-897f-b808635017c5-tls-certs\") pod \"f4ab8826-a6f1-41e6-897f-b808635017c5\" (UID: \"f4ab8826-a6f1-41e6-897f-b808635017c5\") "
Oct 30 21:17:36.749219 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:17:36.749140    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/f4ab8826-a6f1-41e6-897f-b808635017c5-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f4ab8826-a6f1-41e6-897f-b808635017c5-model-cache\") pod \"f4ab8826-a6f1-41e6-897f-b808635017c5\" (UID: \"f4ab8826-a6f1-41e6-897f-b808635017c5\") "
Oct 30 21:17:36.749219 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:17:36.749168    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/f4ab8826-a6f1-41e6-897f-b808635017c5-dshm\" (UniqueName: \"kubernetes.io/empty-dir/f4ab8826-a6f1-41e6-897f-b808635017c5-dshm\") pod \"f4ab8826-a6f1-41e6-897f-b808635017c5\" (UID: \"f4ab8826-a6f1-41e6-897f-b808635017c5\") "
Oct 30 21:17:36.756260 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:17:36.756224    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f4ab8826-a6f1-41e6-897f-b808635017c5-dshm" pod "f4ab8826-a6f1-41e6-897f-b808635017c5" (UID: "f4ab8826-a6f1-41e6-897f-b808635017c5"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:17:36.757017 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:17:36.756986    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f4ab8826-a6f1-41e6-897f-b808635017c5-tmp-dir" pod "f4ab8826-a6f1-41e6-897f-b808635017c5" (UID: "f4ab8826-a6f1-41e6-897f-b808635017c5"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:17:36.757236 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:17:36.757213    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f4ab8826-a6f1-41e6-897f-b808635017c5-home" pod "f4ab8826-a6f1-41e6-897f-b808635017c5" (UID: "f4ab8826-a6f1-41e6-897f-b808635017c5"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:17:36.757342 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:17:36.757270    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f4ab8826-a6f1-41e6-897f-b808635017c5-model-cache" pod "f4ab8826-a6f1-41e6-897f-b808635017c5" (UID: "f4ab8826-a6f1-41e6-897f-b808635017c5"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:17:36.764330 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:17:36.764300    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f4ab8826-a6f1-41e6-897f-b808635017c5-tls-certs" pod "f4ab8826-a6f1-41e6-897f-b808635017c5" (UID: "f4ab8826-a6f1-41e6-897f-b808635017c5"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:17:36.765686 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:17:36.765657    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f4ab8826-a6f1-41e6-897f-b808635017c5-kube-api-access-pfchm" pod "f4ab8826-a6f1-41e6-897f-b808635017c5" (UID: "f4ab8826-a6f1-41e6-897f-b808635017c5"). InnerVolumeSpecName "kube-api-access-pfchm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:17:36.850276 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:17:36.850237    6004 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f4ab8826-a6f1-41e6-897f-b808635017c5-model-cache\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:17:36.850276 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:17:36.850273    6004 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f4ab8826-a6f1-41e6-897f-b808635017c5-dshm\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:17:36.850511 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:17:36.850286    6004 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f4ab8826-a6f1-41e6-897f-b808635017c5-home\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:17:36.850511 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:17:36.850299    6004 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f4ab8826-a6f1-41e6-897f-b808635017c5-tmp-dir\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:17:36.850511 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:17:36.850312    6004 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pfchm\" (UniqueName: \"kubernetes.io/projected/f4ab8826-a6f1-41e6-897f-b808635017c5-kube-api-access-pfchm\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:17:36.850511 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:17:36.850325    6004 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f4ab8826-a6f1-41e6-897f-b808635017c5-tls-certs\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:17:37.433272 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:17:37.433233    6004 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w1-f9f277/distinct-w1-f9f277-kserve-f947bc879-lzs6w" event={"ID":"f4ab8826-a6f1-41e6-897f-b808635017c5","Type":"ContainerDied","Data":"6a31c94c4bdc147db3f92300cf15d4b9af673751540d07d1c25d7442dd3ecbbe"}
Oct 30 21:17:37.433707 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:17:37.433273    6004 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w1-f9f277/distinct-w1-f9f277-kserve-f947bc879-lzs6w"
Oct 30 21:17:37.433707 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:17:37.433294    6004 scope.go:122] "RemoveContainer" containerID="484fab5b5a419492e7bed18994e40d23d984685d3e8de6075310329447b9468d"
Oct 30 21:17:37.433707 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:17:37.433273    6004 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-cb6404-5b8885c785-vhrvl"
Oct 30 21:17:37.654482 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:17:37.654445    6004 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-cb6404-5b8885c785-vhrvl"]
Oct 30 21:17:37.704503 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:17:37.704421    6004 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-cb6404-5b8885c785-vhrvl"]
Oct 30 21:17:37.767790 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:17:37.767757    6004 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w1-f9f277/distinct-w1-f9f277-kserve-f947bc879-lzs6w"]
Oct 30 21:17:37.772717 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:17:37.772686    6004 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w1-f9f277/distinct-w1-f9f277-kserve-f947bc879-lzs6w"]
Oct 30 21:17:38.230792 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:17:38.230755    6004 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="f4ab8826-a6f1-41e6-897f-b808635017c5" path="/var/lib/kubelet/pods/f4ab8826-a6f1-41e6-897f-b808635017c5/volumes"
Oct 30 21:17:38.231338 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:17:38.231316    6004 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="f70ac5fb-9ac9-4cb2-b2aa-4d37bfc117ee" path="/var/lib/kubelet/pods/f70ac5fb-9ac9-4cb2-b2aa-4d37bfc117ee/volumes"
Oct 30 21:17:44.287546 ip-10-0-138-85 kubenswrapper[6004]: E1030 21:17:44.287504    6004 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-zz4wr" containerName="extractor"
Oct 30 21:17:53.466531 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:17:53.466493    6004 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-639b07-6f8d5c7898-jw9m6"]
Oct 30 21:17:53.467110 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:17:53.466991    6004 cpu_manager.go:414] "containerMap: removing container" podUID="802e5037-d6f5-4a37-a95f-b49dda7f8b1b" containerName="main"
Oct 30 21:17:53.467110 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:17:53.467002    6004 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="802e5037-d6f5-4a37-a95f-b49dda7f8b1b" containerName="main"
Oct 30 21:17:53.467110 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:17:53.467026    6004 cpu_manager.go:414] "containerMap: removing container" podUID="32c8cf2d-a21e-46da-97a4-dacb149d0f7a" containerName="payload-pre-processing"
Oct 30 21:17:53.467110 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:17:53.467031    6004 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="32c8cf2d-a21e-46da-97a4-dacb149d0f7a" containerName="payload-pre-processing"
Oct 30 21:17:53.467110 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:17:53.467068    6004 cpu_manager.go:414] "containerMap: removing container" podUID="f4ab8826-a6f1-41e6-897f-b808635017c5" containerName="main"
Oct 30 21:17:53.467110 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:17:53.467075    6004 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="f4ab8826-a6f1-41e6-897f-b808635017c5" containerName="main"
Oct 30 21:17:53.467110 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:17:53.467081    6004 cpu_manager.go:414] "containerMap: removing container" podUID="f70ac5fb-9ac9-4cb2-b2aa-4d37bfc117ee" containerName="maas-api"
Oct 30 21:17:53.467110 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:17:53.467086    6004 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="f70ac5fb-9ac9-4cb2-b2aa-4d37bfc117ee" containerName="maas-api"
Oct 30 21:17:53.467520 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:17:53.467178    6004 memory_manager.go:365] "RemoveStaleState removing state" podUID="32c8cf2d-a21e-46da-97a4-dacb149d0f7a" containerName="payload-pre-processing"
Oct 30 21:17:53.467520 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:17:53.467190    6004 memory_manager.go:365] "RemoveStaleState removing state" podUID="f4ab8826-a6f1-41e6-897f-b808635017c5" containerName="main"
Oct 30 21:17:53.467520 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:17:53.467195    6004 memory_manager.go:365] "RemoveStaleState removing state" podUID="f70ac5fb-9ac9-4cb2-b2aa-4d37bfc117ee" containerName="maas-api"
Oct 30 21:17:53.467520 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:17:53.467204    6004 memory_manager.go:365] "RemoveStaleState removing state" podUID="802e5037-d6f5-4a37-a95f-b49dda7f8b1b" containerName="main"
Oct 30 21:17:53.471074 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:17:53.471040    6004 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-639b07-6f8d5c7898-jw9m6"
Oct 30 21:17:53.523913 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:17:53.523879    6004 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-b-639b07-serving-cert\""
Oct 30 21:17:53.548240 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:17:53.548201    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sxqfr\" (UniqueName: \"kubernetes.io/projected/766d43f7-3939-49dc-9829-db0918b2a138-kube-api-access-sxqfr\") pod \"maas-api-e2e-inf-b-639b07-6f8d5c7898-jw9m6\" (UID: \"766d43f7-3939-49dc-9829-db0918b2a138\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-639b07-6f8d5c7898-jw9m6"
Oct 30 21:17:53.548407 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:17:53.548248    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/766d43f7-3939-49dc-9829-db0918b2a138-openshift-service-ca\") pod \"maas-api-e2e-inf-b-639b07-6f8d5c7898-jw9m6\" (UID: \"766d43f7-3939-49dc-9829-db0918b2a138\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-639b07-6f8d5c7898-jw9m6"
Oct 30 21:17:53.548407 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:17:53.548358    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/766d43f7-3939-49dc-9829-db0918b2a138-maas-api-tls\") pod \"maas-api-e2e-inf-b-639b07-6f8d5c7898-jw9m6\" (UID: \"766d43f7-3939-49dc-9829-db0918b2a138\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-639b07-6f8d5c7898-jw9m6"
Oct 30 21:17:53.548483 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:17:53.548454    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/766d43f7-3939-49dc-9829-db0918b2a138-metrics-certs\") pod \"maas-api-e2e-inf-b-639b07-6f8d5c7898-jw9m6\" (UID: \"766d43f7-3939-49dc-9829-db0918b2a138\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-639b07-6f8d5c7898-jw9m6"
Oct 30 21:17:53.577300 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:17:53.577267    6004 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-639b07-6f8d5c7898-jw9m6"]
Oct 30 21:17:53.649986 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:17:53.649944    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/766d43f7-3939-49dc-9829-db0918b2a138-metrics-certs\") pod \"maas-api-e2e-inf-b-639b07-6f8d5c7898-jw9m6\" (UID: \"766d43f7-3939-49dc-9829-db0918b2a138\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-639b07-6f8d5c7898-jw9m6"
Oct 30 21:17:53.650440 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:17:53.650418    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sxqfr\" (UniqueName: \"kubernetes.io/projected/766d43f7-3939-49dc-9829-db0918b2a138-kube-api-access-sxqfr\") pod \"maas-api-e2e-inf-b-639b07-6f8d5c7898-jw9m6\" (UID: \"766d43f7-3939-49dc-9829-db0918b2a138\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-639b07-6f8d5c7898-jw9m6"
Oct 30 21:17:53.650568 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:17:53.650552    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/766d43f7-3939-49dc-9829-db0918b2a138-openshift-service-ca\") pod \"maas-api-e2e-inf-b-639b07-6f8d5c7898-jw9m6\" (UID: \"766d43f7-3939-49dc-9829-db0918b2a138\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-639b07-6f8d5c7898-jw9m6"
Oct 30 21:17:53.650706 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:17:53.650691    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/766d43f7-3939-49dc-9829-db0918b2a138-maas-api-tls\") pod \"maas-api-e2e-inf-b-639b07-6f8d5c7898-jw9m6\" (UID: \"766d43f7-3939-49dc-9829-db0918b2a138\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-639b07-6f8d5c7898-jw9m6"
Oct 30 21:17:53.650961 ip-10-0-138-85 kubenswrapper[6004]: E1030 21:17:53.650943    6004 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-inf-b-639b07-serving-cert: secret "maas-api-e2e-inf-b-639b07-serving-cert" not found
Oct 30 21:17:53.651152 ip-10-0-138-85 kubenswrapper[6004]: E1030 21:17:53.651139    6004 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/766d43f7-3939-49dc-9829-db0918b2a138-maas-api-tls podName:766d43f7-3939-49dc-9829-db0918b2a138 nodeName:}" failed. No retries permitted until 2026-10-30 21:17:54.151117949 +0000 UTC m=+2380.070904061 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/766d43f7-3939-49dc-9829-db0918b2a138-maas-api-tls") pod "maas-api-e2e-inf-b-639b07-6f8d5c7898-jw9m6" (UID: "766d43f7-3939-49dc-9829-db0918b2a138") : secret "maas-api-e2e-inf-b-639b07-serving-cert" not found
Oct 30 21:17:53.652023 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:17:53.651980    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/766d43f7-3939-49dc-9829-db0918b2a138-openshift-service-ca\") pod \"maas-api-e2e-inf-b-639b07-6f8d5c7898-jw9m6\" (UID: \"766d43f7-3939-49dc-9829-db0918b2a138\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-639b07-6f8d5c7898-jw9m6"
Oct 30 21:17:53.653268 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:17:53.653243    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/766d43f7-3939-49dc-9829-db0918b2a138-metrics-certs\") pod \"maas-api-e2e-inf-b-639b07-6f8d5c7898-jw9m6\" (UID: \"766d43f7-3939-49dc-9829-db0918b2a138\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-639b07-6f8d5c7898-jw9m6"
Oct 30 21:17:53.709258 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:17:53.709232    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sxqfr\" (UniqueName: \"kubernetes.io/projected/766d43f7-3939-49dc-9829-db0918b2a138-kube-api-access-sxqfr\") pod \"maas-api-e2e-inf-b-639b07-6f8d5c7898-jw9m6\" (UID: \"766d43f7-3939-49dc-9829-db0918b2a138\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-639b07-6f8d5c7898-jw9m6"
Oct 30 21:17:54.160060 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:17:54.160006    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/766d43f7-3939-49dc-9829-db0918b2a138-maas-api-tls\") pod \"maas-api-e2e-inf-b-639b07-6f8d5c7898-jw9m6\" (UID: \"766d43f7-3939-49dc-9829-db0918b2a138\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-639b07-6f8d5c7898-jw9m6"
Oct 30 21:17:54.162492 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:17:54.162464    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/766d43f7-3939-49dc-9829-db0918b2a138-maas-api-tls\") pod \"maas-api-e2e-inf-b-639b07-6f8d5c7898-jw9m6\" (UID: \"766d43f7-3939-49dc-9829-db0918b2a138\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-639b07-6f8d5c7898-jw9m6"
Oct 30 21:17:54.389110 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:17:54.389075    6004 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-639b07-6f8d5c7898-jw9m6"
Oct 30 21:17:54.773590 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:17:54.773559    6004 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-639b07-6f8d5c7898-jw9m6"]
Oct 30 21:17:54.775281 ip-10-0-138-85 kubenswrapper[6004]: W1030 21:17:54.775245    6004 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod766d43f7_3939_49dc_9829_db0918b2a138.slice/crio-7e9716cecc2836a47e50e9efd6dd2bb45c6355a3de5c9ea457403431e870fbdb WatchSource:0}: Error finding container 7e9716cecc2836a47e50e9efd6dd2bb45c6355a3de5c9ea457403431e870fbdb: Status 404 returned error can't find the container with id 7e9716cecc2836a47e50e9efd6dd2bb45c6355a3de5c9ea457403431e870fbdb
Oct 30 21:17:55.545305 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:17:55.545273    6004 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-639b07-6f8d5c7898-jw9m6" event={"ID":"766d43f7-3939-49dc-9829-db0918b2a138","Type":"ContainerStarted","Data":"7e9716cecc2836a47e50e9efd6dd2bb45c6355a3de5c9ea457403431e870fbdb"}
Oct 30 21:17:56.553694 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:17:56.553654    6004 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-639b07-6f8d5c7898-jw9m6" event={"ID":"766d43f7-3939-49dc-9829-db0918b2a138","Type":"ContainerStarted","Data":"e41a44f096fe6f25cf11b36be5d652a1033f82149c4f2a79c94b55ab6a314c92"}
Oct 30 21:17:56.554129 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:17:56.553750    6004 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-639b07-6f8d5c7898-jw9m6"
Oct 30 21:17:56.678563 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:17:56.678504    6004 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-639b07-6f8d5c7898-jw9m6" podStartSLOduration=2.911156424 podStartE2EDuration="3.678489712s" totalImagesPullingTime="767.333288ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:17:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:17:56.676647672 +0000 UTC m=+2382.596433792" watchObservedRunningTime="2026-10-30 21:17:56.678489712 +0000 UTC m=+2382.598275830"
Oct 30 21:18:02.565293 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:18:02.565260    6004 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-639b07-6f8d5c7898-jw9m6"
Oct 30 21:18:14.287325 ip-10-0-138-85 kubenswrapper[6004]: E1030 21:18:14.287280    6004 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-zz4wr" containerName="extractor"
Oct 30 21:18:14.612305 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:18:14.612222    6004 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-sb7ds_90cd3de0-c573-41c2-bf3e-cf0e46a41d50/console-operator/2.log"
Oct 30 21:18:14.625456 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:18:14.625432    6004 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-sb7ds_90cd3de0-c573-41c2-bf3e-cf0e46a41d50/console-operator/2.log"
Oct 30 21:18:19.385581 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:18:19.385548    6004 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w5-2b425d-7bd8f69d87-qtpmg"]
Oct 30 21:18:19.386045 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:18:19.385812    6004 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-2b425d-7bd8f69d87-qtpmg" podUID="d7b91b87-18a8-42be-8652-137ee8b789a1" containerName="maas-api" containerID="cri-o://a462ef876272b72c1d55b97cc7a5bb2301e6d504294aa90e10a9bc4215a100dd" gracePeriod=30
Oct 30 21:18:19.715172 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:18:19.715142    6004 generic.go:356] "Generic (PLEG): container finished" podID="d7b91b87-18a8-42be-8652-137ee8b789a1" containerID="a462ef876272b72c1d55b97cc7a5bb2301e6d504294aa90e10a9bc4215a100dd" exitCode=0
Oct 30 21:18:19.715340 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:18:19.715214    6004 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-2b425d-7bd8f69d87-qtpmg" event={"ID":"d7b91b87-18a8-42be-8652-137ee8b789a1","Type":"ContainerDied","Data":"a462ef876272b72c1d55b97cc7a5bb2301e6d504294aa90e10a9bc4215a100dd"}
Oct 30 21:18:19.715340 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:18:19.715259    6004 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-2b425d-7bd8f69d87-qtpmg" event={"ID":"d7b91b87-18a8-42be-8652-137ee8b789a1","Type":"ContainerDied","Data":"7c85442bc6bc08b79a2739fcb0ad333d13b2b8b446c1e4fceeb340232d7a2dc1"}
Oct 30 21:18:19.715340 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:18:19.715278    6004 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7c85442bc6bc08b79a2739fcb0ad333d13b2b8b446c1e4fceeb340232d7a2dc1"
Oct 30 21:18:19.719067 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:18:19.719027    6004 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-2b425d-7bd8f69d87-qtpmg"
Oct 30 21:18:19.752559 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:18:19.752527    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/d7b91b87-18a8-42be-8652-137ee8b789a1-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d7b91b87-18a8-42be-8652-137ee8b789a1-maas-api-tls\") pod \"d7b91b87-18a8-42be-8652-137ee8b789a1\" (UID: \"d7b91b87-18a8-42be-8652-137ee8b789a1\") "
Oct 30 21:18:19.752731 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:18:19.752620    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/d7b91b87-18a8-42be-8652-137ee8b789a1-metrics-certs\" (UniqueName: \"kubernetes.io/secret/d7b91b87-18a8-42be-8652-137ee8b789a1-metrics-certs\") pod \"d7b91b87-18a8-42be-8652-137ee8b789a1\" (UID: \"d7b91b87-18a8-42be-8652-137ee8b789a1\") "
Oct 30 21:18:19.752731 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:18:19.752682    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/d7b91b87-18a8-42be-8652-137ee8b789a1-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d7b91b87-18a8-42be-8652-137ee8b789a1-openshift-service-ca\") pod \"d7b91b87-18a8-42be-8652-137ee8b789a1\" (UID: \"d7b91b87-18a8-42be-8652-137ee8b789a1\") "
Oct 30 21:18:19.752847 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:18:19.752765    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/d7b91b87-18a8-42be-8652-137ee8b789a1-kube-api-access-5mgqj\" (UniqueName: \"kubernetes.io/projected/d7b91b87-18a8-42be-8652-137ee8b789a1-kube-api-access-5mgqj\") pod \"d7b91b87-18a8-42be-8652-137ee8b789a1\" (UID: \"d7b91b87-18a8-42be-8652-137ee8b789a1\") "
Oct 30 21:18:19.753306 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:18:19.753265    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d7b91b87-18a8-42be-8652-137ee8b789a1-openshift-service-ca" pod "d7b91b87-18a8-42be-8652-137ee8b789a1" (UID: "d7b91b87-18a8-42be-8652-137ee8b789a1"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:18:19.754926 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:18:19.754902    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d7b91b87-18a8-42be-8652-137ee8b789a1-maas-api-tls" pod "d7b91b87-18a8-42be-8652-137ee8b789a1" (UID: "d7b91b87-18a8-42be-8652-137ee8b789a1"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:18:19.756215 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:18:19.756179    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d7b91b87-18a8-42be-8652-137ee8b789a1-kube-api-access-5mgqj" pod "d7b91b87-18a8-42be-8652-137ee8b789a1" (UID: "d7b91b87-18a8-42be-8652-137ee8b789a1"). InnerVolumeSpecName "kube-api-access-5mgqj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:18:19.756491 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:18:19.756454    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d7b91b87-18a8-42be-8652-137ee8b789a1-metrics-certs" pod "d7b91b87-18a8-42be-8652-137ee8b789a1" (UID: "d7b91b87-18a8-42be-8652-137ee8b789a1"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:18:19.856488 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:18:19.855793    6004 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d7b91b87-18a8-42be-8652-137ee8b789a1-metrics-certs\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:18:19.856488 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:18:19.855832    6004 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d7b91b87-18a8-42be-8652-137ee8b789a1-openshift-service-ca\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:18:19.856488 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:18:19.855848    6004 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5mgqj\" (UniqueName: \"kubernetes.io/projected/d7b91b87-18a8-42be-8652-137ee8b789a1-kube-api-access-5mgqj\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:18:19.856488 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:18:19.855868    6004 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d7b91b87-18a8-42be-8652-137ee8b789a1-maas-api-tls\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:18:20.721797 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:18:20.721763    6004 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-2b425d-7bd8f69d87-qtpmg"
Oct 30 21:18:20.887223 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:18:20.887193    6004 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w5-2b425d-7bd8f69d87-qtpmg"]
Oct 30 21:18:20.939016 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:18:20.938980    6004 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w5-2b425d-7bd8f69d87-qtpmg"]
Oct 30 21:18:22.232066 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:18:22.232026    6004 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="d7b91b87-18a8-42be-8652-137ee8b789a1" path="/var/lib/kubelet/pods/d7b91b87-18a8-42be-8652-137ee8b789a1/volumes"
Oct 30 21:18:28.566202 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:18:28.566164    6004 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w5-2b425d-openshift-default-f547dbcbf-5q4qn"]
Oct 30 21:18:28.566732 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:18:28.566424    6004 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w5-2b425d-openshift-default-f547dbcbf-5q4qn" podUID="f2e32e7c-6a2f-4464-aa11-243c5b5ccbe1" containerName="istio-proxy" containerID="cri-o://9c3d96c9cbcb0ea6f576c8fd3bf4bb751e942d5e78d85170f407d565c2b0313f" gracePeriod=30
Oct 30 21:18:33.840381 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:18:33.840344    6004 generic.go:356] "Generic (PLEG): container finished" podID="f2e32e7c-6a2f-4464-aa11-243c5b5ccbe1" containerID="9c3d96c9cbcb0ea6f576c8fd3bf4bb751e942d5e78d85170f407d565c2b0313f" exitCode=0
Oct 30 21:18:33.840816 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:18:33.840391    6004 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-2b425d-openshift-default-f547dbcbf-5q4qn" event={"ID":"f2e32e7c-6a2f-4464-aa11-243c5b5ccbe1","Type":"ContainerDied","Data":"9c3d96c9cbcb0ea6f576c8fd3bf4bb751e942d5e78d85170f407d565c2b0313f"}
Oct 30 21:18:33.860714 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:18:33.860691    6004 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-2b425d-openshift-default-f547dbcbf-5q4qn"
Oct 30 21:18:33.959831 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:18:33.959800    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/f2e32e7c-6a2f-4464-aa11-243c5b5ccbe1-kube-api-access-dscq9\" (UniqueName: \"kubernetes.io/projected/f2e32e7c-6a2f-4464-aa11-243c5b5ccbe1-kube-api-access-dscq9\") pod \"f2e32e7c-6a2f-4464-aa11-243c5b5ccbe1\" (UID: \"f2e32e7c-6a2f-4464-aa11-243c5b5ccbe1\") "
Oct 30 21:18:33.960096 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:18:33.959857    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/f2e32e7c-6a2f-4464-aa11-243c5b5ccbe1-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f2e32e7c-6a2f-4464-aa11-243c5b5ccbe1-workload-socket\") pod \"f2e32e7c-6a2f-4464-aa11-243c5b5ccbe1\" (UID: \"f2e32e7c-6a2f-4464-aa11-243c5b5ccbe1\") "
Oct 30 21:18:33.960096 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:18:33.959906    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/f2e32e7c-6a2f-4464-aa11-243c5b5ccbe1-istio-token\" (UniqueName: \"kubernetes.io/projected/f2e32e7c-6a2f-4464-aa11-243c5b5ccbe1-istio-token\") pod \"f2e32e7c-6a2f-4464-aa11-243c5b5ccbe1\" (UID: \"f2e32e7c-6a2f-4464-aa11-243c5b5ccbe1\") "
Oct 30 21:18:33.960096 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:18:33.959938    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/f2e32e7c-6a2f-4464-aa11-243c5b5ccbe1-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f2e32e7c-6a2f-4464-aa11-243c5b5ccbe1-istiod-ca-cert\") pod \"f2e32e7c-6a2f-4464-aa11-243c5b5ccbe1\" (UID: \"f2e32e7c-6a2f-4464-aa11-243c5b5ccbe1\") "
Oct 30 21:18:33.960096 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:18:33.959988    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/f2e32e7c-6a2f-4464-aa11-243c5b5ccbe1-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f2e32e7c-6a2f-4464-aa11-243c5b5ccbe1-istio-podinfo\") pod \"f2e32e7c-6a2f-4464-aa11-243c5b5ccbe1\" (UID: \"f2e32e7c-6a2f-4464-aa11-243c5b5ccbe1\") "
Oct 30 21:18:33.960096 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:18:33.960019    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/f2e32e7c-6a2f-4464-aa11-243c5b5ccbe1-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f2e32e7c-6a2f-4464-aa11-243c5b5ccbe1-istio-data\") pod \"f2e32e7c-6a2f-4464-aa11-243c5b5ccbe1\" (UID: \"f2e32e7c-6a2f-4464-aa11-243c5b5ccbe1\") "
Oct 30 21:18:33.960394 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:18:33.960116    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/f2e32e7c-6a2f-4464-aa11-243c5b5ccbe1-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f2e32e7c-6a2f-4464-aa11-243c5b5ccbe1-istio-envoy\") pod \"f2e32e7c-6a2f-4464-aa11-243c5b5ccbe1\" (UID: \"f2e32e7c-6a2f-4464-aa11-243c5b5ccbe1\") "
Oct 30 21:18:33.960394 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:18:33.960214    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/f2e32e7c-6a2f-4464-aa11-243c5b5ccbe1-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f2e32e7c-6a2f-4464-aa11-243c5b5ccbe1-workload-certs\") pod \"f2e32e7c-6a2f-4464-aa11-243c5b5ccbe1\" (UID: \"f2e32e7c-6a2f-4464-aa11-243c5b5ccbe1\") "
Oct 30 21:18:33.960394 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:18:33.960259    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/f2e32e7c-6a2f-4464-aa11-243c5b5ccbe1-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f2e32e7c-6a2f-4464-aa11-243c5b5ccbe1-credential-socket\") pod \"f2e32e7c-6a2f-4464-aa11-243c5b5ccbe1\" (UID: \"f2e32e7c-6a2f-4464-aa11-243c5b5ccbe1\") "
Oct 30 21:18:33.960394 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:18:33.960285    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f2e32e7c-6a2f-4464-aa11-243c5b5ccbe1-workload-socket" pod "f2e32e7c-6a2f-4464-aa11-243c5b5ccbe1" (UID: "f2e32e7c-6a2f-4464-aa11-243c5b5ccbe1"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:18:33.960597 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:18:33.960484    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f2e32e7c-6a2f-4464-aa11-243c5b5ccbe1-workload-certs" pod "f2e32e7c-6a2f-4464-aa11-243c5b5ccbe1" (UID: "f2e32e7c-6a2f-4464-aa11-243c5b5ccbe1"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:18:33.960597 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:18:33.960522    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f2e32e7c-6a2f-4464-aa11-243c5b5ccbe1-istiod-ca-cert" pod "f2e32e7c-6a2f-4464-aa11-243c5b5ccbe1" (UID: "f2e32e7c-6a2f-4464-aa11-243c5b5ccbe1"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:18:33.960700 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:18:33.960658    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f2e32e7c-6a2f-4464-aa11-243c5b5ccbe1-istio-data" pod "f2e32e7c-6a2f-4464-aa11-243c5b5ccbe1" (UID: "f2e32e7c-6a2f-4464-aa11-243c5b5ccbe1"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:18:33.960700 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:18:33.960686    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f2e32e7c-6a2f-4464-aa11-243c5b5ccbe1-credential-socket" pod "f2e32e7c-6a2f-4464-aa11-243c5b5ccbe1" (UID: "f2e32e7c-6a2f-4464-aa11-243c5b5ccbe1"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:18:33.960863 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:18:33.960844    6004 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f2e32e7c-6a2f-4464-aa11-243c5b5ccbe1-workload-certs\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:18:33.960903 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:18:33.960870    6004 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f2e32e7c-6a2f-4464-aa11-243c5b5ccbe1-credential-socket\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:18:33.960903 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:18:33.960885    6004 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f2e32e7c-6a2f-4464-aa11-243c5b5ccbe1-workload-socket\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:18:33.960903 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:18:33.960899    6004 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f2e32e7c-6a2f-4464-aa11-243c5b5ccbe1-istiod-ca-cert\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:18:33.960997 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:18:33.960914    6004 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f2e32e7c-6a2f-4464-aa11-243c5b5ccbe1-istio-data\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:18:33.962313 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:18:33.962292    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f2e32e7c-6a2f-4464-aa11-243c5b5ccbe1-kube-api-access-dscq9" pod "f2e32e7c-6a2f-4464-aa11-243c5b5ccbe1" (UID: "f2e32e7c-6a2f-4464-aa11-243c5b5ccbe1"). InnerVolumeSpecName "kube-api-access-dscq9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:18:33.962414 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:18:33.962349    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f2e32e7c-6a2f-4464-aa11-243c5b5ccbe1-istio-envoy" pod "f2e32e7c-6a2f-4464-aa11-243c5b5ccbe1" (UID: "f2e32e7c-6a2f-4464-aa11-243c5b5ccbe1"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:18:33.962605 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:18:33.962583    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/f2e32e7c-6a2f-4464-aa11-243c5b5ccbe1-istio-podinfo" pod "f2e32e7c-6a2f-4464-aa11-243c5b5ccbe1" (UID: "f2e32e7c-6a2f-4464-aa11-243c5b5ccbe1"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 21:18:33.962665 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:18:33.962590    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f2e32e7c-6a2f-4464-aa11-243c5b5ccbe1-istio-token" pod "f2e32e7c-6a2f-4464-aa11-243c5b5ccbe1" (UID: "f2e32e7c-6a2f-4464-aa11-243c5b5ccbe1"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:18:34.062296 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:18:34.062259    6004 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f2e32e7c-6a2f-4464-aa11-243c5b5ccbe1-istio-podinfo\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:18:34.062296 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:18:34.062298    6004 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f2e32e7c-6a2f-4464-aa11-243c5b5ccbe1-istio-envoy\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:18:34.062491 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:18:34.062312    6004 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dscq9\" (UniqueName: \"kubernetes.io/projected/f2e32e7c-6a2f-4464-aa11-243c5b5ccbe1-kube-api-access-dscq9\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:18:34.062491 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:18:34.062326    6004 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f2e32e7c-6a2f-4464-aa11-243c5b5ccbe1-istio-token\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:18:34.849336 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:18:34.849301    6004 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-2b425d-openshift-default-f547dbcbf-5q4qn"
Oct 30 21:18:34.849336 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:18:34.849329    6004 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-2b425d-openshift-default-f547dbcbf-5q4qn" event={"ID":"f2e32e7c-6a2f-4464-aa11-243c5b5ccbe1","Type":"ContainerDied","Data":"3da74deb1fcb94878454dee156c57ab4a0059f8cd540835615f978dcf537b90c"}
Oct 30 21:18:34.849830 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:18:34.849396    6004 scope.go:122] "RemoveContainer" containerID="9c3d96c9cbcb0ea6f576c8fd3bf4bb751e942d5e78d85170f407d565c2b0313f"
Oct 30 21:18:35.068009 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:18:35.067971    6004 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w5-2b425d-openshift-default-f547dbcbf-5q4qn"]
Oct 30 21:18:35.116899 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:18:35.116824    6004 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w5-2b425d-openshift-default-f547dbcbf-5q4qn"]
Oct 30 21:18:36.231262 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:18:36.231219    6004 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="f2e32e7c-6a2f-4464-aa11-243c5b5ccbe1" path="/var/lib/kubelet/pods/f2e32e7c-6a2f-4464-aa11-243c5b5ccbe1/volumes"
Oct 30 21:18:44.286210 ip-10-0-138-85 kubenswrapper[6004]: E1030 21:18:44.286176    6004 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-zz4wr" containerName="extractor"
Oct 30 21:19:01.324246 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:19:01.324162    6004 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w0-781058-774f49c6f8-vlsxt"]
Oct 30 21:19:01.324821 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:19:01.324376    6004 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-781058-774f49c6f8-vlsxt" podUID="ffe16c53-414f-495c-b864-497edeab3871" containerName="maas-api" containerID="cri-o://b7f168528fb575257129486e93348a0aa6bb7e2ce10e8bd78a3ccfb943f420b6" gracePeriod=30
Oct 30 21:19:01.646537 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:19:01.646508    6004 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-781058-774f49c6f8-vlsxt"
Oct 30 21:19:01.694098 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:19:01.694060    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/ffe16c53-414f-495c-b864-497edeab3871-metrics-certs\" (UniqueName: \"kubernetes.io/secret/ffe16c53-414f-495c-b864-497edeab3871-metrics-certs\") pod \"ffe16c53-414f-495c-b864-497edeab3871\" (UID: \"ffe16c53-414f-495c-b864-497edeab3871\") "
Oct 30 21:19:01.694304 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:19:01.694186    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/ffe16c53-414f-495c-b864-497edeab3871-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ffe16c53-414f-495c-b864-497edeab3871-openshift-service-ca\") pod \"ffe16c53-414f-495c-b864-497edeab3871\" (UID: \"ffe16c53-414f-495c-b864-497edeab3871\") "
Oct 30 21:19:01.694373 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:19:01.694319    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/ffe16c53-414f-495c-b864-497edeab3871-kube-api-access-lzfrs\" (UniqueName: \"kubernetes.io/projected/ffe16c53-414f-495c-b864-497edeab3871-kube-api-access-lzfrs\") pod \"ffe16c53-414f-495c-b864-497edeab3871\" (UID: \"ffe16c53-414f-495c-b864-497edeab3871\") "
Oct 30 21:19:01.694432 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:19:01.694377    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/ffe16c53-414f-495c-b864-497edeab3871-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ffe16c53-414f-495c-b864-497edeab3871-maas-api-tls\") pod \"ffe16c53-414f-495c-b864-497edeab3871\" (UID: \"ffe16c53-414f-495c-b864-497edeab3871\") "
Oct 30 21:19:01.695005 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:19:01.694904    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ffe16c53-414f-495c-b864-497edeab3871-openshift-service-ca" pod "ffe16c53-414f-495c-b864-497edeab3871" (UID: "ffe16c53-414f-495c-b864-497edeab3871"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:19:01.696913 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:19:01.696875    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ffe16c53-414f-495c-b864-497edeab3871-metrics-certs" pod "ffe16c53-414f-495c-b864-497edeab3871" (UID: "ffe16c53-414f-495c-b864-497edeab3871"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:19:01.697246 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:19:01.697207    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ffe16c53-414f-495c-b864-497edeab3871-maas-api-tls" pod "ffe16c53-414f-495c-b864-497edeab3871" (UID: "ffe16c53-414f-495c-b864-497edeab3871"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:19:01.697437 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:19:01.697416    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ffe16c53-414f-495c-b864-497edeab3871-kube-api-access-lzfrs" pod "ffe16c53-414f-495c-b864-497edeab3871" (UID: "ffe16c53-414f-495c-b864-497edeab3871"). InnerVolumeSpecName "kube-api-access-lzfrs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:19:01.795692 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:19:01.795652    6004 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lzfrs\" (UniqueName: \"kubernetes.io/projected/ffe16c53-414f-495c-b864-497edeab3871-kube-api-access-lzfrs\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:19:01.795692 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:19:01.795686    6004 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ffe16c53-414f-495c-b864-497edeab3871-maas-api-tls\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:19:01.795692 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:19:01.795700    6004 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ffe16c53-414f-495c-b864-497edeab3871-metrics-certs\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:19:01.795935 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:19:01.795710    6004 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ffe16c53-414f-495c-b864-497edeab3871-openshift-service-ca\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:19:02.036125 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:19:02.036085    6004 generic.go:356] "Generic (PLEG): container finished" podID="ffe16c53-414f-495c-b864-497edeab3871" containerID="b7f168528fb575257129486e93348a0aa6bb7e2ce10e8bd78a3ccfb943f420b6" exitCode=0
Oct 30 21:19:02.036336 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:19:02.036138    6004 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-781058-774f49c6f8-vlsxt"
Oct 30 21:19:02.036336 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:19:02.036172    6004 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-781058-774f49c6f8-vlsxt" event={"ID":"ffe16c53-414f-495c-b864-497edeab3871","Type":"ContainerDied","Data":"b7f168528fb575257129486e93348a0aa6bb7e2ce10e8bd78a3ccfb943f420b6"}
Oct 30 21:19:02.036336 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:19:02.036244    6004 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-781058-774f49c6f8-vlsxt" event={"ID":"ffe16c53-414f-495c-b864-497edeab3871","Type":"ContainerDied","Data":"7e02d5f7443fb1c2a1604eccc498f0df8c37ed7a836d69c25ff4486327cdfe95"}
Oct 30 21:19:02.036336 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:19:02.036273    6004 scope.go:122] "RemoveContainer" containerID="b7f168528fb575257129486e93348a0aa6bb7e2ce10e8bd78a3ccfb943f420b6"
Oct 30 21:19:02.048210 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:19:02.048185    6004 scope.go:122] "RemoveContainer" containerID="b7f168528fb575257129486e93348a0aa6bb7e2ce10e8bd78a3ccfb943f420b6"
Oct 30 21:19:02.048503 ip-10-0-138-85 kubenswrapper[6004]: E1030 21:19:02.048476    6004 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b7f168528fb575257129486e93348a0aa6bb7e2ce10e8bd78a3ccfb943f420b6\": container with ID starting with b7f168528fb575257129486e93348a0aa6bb7e2ce10e8bd78a3ccfb943f420b6 not found: ID does not exist" containerID="b7f168528fb575257129486e93348a0aa6bb7e2ce10e8bd78a3ccfb943f420b6"
Oct 30 21:19:02.048561 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:19:02.048515    6004 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b7f168528fb575257129486e93348a0aa6bb7e2ce10e8bd78a3ccfb943f420b6"} err="failed to get container status \"b7f168528fb575257129486e93348a0aa6bb7e2ce10e8bd78a3ccfb943f420b6\": rpc error: code = NotFound desc = could not find container \"b7f168528fb575257129486e93348a0aa6bb7e2ce10e8bd78a3ccfb943f420b6\": container with ID starting with b7f168528fb575257129486e93348a0aa6bb7e2ce10e8bd78a3ccfb943f420b6 not found: ID does not exist"
Oct 30 21:19:02.201953 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:19:02.201919    6004 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w0-781058-774f49c6f8-vlsxt"]
Oct 30 21:19:02.205414 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:19:02.205387    6004 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w0-781058-774f49c6f8-vlsxt"]
Oct 30 21:19:02.232731 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:19:02.232702    6004 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="ffe16c53-414f-495c-b864-497edeab3871" path="/var/lib/kubelet/pods/ffe16c53-414f-495c-b864-497edeab3871/volumes"
Oct 30 21:19:10.410886 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:19:10.410852    6004 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w0-781058-openshift-default-55fb495b7-6mqk2"]
Oct 30 21:19:10.411464 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:19:10.411176    6004 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w0-781058-openshift-default-55fb495b7-6mqk2" podUID="d8c44f87-9b8f-4838-bd12-d48dd55a08d0" containerName="istio-proxy" containerID="cri-o://5c65a9825e6b085f3676f2e77d0bc521bf7555cc2c794fb5ba1cce9c60d79d03" gracePeriod=30
Oct 30 21:19:14.288023 ip-10-0-138-85 kubenswrapper[6004]: E1030 21:19:14.287979    6004 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-zz4wr" containerName="extractor"
Oct 30 21:19:14.882614 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:19:14.882581    6004 scope.go:122] "RemoveContainer" containerID="bb4e6a4aa50dbf74fb29b2c7a0a56ab503699e6325903ae7a4acd7c14eac3b56"
Oct 30 21:19:14.894779 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:19:14.894751    6004 scope.go:122] "RemoveContainer" containerID="a462ef876272b72c1d55b97cc7a5bb2301e6d504294aa90e10a9bc4215a100dd"
Oct 30 21:19:15.696482 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:19:15.696454    6004 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-781058-openshift-default-55fb495b7-6mqk2"
Oct 30 21:19:15.766518 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:19:15.766479    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/d8c44f87-9b8f-4838-bd12-d48dd55a08d0-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d8c44f87-9b8f-4838-bd12-d48dd55a08d0-istio-data\") pod \"d8c44f87-9b8f-4838-bd12-d48dd55a08d0\" (UID: \"d8c44f87-9b8f-4838-bd12-d48dd55a08d0\") "
Oct 30 21:19:15.766518 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:19:15.766522    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/d8c44f87-9b8f-4838-bd12-d48dd55a08d0-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d8c44f87-9b8f-4838-bd12-d48dd55a08d0-workload-socket\") pod \"d8c44f87-9b8f-4838-bd12-d48dd55a08d0\" (UID: \"d8c44f87-9b8f-4838-bd12-d48dd55a08d0\") "
Oct 30 21:19:15.766750 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:19:15.766573    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/d8c44f87-9b8f-4838-bd12-d48dd55a08d0-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d8c44f87-9b8f-4838-bd12-d48dd55a08d0-workload-certs\") pod \"d8c44f87-9b8f-4838-bd12-d48dd55a08d0\" (UID: \"d8c44f87-9b8f-4838-bd12-d48dd55a08d0\") "
Oct 30 21:19:15.766750 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:19:15.766608    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/d8c44f87-9b8f-4838-bd12-d48dd55a08d0-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d8c44f87-9b8f-4838-bd12-d48dd55a08d0-istio-podinfo\") pod \"d8c44f87-9b8f-4838-bd12-d48dd55a08d0\" (UID: \"d8c44f87-9b8f-4838-bd12-d48dd55a08d0\") "
Oct 30 21:19:15.766750 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:19:15.766660    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/d8c44f87-9b8f-4838-bd12-d48dd55a08d0-kube-api-access-9x97s\" (UniqueName: \"kubernetes.io/projected/d8c44f87-9b8f-4838-bd12-d48dd55a08d0-kube-api-access-9x97s\") pod \"d8c44f87-9b8f-4838-bd12-d48dd55a08d0\" (UID: \"d8c44f87-9b8f-4838-bd12-d48dd55a08d0\") "
Oct 30 21:19:15.766963 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:19:15.766771    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/d8c44f87-9b8f-4838-bd12-d48dd55a08d0-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d8c44f87-9b8f-4838-bd12-d48dd55a08d0-istio-envoy\") pod \"d8c44f87-9b8f-4838-bd12-d48dd55a08d0\" (UID: \"d8c44f87-9b8f-4838-bd12-d48dd55a08d0\") "
Oct 30 21:19:15.766963 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:19:15.766799    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/d8c44f87-9b8f-4838-bd12-d48dd55a08d0-istio-token\" (UniqueName: \"kubernetes.io/projected/d8c44f87-9b8f-4838-bd12-d48dd55a08d0-istio-token\") pod \"d8c44f87-9b8f-4838-bd12-d48dd55a08d0\" (UID: \"d8c44f87-9b8f-4838-bd12-d48dd55a08d0\") "
Oct 30 21:19:15.766963 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:19:15.766864    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/d8c44f87-9b8f-4838-bd12-d48dd55a08d0-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d8c44f87-9b8f-4838-bd12-d48dd55a08d0-istiod-ca-cert\") pod \"d8c44f87-9b8f-4838-bd12-d48dd55a08d0\" (UID: \"d8c44f87-9b8f-4838-bd12-d48dd55a08d0\") "
Oct 30 21:19:15.766963 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:19:15.766766    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d8c44f87-9b8f-4838-bd12-d48dd55a08d0-istio-data" pod "d8c44f87-9b8f-4838-bd12-d48dd55a08d0" (UID: "d8c44f87-9b8f-4838-bd12-d48dd55a08d0"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:19:15.766963 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:19:15.766857    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d8c44f87-9b8f-4838-bd12-d48dd55a08d0-workload-socket" pod "d8c44f87-9b8f-4838-bd12-d48dd55a08d0" (UID: "d8c44f87-9b8f-4838-bd12-d48dd55a08d0"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:19:15.766963 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:19:15.766909    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d8c44f87-9b8f-4838-bd12-d48dd55a08d0-workload-certs" pod "d8c44f87-9b8f-4838-bd12-d48dd55a08d0" (UID: "d8c44f87-9b8f-4838-bd12-d48dd55a08d0"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:19:15.766963 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:19:15.766939    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/d8c44f87-9b8f-4838-bd12-d48dd55a08d0-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d8c44f87-9b8f-4838-bd12-d48dd55a08d0-credential-socket\") pod \"d8c44f87-9b8f-4838-bd12-d48dd55a08d0\" (UID: \"d8c44f87-9b8f-4838-bd12-d48dd55a08d0\") "
Oct 30 21:19:15.767424 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:19:15.767361    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d8c44f87-9b8f-4838-bd12-d48dd55a08d0-credential-socket" pod "d8c44f87-9b8f-4838-bd12-d48dd55a08d0" (UID: "d8c44f87-9b8f-4838-bd12-d48dd55a08d0"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:19:15.767424 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:19:15.767396    6004 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d8c44f87-9b8f-4838-bd12-d48dd55a08d0-istio-data\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:19:15.767424 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:19:15.767417    6004 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d8c44f87-9b8f-4838-bd12-d48dd55a08d0-workload-socket\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:19:15.767577 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:19:15.767433    6004 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d8c44f87-9b8f-4838-bd12-d48dd55a08d0-workload-certs\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:19:15.767577 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:19:15.767531    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d8c44f87-9b8f-4838-bd12-d48dd55a08d0-istiod-ca-cert" pod "d8c44f87-9b8f-4838-bd12-d48dd55a08d0" (UID: "d8c44f87-9b8f-4838-bd12-d48dd55a08d0"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:19:15.769454 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:19:15.769427    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d8c44f87-9b8f-4838-bd12-d48dd55a08d0-istio-token" pod "d8c44f87-9b8f-4838-bd12-d48dd55a08d0" (UID: "d8c44f87-9b8f-4838-bd12-d48dd55a08d0"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:19:15.769590 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:19:15.769489    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d8c44f87-9b8f-4838-bd12-d48dd55a08d0-istio-envoy" pod "d8c44f87-9b8f-4838-bd12-d48dd55a08d0" (UID: "d8c44f87-9b8f-4838-bd12-d48dd55a08d0"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:19:15.769590 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:19:15.769497    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d8c44f87-9b8f-4838-bd12-d48dd55a08d0-kube-api-access-9x97s" pod "d8c44f87-9b8f-4838-bd12-d48dd55a08d0" (UID: "d8c44f87-9b8f-4838-bd12-d48dd55a08d0"). InnerVolumeSpecName "kube-api-access-9x97s". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:19:15.769707 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:19:15.769689    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/d8c44f87-9b8f-4838-bd12-d48dd55a08d0-istio-podinfo" pod "d8c44f87-9b8f-4838-bd12-d48dd55a08d0" (UID: "d8c44f87-9b8f-4838-bd12-d48dd55a08d0"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 21:19:15.869146 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:19:15.869110    6004 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d8c44f87-9b8f-4838-bd12-d48dd55a08d0-istio-podinfo\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:19:15.869146 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:19:15.869148    6004 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9x97s\" (UniqueName: \"kubernetes.io/projected/d8c44f87-9b8f-4838-bd12-d48dd55a08d0-kube-api-access-9x97s\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:19:15.869344 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:19:15.869164    6004 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d8c44f87-9b8f-4838-bd12-d48dd55a08d0-istio-envoy\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:19:15.869344 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:19:15.869177    6004 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d8c44f87-9b8f-4838-bd12-d48dd55a08d0-istio-token\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:19:15.869344 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:19:15.869191    6004 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d8c44f87-9b8f-4838-bd12-d48dd55a08d0-istiod-ca-cert\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:19:15.869344 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:19:15.869205    6004 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d8c44f87-9b8f-4838-bd12-d48dd55a08d0-credential-socket\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:19:16.124838 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:19:16.124799    6004 generic.go:356] "Generic (PLEG): container finished" podID="d8c44f87-9b8f-4838-bd12-d48dd55a08d0" containerID="5c65a9825e6b085f3676f2e77d0bc521bf7555cc2c794fb5ba1cce9c60d79d03" exitCode=0
Oct 30 21:19:16.125012 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:19:16.124843    6004 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-781058-openshift-default-55fb495b7-6mqk2"
Oct 30 21:19:16.125012 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:19:16.124877    6004 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-781058-openshift-default-55fb495b7-6mqk2" event={"ID":"d8c44f87-9b8f-4838-bd12-d48dd55a08d0","Type":"ContainerDied","Data":"5c65a9825e6b085f3676f2e77d0bc521bf7555cc2c794fb5ba1cce9c60d79d03"}
Oct 30 21:19:16.125012 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:19:16.124932    6004 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-781058-openshift-default-55fb495b7-6mqk2" event={"ID":"d8c44f87-9b8f-4838-bd12-d48dd55a08d0","Type":"ContainerDied","Data":"36d8155b4e70f7bf1ade57d12638765b2f0e9d085217eace90441ffc09cbff8b"}
Oct 30 21:19:16.125012 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:19:16.124958    6004 scope.go:122] "RemoveContainer" containerID="5c65a9825e6b085f3676f2e77d0bc521bf7555cc2c794fb5ba1cce9c60d79d03"
Oct 30 21:19:16.136803 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:19:16.136787    6004 scope.go:122] "RemoveContainer" containerID="800e1e6882eeb4616d2615d0e9b78a9f22722f55df2dfceb33c58c8a1b32eef6"
Oct 30 21:19:16.147657 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:19:16.147639    6004 scope.go:122] "RemoveContainer" containerID="5c65a9825e6b085f3676f2e77d0bc521bf7555cc2c794fb5ba1cce9c60d79d03"
Oct 30 21:19:16.147916 ip-10-0-138-85 kubenswrapper[6004]: E1030 21:19:16.147888    6004 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5c65a9825e6b085f3676f2e77d0bc521bf7555cc2c794fb5ba1cce9c60d79d03\": container with ID starting with 5c65a9825e6b085f3676f2e77d0bc521bf7555cc2c794fb5ba1cce9c60d79d03 not found: ID does not exist" containerID="5c65a9825e6b085f3676f2e77d0bc521bf7555cc2c794fb5ba1cce9c60d79d03"
Oct 30 21:19:16.147998 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:19:16.147920    6004 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5c65a9825e6b085f3676f2e77d0bc521bf7555cc2c794fb5ba1cce9c60d79d03"} err="failed to get container status \"5c65a9825e6b085f3676f2e77d0bc521bf7555cc2c794fb5ba1cce9c60d79d03\": rpc error: code = NotFound desc = could not find container \"5c65a9825e6b085f3676f2e77d0bc521bf7555cc2c794fb5ba1cce9c60d79d03\": container with ID starting with 5c65a9825e6b085f3676f2e77d0bc521bf7555cc2c794fb5ba1cce9c60d79d03 not found: ID does not exist"
Oct 30 21:19:16.147998 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:19:16.147944    6004 scope.go:122] "RemoveContainer" containerID="800e1e6882eeb4616d2615d0e9b78a9f22722f55df2dfceb33c58c8a1b32eef6"
Oct 30 21:19:16.148231 ip-10-0-138-85 kubenswrapper[6004]: E1030 21:19:16.148208    6004 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"800e1e6882eeb4616d2615d0e9b78a9f22722f55df2dfceb33c58c8a1b32eef6\": container with ID starting with 800e1e6882eeb4616d2615d0e9b78a9f22722f55df2dfceb33c58c8a1b32eef6 not found: ID does not exist" containerID="800e1e6882eeb4616d2615d0e9b78a9f22722f55df2dfceb33c58c8a1b32eef6"
Oct 30 21:19:16.148274 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:19:16.148248    6004 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"800e1e6882eeb4616d2615d0e9b78a9f22722f55df2dfceb33c58c8a1b32eef6"} err="failed to get container status \"800e1e6882eeb4616d2615d0e9b78a9f22722f55df2dfceb33c58c8a1b32eef6\": rpc error: code = NotFound desc = could not find container \"800e1e6882eeb4616d2615d0e9b78a9f22722f55df2dfceb33c58c8a1b32eef6\": container with ID starting with 800e1e6882eeb4616d2615d0e9b78a9f22722f55df2dfceb33c58c8a1b32eef6 not found: ID does not exist"
Oct 30 21:19:16.289890 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:19:16.289851    6004 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w0-781058-openshift-default-55fb495b7-6mqk2"]
Oct 30 21:19:16.340380 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:19:16.340341    6004 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w0-781058-openshift-default-55fb495b7-6mqk2"]
Oct 30 21:19:18.231078 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:19:18.231033    6004 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="d8c44f87-9b8f-4838-bd12-d48dd55a08d0" path="/var/lib/kubelet/pods/d8c44f87-9b8f-4838-bd12-d48dd55a08d0/volumes"
Oct 30 21:19:31.709453 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:19:31.709418    6004 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w1-f9f277-89dcd697f-45nmx"]
Oct 30 21:19:31.709977 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:19:31.709624    6004 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-f9f277-89dcd697f-45nmx" podUID="a651327d-e3a3-4fcb-8070-1e0deeb0ea90" containerName="maas-api" containerID="cri-o://f58af8fa5de7727afee975da444819862bd4f234b6549849df295e9124459e89" gracePeriod=30
Oct 30 21:19:32.019484 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:19:32.019450    6004 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-f9f277-89dcd697f-45nmx"
Oct 30 21:19:32.055317 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:19:32.055271    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/a651327d-e3a3-4fcb-8070-1e0deeb0ea90-kube-api-access-bscvw\" (UniqueName: \"kubernetes.io/projected/a651327d-e3a3-4fcb-8070-1e0deeb0ea90-kube-api-access-bscvw\") pod \"a651327d-e3a3-4fcb-8070-1e0deeb0ea90\" (UID: \"a651327d-e3a3-4fcb-8070-1e0deeb0ea90\") "
Oct 30 21:19:32.055483 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:19:32.055393    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/a651327d-e3a3-4fcb-8070-1e0deeb0ea90-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a651327d-e3a3-4fcb-8070-1e0deeb0ea90-maas-api-tls\") pod \"a651327d-e3a3-4fcb-8070-1e0deeb0ea90\" (UID: \"a651327d-e3a3-4fcb-8070-1e0deeb0ea90\") "
Oct 30 21:19:32.057408 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:19:32.057377    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a651327d-e3a3-4fcb-8070-1e0deeb0ea90-maas-api-tls" pod "a651327d-e3a3-4fcb-8070-1e0deeb0ea90" (UID: "a651327d-e3a3-4fcb-8070-1e0deeb0ea90"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:19:32.057549 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:19:32.057507    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a651327d-e3a3-4fcb-8070-1e0deeb0ea90-kube-api-access-bscvw" pod "a651327d-e3a3-4fcb-8070-1e0deeb0ea90" (UID: "a651327d-e3a3-4fcb-8070-1e0deeb0ea90"). InnerVolumeSpecName "kube-api-access-bscvw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:19:32.163300 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:19:32.163253    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/a651327d-e3a3-4fcb-8070-1e0deeb0ea90-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a651327d-e3a3-4fcb-8070-1e0deeb0ea90-openshift-service-ca\") pod \"a651327d-e3a3-4fcb-8070-1e0deeb0ea90\" (UID: \"a651327d-e3a3-4fcb-8070-1e0deeb0ea90\") "
Oct 30 21:19:32.163503 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:19:32.163476    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/a651327d-e3a3-4fcb-8070-1e0deeb0ea90-metrics-certs\" (UniqueName: \"kubernetes.io/secret/a651327d-e3a3-4fcb-8070-1e0deeb0ea90-metrics-certs\") pod \"a651327d-e3a3-4fcb-8070-1e0deeb0ea90\" (UID: \"a651327d-e3a3-4fcb-8070-1e0deeb0ea90\") "
Oct 30 21:19:32.163938 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:19:32.163619    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a651327d-e3a3-4fcb-8070-1e0deeb0ea90-openshift-service-ca" pod "a651327d-e3a3-4fcb-8070-1e0deeb0ea90" (UID: "a651327d-e3a3-4fcb-8070-1e0deeb0ea90"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:19:32.164104 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:19:32.164081    6004 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a651327d-e3a3-4fcb-8070-1e0deeb0ea90-maas-api-tls\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:19:32.164197 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:19:32.164109    6004 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a651327d-e3a3-4fcb-8070-1e0deeb0ea90-openshift-service-ca\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:19:32.164197 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:19:32.164123    6004 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bscvw\" (UniqueName: \"kubernetes.io/projected/a651327d-e3a3-4fcb-8070-1e0deeb0ea90-kube-api-access-bscvw\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:19:32.168947 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:19:32.166461    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a651327d-e3a3-4fcb-8070-1e0deeb0ea90-metrics-certs" pod "a651327d-e3a3-4fcb-8070-1e0deeb0ea90" (UID: "a651327d-e3a3-4fcb-8070-1e0deeb0ea90"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:19:32.232227 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:19:32.232196    6004 generic.go:356] "Generic (PLEG): container finished" podID="a651327d-e3a3-4fcb-8070-1e0deeb0ea90" containerID="f58af8fa5de7727afee975da444819862bd4f234b6549849df295e9124459e89" exitCode=0
Oct 30 21:19:32.232397 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:19:32.232307    6004 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-f9f277-89dcd697f-45nmx"
Oct 30 21:19:32.232841 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:19:32.232815    6004 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-f9f277-89dcd697f-45nmx" event={"ID":"a651327d-e3a3-4fcb-8070-1e0deeb0ea90","Type":"ContainerDied","Data":"f58af8fa5de7727afee975da444819862bd4f234b6549849df295e9124459e89"}
Oct 30 21:19:32.232904 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:19:32.232862    6004 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-f9f277-89dcd697f-45nmx" event={"ID":"a651327d-e3a3-4fcb-8070-1e0deeb0ea90","Type":"ContainerDied","Data":"b620dab4b480e874a7e2177727e056bac564d6560c601e1384ea13c024e689d7"}
Oct 30 21:19:32.232904 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:19:32.232890    6004 scope.go:122] "RemoveContainer" containerID="f58af8fa5de7727afee975da444819862bd4f234b6549849df295e9124459e89"
Oct 30 21:19:32.244488 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:19:32.244468    6004 scope.go:122] "RemoveContainer" containerID="f58af8fa5de7727afee975da444819862bd4f234b6549849df295e9124459e89"
Oct 30 21:19:32.244761 ip-10-0-138-85 kubenswrapper[6004]: E1030 21:19:32.244741    6004 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f58af8fa5de7727afee975da444819862bd4f234b6549849df295e9124459e89\": container with ID starting with f58af8fa5de7727afee975da444819862bd4f234b6549849df295e9124459e89 not found: ID does not exist" containerID="f58af8fa5de7727afee975da444819862bd4f234b6549849df295e9124459e89"
Oct 30 21:19:32.244826 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:19:32.244769    6004 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f58af8fa5de7727afee975da444819862bd4f234b6549849df295e9124459e89"} err="failed to get container status \"f58af8fa5de7727afee975da444819862bd4f234b6549849df295e9124459e89\": rpc error: code = NotFound desc = could not find container \"f58af8fa5de7727afee975da444819862bd4f234b6549849df295e9124459e89\": container with ID starting with f58af8fa5de7727afee975da444819862bd4f234b6549849df295e9124459e89 not found: ID does not exist"
Oct 30 21:19:32.272514 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:19:32.265847    6004 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a651327d-e3a3-4fcb-8070-1e0deeb0ea90-metrics-certs\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:19:32.404855 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:19:32.404823    6004 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w1-f9f277-89dcd697f-45nmx"]
Oct 30 21:19:32.408582 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:19:32.408557    6004 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w1-f9f277-89dcd697f-45nmx"]
Oct 30 21:19:34.232273 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:19:34.232238    6004 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="a651327d-e3a3-4fcb-8070-1e0deeb0ea90" path="/var/lib/kubelet/pods/a651327d-e3a3-4fcb-8070-1e0deeb0ea90/volumes"
Oct 30 21:19:40.584947 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:19:40.584909    6004 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w1-f9f277-openshift-default-869d58fb77-xbhch"]
Oct 30 21:19:40.585328 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:19:40.585127    6004 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w1-f9f277-openshift-default-869d58fb77-xbhch" podUID="7b81a18e-7cc3-4ed4-b08e-20e426d4c3e1" containerName="istio-proxy" containerID="cri-o://c42b3540610ffdfbecb349d1f724ad59a74469c3492a0e717b7ad66663c801b5" gracePeriod=30
Oct 30 21:19:44.286597 ip-10-0-138-85 kubenswrapper[6004]: E1030 21:19:44.286560    6004 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-zz4wr" containerName="extractor"
Oct 30 21:19:45.836451 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:19:45.836426    6004 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-f9f277-openshift-default-869d58fb77-xbhch"
Oct 30 21:19:45.919255 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:19:45.919177    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/7b81a18e-7cc3-4ed4-b08e-20e426d4c3e1-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7b81a18e-7cc3-4ed4-b08e-20e426d4c3e1-istio-envoy\") pod \"7b81a18e-7cc3-4ed4-b08e-20e426d4c3e1\" (UID: \"7b81a18e-7cc3-4ed4-b08e-20e426d4c3e1\") "
Oct 30 21:19:45.919255 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:19:45.919228    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/7b81a18e-7cc3-4ed4-b08e-20e426d4c3e1-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7b81a18e-7cc3-4ed4-b08e-20e426d4c3e1-istiod-ca-cert\") pod \"7b81a18e-7cc3-4ed4-b08e-20e426d4c3e1\" (UID: \"7b81a18e-7cc3-4ed4-b08e-20e426d4c3e1\") "
Oct 30 21:19:45.919255 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:19:45.919248    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/7b81a18e-7cc3-4ed4-b08e-20e426d4c3e1-istio-token\" (UniqueName: \"kubernetes.io/projected/7b81a18e-7cc3-4ed4-b08e-20e426d4c3e1-istio-token\") pod \"7b81a18e-7cc3-4ed4-b08e-20e426d4c3e1\" (UID: \"7b81a18e-7cc3-4ed4-b08e-20e426d4c3e1\") "
Oct 30 21:19:45.919579 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:19:45.919302    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/7b81a18e-7cc3-4ed4-b08e-20e426d4c3e1-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7b81a18e-7cc3-4ed4-b08e-20e426d4c3e1-workload-socket\") pod \"7b81a18e-7cc3-4ed4-b08e-20e426d4c3e1\" (UID: \"7b81a18e-7cc3-4ed4-b08e-20e426d4c3e1\") "
Oct 30 21:19:45.919579 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:19:45.919321    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/7b81a18e-7cc3-4ed4-b08e-20e426d4c3e1-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7b81a18e-7cc3-4ed4-b08e-20e426d4c3e1-workload-certs\") pod \"7b81a18e-7cc3-4ed4-b08e-20e426d4c3e1\" (UID: \"7b81a18e-7cc3-4ed4-b08e-20e426d4c3e1\") "
Oct 30 21:19:45.919579 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:19:45.919390    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/7b81a18e-7cc3-4ed4-b08e-20e426d4c3e1-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7b81a18e-7cc3-4ed4-b08e-20e426d4c3e1-istio-podinfo\") pod \"7b81a18e-7cc3-4ed4-b08e-20e426d4c3e1\" (UID: \"7b81a18e-7cc3-4ed4-b08e-20e426d4c3e1\") "
Oct 30 21:19:45.919579 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:19:45.919427    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/7b81a18e-7cc3-4ed4-b08e-20e426d4c3e1-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7b81a18e-7cc3-4ed4-b08e-20e426d4c3e1-istio-data\") pod \"7b81a18e-7cc3-4ed4-b08e-20e426d4c3e1\" (UID: \"7b81a18e-7cc3-4ed4-b08e-20e426d4c3e1\") "
Oct 30 21:19:45.919579 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:19:45.919463    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/7b81a18e-7cc3-4ed4-b08e-20e426d4c3e1-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7b81a18e-7cc3-4ed4-b08e-20e426d4c3e1-credential-socket\") pod \"7b81a18e-7cc3-4ed4-b08e-20e426d4c3e1\" (UID: \"7b81a18e-7cc3-4ed4-b08e-20e426d4c3e1\") "
Oct 30 21:19:45.919860 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:19:45.919581    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/7b81a18e-7cc3-4ed4-b08e-20e426d4c3e1-kube-api-access-2svql\" (UniqueName: \"kubernetes.io/projected/7b81a18e-7cc3-4ed4-b08e-20e426d4c3e1-kube-api-access-2svql\") pod \"7b81a18e-7cc3-4ed4-b08e-20e426d4c3e1\" (UID: \"7b81a18e-7cc3-4ed4-b08e-20e426d4c3e1\") "
Oct 30 21:19:45.919860 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:19:45.919602    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7b81a18e-7cc3-4ed4-b08e-20e426d4c3e1-workload-socket" pod "7b81a18e-7cc3-4ed4-b08e-20e426d4c3e1" (UID: "7b81a18e-7cc3-4ed4-b08e-20e426d4c3e1"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:19:45.919860 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:19:45.919629    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7b81a18e-7cc3-4ed4-b08e-20e426d4c3e1-istiod-ca-cert" pod "7b81a18e-7cc3-4ed4-b08e-20e426d4c3e1" (UID: "7b81a18e-7cc3-4ed4-b08e-20e426d4c3e1"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:19:45.919860 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:19:45.919675    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7b81a18e-7cc3-4ed4-b08e-20e426d4c3e1-workload-certs" pod "7b81a18e-7cc3-4ed4-b08e-20e426d4c3e1" (UID: "7b81a18e-7cc3-4ed4-b08e-20e426d4c3e1"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:19:45.919860 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:19:45.919716    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7b81a18e-7cc3-4ed4-b08e-20e426d4c3e1-istio-data" pod "7b81a18e-7cc3-4ed4-b08e-20e426d4c3e1" (UID: "7b81a18e-7cc3-4ed4-b08e-20e426d4c3e1"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:19:45.919860 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:19:45.919798    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7b81a18e-7cc3-4ed4-b08e-20e426d4c3e1-credential-socket" pod "7b81a18e-7cc3-4ed4-b08e-20e426d4c3e1" (UID: "7b81a18e-7cc3-4ed4-b08e-20e426d4c3e1"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:19:45.920174 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:19:45.919962    6004 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7b81a18e-7cc3-4ed4-b08e-20e426d4c3e1-workload-socket\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:19:45.920174 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:19:45.919981    6004 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7b81a18e-7cc3-4ed4-b08e-20e426d4c3e1-workload-certs\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:19:45.920174 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:19:45.919995    6004 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7b81a18e-7cc3-4ed4-b08e-20e426d4c3e1-istio-data\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:19:45.920174 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:19:45.920010    6004 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7b81a18e-7cc3-4ed4-b08e-20e426d4c3e1-credential-socket\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:19:45.920174 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:19:45.920026    6004 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7b81a18e-7cc3-4ed4-b08e-20e426d4c3e1-istiod-ca-cert\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:19:45.921614 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:19:45.921589    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/7b81a18e-7cc3-4ed4-b08e-20e426d4c3e1-istio-podinfo" pod "7b81a18e-7cc3-4ed4-b08e-20e426d4c3e1" (UID: "7b81a18e-7cc3-4ed4-b08e-20e426d4c3e1"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 21:19:45.921861 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:19:45.921832    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7b81a18e-7cc3-4ed4-b08e-20e426d4c3e1-istio-envoy" pod "7b81a18e-7cc3-4ed4-b08e-20e426d4c3e1" (UID: "7b81a18e-7cc3-4ed4-b08e-20e426d4c3e1"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:19:45.921959 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:19:45.921835    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7b81a18e-7cc3-4ed4-b08e-20e426d4c3e1-istio-token" pod "7b81a18e-7cc3-4ed4-b08e-20e426d4c3e1" (UID: "7b81a18e-7cc3-4ed4-b08e-20e426d4c3e1"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:19:45.922083 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:19:45.922057    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7b81a18e-7cc3-4ed4-b08e-20e426d4c3e1-kube-api-access-2svql" pod "7b81a18e-7cc3-4ed4-b08e-20e426d4c3e1" (UID: "7b81a18e-7cc3-4ed4-b08e-20e426d4c3e1"). InnerVolumeSpecName "kube-api-access-2svql". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:19:46.021120 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:19:46.021088    6004 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7b81a18e-7cc3-4ed4-b08e-20e426d4c3e1-istio-token\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:19:46.021120 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:19:46.021119    6004 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7b81a18e-7cc3-4ed4-b08e-20e426d4c3e1-istio-podinfo\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:19:46.021354 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:19:46.021129    6004 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2svql\" (UniqueName: \"kubernetes.io/projected/7b81a18e-7cc3-4ed4-b08e-20e426d4c3e1-kube-api-access-2svql\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:19:46.021354 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:19:46.021139    6004 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7b81a18e-7cc3-4ed4-b08e-20e426d4c3e1-istio-envoy\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:19:46.317175 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:19:46.317140    6004 generic.go:356] "Generic (PLEG): container finished" podID="7b81a18e-7cc3-4ed4-b08e-20e426d4c3e1" containerID="c42b3540610ffdfbecb349d1f724ad59a74469c3492a0e717b7ad66663c801b5" exitCode=0
Oct 30 21:19:46.317357 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:19:46.317208    6004 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-f9f277-openshift-default-869d58fb77-xbhch"
Oct 30 21:19:46.317357 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:19:46.317224    6004 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-f9f277-openshift-default-869d58fb77-xbhch" event={"ID":"7b81a18e-7cc3-4ed4-b08e-20e426d4c3e1","Type":"ContainerDied","Data":"c42b3540610ffdfbecb349d1f724ad59a74469c3492a0e717b7ad66663c801b5"}
Oct 30 21:19:46.317357 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:19:46.317283    6004 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-f9f277-openshift-default-869d58fb77-xbhch" event={"ID":"7b81a18e-7cc3-4ed4-b08e-20e426d4c3e1","Type":"ContainerDied","Data":"ff20a13bafeae47a6fa7b916e9e1a9f8fa6b3c9847b49a94528c724387dd6328"}
Oct 30 21:19:46.317357 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:19:46.317306    6004 scope.go:122] "RemoveContainer" containerID="c42b3540610ffdfbecb349d1f724ad59a74469c3492a0e717b7ad66663c801b5"
Oct 30 21:19:46.327775 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:19:46.327754    6004 scope.go:122] "RemoveContainer" containerID="c42b3540610ffdfbecb349d1f724ad59a74469c3492a0e717b7ad66663c801b5"
Oct 30 21:19:46.328096 ip-10-0-138-85 kubenswrapper[6004]: E1030 21:19:46.328071    6004 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c42b3540610ffdfbecb349d1f724ad59a74469c3492a0e717b7ad66663c801b5\": container with ID starting with c42b3540610ffdfbecb349d1f724ad59a74469c3492a0e717b7ad66663c801b5 not found: ID does not exist" containerID="c42b3540610ffdfbecb349d1f724ad59a74469c3492a0e717b7ad66663c801b5"
Oct 30 21:19:46.328177 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:19:46.328107    6004 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c42b3540610ffdfbecb349d1f724ad59a74469c3492a0e717b7ad66663c801b5"} err="failed to get container status \"c42b3540610ffdfbecb349d1f724ad59a74469c3492a0e717b7ad66663c801b5\": rpc error: code = NotFound desc = could not find container \"c42b3540610ffdfbecb349d1f724ad59a74469c3492a0e717b7ad66663c801b5\": container with ID starting with c42b3540610ffdfbecb349d1f724ad59a74469c3492a0e717b7ad66663c801b5 not found: ID does not exist"
Oct 30 21:19:46.483203 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:19:46.483166    6004 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w1-f9f277-openshift-default-869d58fb77-xbhch"]
Oct 30 21:19:46.533732 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:19:46.533631    6004 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w1-f9f277-openshift-default-869d58fb77-xbhch"]
Oct 30 21:19:48.231136 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:19:48.231095    6004 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="7b81a18e-7cc3-4ed4-b08e-20e426d4c3e1" path="/var/lib/kubelet/pods/7b81a18e-7cc3-4ed4-b08e-20e426d4c3e1/volumes"
Oct 30 21:20:13.291281 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:20:13.291244    6004 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7269-1a90b4"]
Oct 30 21:20:13.291745 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:20:13.291705    6004 cpu_manager.go:414] "containerMap: removing container" podUID="d8c44f87-9b8f-4838-bd12-d48dd55a08d0" containerName="istio-proxy"
Oct 30 21:20:13.291745 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:20:13.291717    6004 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="d8c44f87-9b8f-4838-bd12-d48dd55a08d0" containerName="istio-proxy"
Oct 30 21:20:13.291745 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:20:13.291735    6004 cpu_manager.go:414] "containerMap: removing container" podUID="d8c44f87-9b8f-4838-bd12-d48dd55a08d0" containerName="istio-proxy"
Oct 30 21:20:13.291745 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:20:13.291741    6004 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="d8c44f87-9b8f-4838-bd12-d48dd55a08d0" containerName="istio-proxy"
Oct 30 21:20:13.291883 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:20:13.291762    6004 cpu_manager.go:414] "containerMap: removing container" podUID="f2e32e7c-6a2f-4464-aa11-243c5b5ccbe1" containerName="istio-proxy"
Oct 30 21:20:13.291883 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:20:13.291768    6004 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="f2e32e7c-6a2f-4464-aa11-243c5b5ccbe1" containerName="istio-proxy"
Oct 30 21:20:13.291883 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:20:13.291783    6004 cpu_manager.go:414] "containerMap: removing container" podUID="a651327d-e3a3-4fcb-8070-1e0deeb0ea90" containerName="maas-api"
Oct 30 21:20:13.291883 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:20:13.291788    6004 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="a651327d-e3a3-4fcb-8070-1e0deeb0ea90" containerName="maas-api"
Oct 30 21:20:13.291883 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:20:13.291796    6004 cpu_manager.go:414] "containerMap: removing container" podUID="7b81a18e-7cc3-4ed4-b08e-20e426d4c3e1" containerName="istio-proxy"
Oct 30 21:20:13.291883 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:20:13.291801    6004 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="7b81a18e-7cc3-4ed4-b08e-20e426d4c3e1" containerName="istio-proxy"
Oct 30 21:20:13.291883 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:20:13.291813    6004 cpu_manager.go:414] "containerMap: removing container" podUID="ffe16c53-414f-495c-b864-497edeab3871" containerName="maas-api"
Oct 30 21:20:13.291883 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:20:13.291817    6004 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="ffe16c53-414f-495c-b864-497edeab3871" containerName="maas-api"
Oct 30 21:20:13.291883 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:20:13.291824    6004 cpu_manager.go:414] "containerMap: removing container" podUID="d7b91b87-18a8-42be-8652-137ee8b789a1" containerName="maas-api"
Oct 30 21:20:13.291883 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:20:13.291829    6004 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="d7b91b87-18a8-42be-8652-137ee8b789a1" containerName="maas-api"
Oct 30 21:20:13.292247 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:20:13.291894    6004 memory_manager.go:365] "RemoveStaleState removing state" podUID="f2e32e7c-6a2f-4464-aa11-243c5b5ccbe1" containerName="istio-proxy"
Oct 30 21:20:13.292247 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:20:13.291902    6004 memory_manager.go:365] "RemoveStaleState removing state" podUID="a651327d-e3a3-4fcb-8070-1e0deeb0ea90" containerName="maas-api"
Oct 30 21:20:13.292247 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:20:13.291909    6004 memory_manager.go:365] "RemoveStaleState removing state" podUID="7b81a18e-7cc3-4ed4-b08e-20e426d4c3e1" containerName="istio-proxy"
Oct 30 21:20:13.292247 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:20:13.291917    6004 memory_manager.go:365] "RemoveStaleState removing state" podUID="ffe16c53-414f-495c-b864-497edeab3871" containerName="maas-api"
Oct 30 21:20:13.292247 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:20:13.291923    6004 memory_manager.go:365] "RemoveStaleState removing state" podUID="d7b91b87-18a8-42be-8652-137ee8b789a1" containerName="maas-api"
Oct 30 21:20:13.292247 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:20:13.291928    6004 memory_manager.go:365] "RemoveStaleState removing state" podUID="d8c44f87-9b8f-4838-bd12-d48dd55a08d0" containerName="istio-proxy"
Oct 30 21:20:13.292247 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:20:13.291935    6004 memory_manager.go:365] "RemoveStaleState removing state" podUID="d8c44f87-9b8f-4838-bd12-d48dd55a08d0" containerName="istio-proxy"
Oct 30 21:20:13.295168 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:20:13.295152    6004 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7269-1a90b4"
Oct 30 21:20:13.317366 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:20:13.317336    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s4fj6\" (UniqueName: \"kubernetes.io/projected/a92e4761-3b8f-41b8-a403-24d52c4a045b-kube-api-access-s4fj6\") pod \"test-curl-7269-1a90b4\" (UID: \"a92e4761-3b8f-41b8-a403-24d52c4a045b\") " pod="opendatahub/test-curl-7269-1a90b4"
Oct 30 21:20:13.350554 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:20:13.350523    6004 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7269-1a90b4"]
Oct 30 21:20:13.397615 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:20:13.397586    6004 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-p9bch\""
Oct 30 21:20:13.419089 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:20:13.419057    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s4fj6\" (UniqueName: \"kubernetes.io/projected/a92e4761-3b8f-41b8-a403-24d52c4a045b-kube-api-access-s4fj6\") pod \"test-curl-7269-1a90b4\" (UID: \"a92e4761-3b8f-41b8-a403-24d52c4a045b\") " pod="opendatahub/test-curl-7269-1a90b4"
Oct 30 21:20:13.476938 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:20:13.476904    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s4fj6\" (UniqueName: \"kubernetes.io/projected/a92e4761-3b8f-41b8-a403-24d52c4a045b-kube-api-access-s4fj6\") pod \"test-curl-7269-1a90b4\" (UID: \"a92e4761-3b8f-41b8-a403-24d52c4a045b\") " pod="opendatahub/test-curl-7269-1a90b4"
Oct 30 21:20:13.608540 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:20:13.608459    6004 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7269-1a90b4"
Oct 30 21:20:13.978466 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:20:13.978438    6004 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7269-1a90b4"]
Oct 30 21:20:13.979875 ip-10-0-138-85 kubenswrapper[6004]: W1030 21:20:13.979847    6004 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda92e4761_3b8f_41b8_a403_24d52c4a045b.slice/crio-090d8adbfe41c93b1275a373a41cdd932fdf6f1a007d2559ed8c291b7534e9bd WatchSource:0}: Error finding container 090d8adbfe41c93b1275a373a41cdd932fdf6f1a007d2559ed8c291b7534e9bd: Status 404 returned error can't find the container with id 090d8adbfe41c93b1275a373a41cdd932fdf6f1a007d2559ed8c291b7534e9bd
Oct 30 21:20:14.285903 ip-10-0-138-85 kubenswrapper[6004]: E1030 21:20:14.285780    6004 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-zz4wr" containerName="extractor"
Oct 30 21:20:14.496132 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:20:14.496089    6004 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7269-1a90b4" event={"ID":"a92e4761-3b8f-41b8-a403-24d52c4a045b","Type":"ContainerStarted","Data":"f5dea50db4490d3b1682558fed2d0483e888601a83a4cddc86a7bb5eb852beb9"}
Oct 30 21:20:14.496132 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:20:14.496135    6004 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7269-1a90b4" event={"ID":"a92e4761-3b8f-41b8-a403-24d52c4a045b","Type":"ContainerStarted","Data":"090d8adbfe41c93b1275a373a41cdd932fdf6f1a007d2559ed8c291b7534e9bd"}
Oct 30 21:20:14.612706 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:20:14.612600    6004 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="opendatahub/test-curl-7269-1a90b4" podStartSLOduration=1.6125883239999999 podStartE2EDuration="1.612588324s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:20:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:20:14.611101555 +0000 UTC m=+2520.530887676" watchObservedRunningTime="2026-10-30 21:20:14.612588324 +0000 UTC m=+2520.532374442"
Oct 30 21:20:16.077880 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:20:16.077840    6004 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7269-1a90b4"]
Oct 30 21:20:16.080964 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:20:16.080931    6004 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7269-1a90b4"]
Oct 30 21:20:16.509876 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:20:16.509819    6004 kuberuntime_container.go:898] "Killing container with a grace period" pod="opendatahub/test-curl-7269-1a90b4" podUID="a92e4761-3b8f-41b8-a403-24d52c4a045b" containerName="test-curl-7269-1a90b4" containerID="cri-o://f5dea50db4490d3b1682558fed2d0483e888601a83a4cddc86a7bb5eb852beb9" gracePeriod=2
Oct 30 21:20:18.752835 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:20:18.752804    6004 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7269-1a90b4"
Oct 30 21:20:18.876761 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:20:18.876672    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/a92e4761-3b8f-41b8-a403-24d52c4a045b-kube-api-access-s4fj6\" (UniqueName: \"kubernetes.io/projected/a92e4761-3b8f-41b8-a403-24d52c4a045b-kube-api-access-s4fj6\") pod \"a92e4761-3b8f-41b8-a403-24d52c4a045b\" (UID: \"a92e4761-3b8f-41b8-a403-24d52c4a045b\") "
Oct 30 21:20:18.878823 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:20:18.878800    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a92e4761-3b8f-41b8-a403-24d52c4a045b-kube-api-access-s4fj6" pod "a92e4761-3b8f-41b8-a403-24d52c4a045b" (UID: "a92e4761-3b8f-41b8-a403-24d52c4a045b"). InnerVolumeSpecName "kube-api-access-s4fj6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:20:18.977978 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:20:18.977935    6004 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s4fj6\" (UniqueName: \"kubernetes.io/projected/a92e4761-3b8f-41b8-a403-24d52c4a045b-kube-api-access-s4fj6\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:20:19.529603 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:20:19.529570    6004 generic.go:356] "Generic (PLEG): container finished" podID="a92e4761-3b8f-41b8-a403-24d52c4a045b" containerID="f5dea50db4490d3b1682558fed2d0483e888601a83a4cddc86a7bb5eb852beb9" exitCode=137
Oct 30 21:20:19.529792 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:20:19.529619    6004 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7269-1a90b4"
Oct 30 21:20:19.529792 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:20:19.529625    6004 scope.go:122] "RemoveContainer" containerID="f5dea50db4490d3b1682558fed2d0483e888601a83a4cddc86a7bb5eb852beb9"
Oct 30 21:20:19.538935 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:20:19.538917    6004 scope.go:122] "RemoveContainer" containerID="f5dea50db4490d3b1682558fed2d0483e888601a83a4cddc86a7bb5eb852beb9"
Oct 30 21:20:19.539207 ip-10-0-138-85 kubenswrapper[6004]: E1030 21:20:19.539186    6004 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f5dea50db4490d3b1682558fed2d0483e888601a83a4cddc86a7bb5eb852beb9\": container with ID starting with f5dea50db4490d3b1682558fed2d0483e888601a83a4cddc86a7bb5eb852beb9 not found: ID does not exist" containerID="f5dea50db4490d3b1682558fed2d0483e888601a83a4cddc86a7bb5eb852beb9"
Oct 30 21:20:19.539306 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:20:19.539213    6004 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f5dea50db4490d3b1682558fed2d0483e888601a83a4cddc86a7bb5eb852beb9"} err="failed to get container status \"f5dea50db4490d3b1682558fed2d0483e888601a83a4cddc86a7bb5eb852beb9\": rpc error: code = NotFound desc = could not find container \"f5dea50db4490d3b1682558fed2d0483e888601a83a4cddc86a7bb5eb852beb9\": container with ID starting with f5dea50db4490d3b1682558fed2d0483e888601a83a4cddc86a7bb5eb852beb9 not found: ID does not exist"
Oct 30 21:20:19.589737 ip-10-0-138-85 kubenswrapper[6004]: E1030 21:20:19.589699    6004 status_manager.go:1045] "Failed to get status for pod" err="pods \"test-curl-7269-1a90b4\" is forbidden: User \"system:node:ip-10-0-138-85.us-west-1.compute.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-138-85.us-west-1.compute.internal' and this object" podUID="a92e4761-3b8f-41b8-a403-24d52c4a045b" pod="opendatahub/test-curl-7269-1a90b4"
Oct 30 21:20:20.230748 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:20:20.230713    6004 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="a92e4761-3b8f-41b8-a403-24d52c4a045b" path="/var/lib/kubelet/pods/a92e4761-3b8f-41b8-a403-24d52c4a045b/volumes"
Oct 30 21:20:44.287610 ip-10-0-138-85 kubenswrapper[6004]: E1030 21:20:44.287571    6004 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-zz4wr" containerName="extractor"
Oct 30 21:20:58.620975 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:20:58.620932    6004 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-2xprk"]
Oct 30 21:20:58.621482 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:20:58.621163    6004 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-2xprk" podUID="1a9526fe-0a73-4405-8e2f-f2aefa4cf495" containerName="discovery" containerID="cri-o://ce0e5be9a89d64a9236d05c51783990b538a29d2c5e991caef281cf3d83955d6" gracePeriod=30
Oct 30 21:20:58.757211 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:20:58.756873    6004 generic.go:356] "Generic (PLEG): container finished" podID="1a9526fe-0a73-4405-8e2f-f2aefa4cf495" containerID="ce0e5be9a89d64a9236d05c51783990b538a29d2c5e991caef281cf3d83955d6" exitCode=0
Oct 30 21:20:58.757211 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:20:58.757133    6004 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-2xprk" event={"ID":"1a9526fe-0a73-4405-8e2f-f2aefa4cf495","Type":"ContainerDied","Data":"ce0e5be9a89d64a9236d05c51783990b538a29d2c5e991caef281cf3d83955d6"}
Oct 30 21:20:58.909318 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:20:58.909285    6004 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-2xprk"
Oct 30 21:20:59.031082 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:20:59.031014    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/1a9526fe-0a73-4405-8e2f-f2aefa4cf495-cacerts\" (UniqueName: \"kubernetes.io/secret/1a9526fe-0a73-4405-8e2f-f2aefa4cf495-cacerts\") pod \"1a9526fe-0a73-4405-8e2f-f2aefa4cf495\" (UID: \"1a9526fe-0a73-4405-8e2f-f2aefa4cf495\") "
Oct 30 21:20:59.031240 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:20:59.031101    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/1a9526fe-0a73-4405-8e2f-f2aefa4cf495-istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/1a9526fe-0a73-4405-8e2f-f2aefa4cf495-istio-kubeconfig\") pod \"1a9526fe-0a73-4405-8e2f-f2aefa4cf495\" (UID: \"1a9526fe-0a73-4405-8e2f-f2aefa4cf495\") "
Oct 30 21:20:59.031240 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:20:59.031162    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/1a9526fe-0a73-4405-8e2f-f2aefa4cf495-istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/1a9526fe-0a73-4405-8e2f-f2aefa4cf495-istio-csr-ca-configmap\") pod \"1a9526fe-0a73-4405-8e2f-f2aefa4cf495\" (UID: \"1a9526fe-0a73-4405-8e2f-f2aefa4cf495\") "
Oct 30 21:20:59.031240 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:20:59.031226    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/1a9526fe-0a73-4405-8e2f-f2aefa4cf495-istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/1a9526fe-0a73-4405-8e2f-f2aefa4cf495-istio-csr-dns-cert\") pod \"1a9526fe-0a73-4405-8e2f-f2aefa4cf495\" (UID: \"1a9526fe-0a73-4405-8e2f-f2aefa4cf495\") "
Oct 30 21:20:59.031404 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:20:59.031277    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/1a9526fe-0a73-4405-8e2f-f2aefa4cf495-local-certs\" (UniqueName: \"kubernetes.io/empty-dir/1a9526fe-0a73-4405-8e2f-f2aefa4cf495-local-certs\") pod \"1a9526fe-0a73-4405-8e2f-f2aefa4cf495\" (UID: \"1a9526fe-0a73-4405-8e2f-f2aefa4cf495\") "
Oct 30 21:20:59.031404 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:20:59.031353    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/1a9526fe-0a73-4405-8e2f-f2aefa4cf495-istio-token\" (UniqueName: \"kubernetes.io/projected/1a9526fe-0a73-4405-8e2f-f2aefa4cf495-istio-token\") pod \"1a9526fe-0a73-4405-8e2f-f2aefa4cf495\" (UID: \"1a9526fe-0a73-4405-8e2f-f2aefa4cf495\") "
Oct 30 21:20:59.031404 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:20:59.031379    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/1a9526fe-0a73-4405-8e2f-f2aefa4cf495-kube-api-access-s54k2\" (UniqueName: \"kubernetes.io/projected/1a9526fe-0a73-4405-8e2f-f2aefa4cf495-kube-api-access-s54k2\") pod \"1a9526fe-0a73-4405-8e2f-f2aefa4cf495\" (UID: \"1a9526fe-0a73-4405-8e2f-f2aefa4cf495\") "
Oct 30 21:20:59.032617 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:20:59.032583    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1a9526fe-0a73-4405-8e2f-f2aefa4cf495-istio-csr-ca-configmap" pod "1a9526fe-0a73-4405-8e2f-f2aefa4cf495" (UID: "1a9526fe-0a73-4405-8e2f-f2aefa4cf495"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:20:59.033526 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:20:59.033498    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1a9526fe-0a73-4405-8e2f-f2aefa4cf495-cacerts" pod "1a9526fe-0a73-4405-8e2f-f2aefa4cf495" (UID: "1a9526fe-0a73-4405-8e2f-f2aefa4cf495"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:20:59.036004 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:20:59.035966    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1a9526fe-0a73-4405-8e2f-f2aefa4cf495-kube-api-access-s54k2" pod "1a9526fe-0a73-4405-8e2f-f2aefa4cf495" (UID: "1a9526fe-0a73-4405-8e2f-f2aefa4cf495"). InnerVolumeSpecName "kube-api-access-s54k2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:20:59.036255 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:20:59.036226    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1a9526fe-0a73-4405-8e2f-f2aefa4cf495-istio-token" pod "1a9526fe-0a73-4405-8e2f-f2aefa4cf495" (UID: "1a9526fe-0a73-4405-8e2f-f2aefa4cf495"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:20:59.037953 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:20:59.037932    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1a9526fe-0a73-4405-8e2f-f2aefa4cf495-istio-kubeconfig" pod "1a9526fe-0a73-4405-8e2f-f2aefa4cf495" (UID: "1a9526fe-0a73-4405-8e2f-f2aefa4cf495"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:20:59.038038 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:20:59.037976    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1a9526fe-0a73-4405-8e2f-f2aefa4cf495-istio-csr-dns-cert" pod "1a9526fe-0a73-4405-8e2f-f2aefa4cf495" (UID: "1a9526fe-0a73-4405-8e2f-f2aefa4cf495"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:20:59.038665 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:20:59.038641    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1a9526fe-0a73-4405-8e2f-f2aefa4cf495-local-certs" pod "1a9526fe-0a73-4405-8e2f-f2aefa4cf495" (UID: "1a9526fe-0a73-4405-8e2f-f2aefa4cf495"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:20:59.132387 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:20:59.132353    6004 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/1a9526fe-0a73-4405-8e2f-f2aefa4cf495-cacerts\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:20:59.132387 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:20:59.132380    6004 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/1a9526fe-0a73-4405-8e2f-f2aefa4cf495-istio-kubeconfig\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:20:59.132387 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:20:59.132391    6004 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/1a9526fe-0a73-4405-8e2f-f2aefa4cf495-istio-csr-ca-configmap\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:20:59.132623 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:20:59.132402    6004 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/1a9526fe-0a73-4405-8e2f-f2aefa4cf495-istio-csr-dns-cert\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:20:59.132623 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:20:59.132411    6004 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/1a9526fe-0a73-4405-8e2f-f2aefa4cf495-local-certs\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:20:59.132623 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:20:59.132420    6004 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1a9526fe-0a73-4405-8e2f-f2aefa4cf495-istio-token\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:20:59.132623 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:20:59.132428    6004 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s54k2\" (UniqueName: \"kubernetes.io/projected/1a9526fe-0a73-4405-8e2f-f2aefa4cf495-kube-api-access-s54k2\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:20:59.764854 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:20:59.764819    6004 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-2xprk" event={"ID":"1a9526fe-0a73-4405-8e2f-f2aefa4cf495","Type":"ContainerDied","Data":"2870614616a249b46c1df0d09d6bb91096fb4f49b276ad38e4d2a42427db3f69"}
Oct 30 21:20:59.765389 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:20:59.764877    6004 scope.go:122] "RemoveContainer" containerID="ce0e5be9a89d64a9236d05c51783990b538a29d2c5e991caef281cf3d83955d6"
Oct 30 21:20:59.765389 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:20:59.764826    6004 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-2xprk"
Oct 30 21:20:59.980844 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:20:59.980809    6004 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-2xprk"]
Oct 30 21:20:59.983589 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:20:59.983566    6004 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-2xprk"]
Oct 30 21:21:00.230635 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:21:00.230603    6004 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="1a9526fe-0a73-4405-8e2f-f2aefa4cf495" path="/var/lib/kubelet/pods/1a9526fe-0a73-4405-8e2f-f2aefa4cf495/volumes"
Oct 30 21:21:14.295454 ip-10-0-138-85 kubenswrapper[6004]: E1030 21:21:14.295416    6004 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-zz4wr" containerName="extractor"
Oct 30 21:21:38.679271 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:21:38.679228    6004 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-d1b889bd-7849b458b6-fqhk7"]
Oct 30 21:21:38.679786 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:21:38.679437    6004 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-d1b889bd-7849b458b6-fqhk7" podUID="e9682eea-c9d5-45ea-b421-587f14489dcf" containerName="maas-api" containerID="cri-o://c51fdd919f15b347d65bb973bc6e545a99be5612638c3104b16c3073d2e89d15" gracePeriod=30
Oct 30 21:21:38.960221 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:21:38.960190    6004 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-d1b889bd-7849b458b6-fqhk7"
Oct 30 21:21:38.991611 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:21:38.991570    6004 generic.go:356] "Generic (PLEG): container finished" podID="e9682eea-c9d5-45ea-b421-587f14489dcf" containerID="c51fdd919f15b347d65bb973bc6e545a99be5612638c3104b16c3073d2e89d15" exitCode=0
Oct 30 21:21:38.991800 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:21:38.991607    6004 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-d1b889bd-7849b458b6-fqhk7" event={"ID":"e9682eea-c9d5-45ea-b421-587f14489dcf","Type":"ContainerDied","Data":"c51fdd919f15b347d65bb973bc6e545a99be5612638c3104b16c3073d2e89d15"}
Oct 30 21:21:38.991800 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:21:38.991676    6004 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-d1b889bd-7849b458b6-fqhk7" event={"ID":"e9682eea-c9d5-45ea-b421-587f14489dcf","Type":"ContainerDied","Data":"e906219d78e3f9c57796c9b486954de5e7c42d91a0c10e32675df8123f62cebf"}
Oct 30 21:21:38.991800 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:21:38.991625    6004 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-d1b889bd-7849b458b6-fqhk7"
Oct 30 21:21:38.991800 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:21:38.991707    6004 scope.go:122] "RemoveContainer" containerID="c51fdd919f15b347d65bb973bc6e545a99be5612638c3104b16c3073d2e89d15"
Oct 30 21:21:39.002924 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:21:39.002903    6004 scope.go:122] "RemoveContainer" containerID="c51fdd919f15b347d65bb973bc6e545a99be5612638c3104b16c3073d2e89d15"
Oct 30 21:21:39.003266 ip-10-0-138-85 kubenswrapper[6004]: E1030 21:21:39.003238    6004 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c51fdd919f15b347d65bb973bc6e545a99be5612638c3104b16c3073d2e89d15\": container with ID starting with c51fdd919f15b347d65bb973bc6e545a99be5612638c3104b16c3073d2e89d15 not found: ID does not exist" containerID="c51fdd919f15b347d65bb973bc6e545a99be5612638c3104b16c3073d2e89d15"
Oct 30 21:21:39.003358 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:21:39.003276    6004 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c51fdd919f15b347d65bb973bc6e545a99be5612638c3104b16c3073d2e89d15"} err="failed to get container status \"c51fdd919f15b347d65bb973bc6e545a99be5612638c3104b16c3073d2e89d15\": rpc error: code = NotFound desc = could not find container \"c51fdd919f15b347d65bb973bc6e545a99be5612638c3104b16c3073d2e89d15\": container with ID starting with c51fdd919f15b347d65bb973bc6e545a99be5612638c3104b16c3073d2e89d15 not found: ID does not exist"
Oct 30 21:21:39.064468 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:21:39.064434    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/e9682eea-c9d5-45ea-b421-587f14489dcf-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e9682eea-c9d5-45ea-b421-587f14489dcf-maas-api-tls\") pod \"e9682eea-c9d5-45ea-b421-587f14489dcf\" (UID: \"e9682eea-c9d5-45ea-b421-587f14489dcf\") "
Oct 30 21:21:39.064667 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:21:39.064503    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/e9682eea-c9d5-45ea-b421-587f14489dcf-metrics-certs\" (UniqueName: \"kubernetes.io/secret/e9682eea-c9d5-45ea-b421-587f14489dcf-metrics-certs\") pod \"e9682eea-c9d5-45ea-b421-587f14489dcf\" (UID: \"e9682eea-c9d5-45ea-b421-587f14489dcf\") "
Oct 30 21:21:39.064667 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:21:39.064570    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/e9682eea-c9d5-45ea-b421-587f14489dcf-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e9682eea-c9d5-45ea-b421-587f14489dcf-openshift-service-ca\") pod \"e9682eea-c9d5-45ea-b421-587f14489dcf\" (UID: \"e9682eea-c9d5-45ea-b421-587f14489dcf\") "
Oct 30 21:21:39.064667 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:21:39.064653    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/e9682eea-c9d5-45ea-b421-587f14489dcf-kube-api-access-7bnpw\" (UniqueName: \"kubernetes.io/projected/e9682eea-c9d5-45ea-b421-587f14489dcf-kube-api-access-7bnpw\") pod \"e9682eea-c9d5-45ea-b421-587f14489dcf\" (UID: \"e9682eea-c9d5-45ea-b421-587f14489dcf\") "
Oct 30 21:21:39.065210 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:21:39.065149    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e9682eea-c9d5-45ea-b421-587f14489dcf-openshift-service-ca" pod "e9682eea-c9d5-45ea-b421-587f14489dcf" (UID: "e9682eea-c9d5-45ea-b421-587f14489dcf"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:21:39.067159 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:21:39.067127    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e9682eea-c9d5-45ea-b421-587f14489dcf-metrics-certs" pod "e9682eea-c9d5-45ea-b421-587f14489dcf" (UID: "e9682eea-c9d5-45ea-b421-587f14489dcf"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:21:39.067440 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:21:39.067409    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e9682eea-c9d5-45ea-b421-587f14489dcf-maas-api-tls" pod "e9682eea-c9d5-45ea-b421-587f14489dcf" (UID: "e9682eea-c9d5-45ea-b421-587f14489dcf"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:21:39.067698 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:21:39.067661    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e9682eea-c9d5-45ea-b421-587f14489dcf-kube-api-access-7bnpw" pod "e9682eea-c9d5-45ea-b421-587f14489dcf" (UID: "e9682eea-c9d5-45ea-b421-587f14489dcf"). InnerVolumeSpecName "kube-api-access-7bnpw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:21:39.166623 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:21:39.166583    6004 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e9682eea-c9d5-45ea-b421-587f14489dcf-maas-api-tls\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:21:39.166623 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:21:39.166623    6004 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e9682eea-c9d5-45ea-b421-587f14489dcf-metrics-certs\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:21:39.166830 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:21:39.166639    6004 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e9682eea-c9d5-45ea-b421-587f14489dcf-openshift-service-ca\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:21:39.166830 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:21:39.166653    6004 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7bnpw\" (UniqueName: \"kubernetes.io/projected/e9682eea-c9d5-45ea-b421-587f14489dcf-kube-api-access-7bnpw\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:21:39.413588 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:21:39.413556    6004 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-d1b889bd-7849b458b6-fqhk7"]
Oct 30 21:21:39.417346 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:21:39.417320    6004 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-d1b889bd-7849b458b6-fqhk7"]
Oct 30 21:21:40.230526 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:21:40.230492    6004 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="e9682eea-c9d5-45ea-b421-587f14489dcf" path="/var/lib/kubelet/pods/e9682eea-c9d5-45ea-b421-587f14489dcf/volumes"
Oct 30 21:21:44.287520 ip-10-0-138-85 kubenswrapper[6004]: E1030 21:21:44.287478    6004 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-zz4wr" containerName="extractor"
Oct 30 21:21:51.692850 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:21:51.692807    6004 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-d1b889bd-7d887b46cb-wk22v"]
Oct 30 21:21:51.693714 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:21:51.693688    6004 cpu_manager.go:414] "containerMap: removing container" podUID="a92e4761-3b8f-41b8-a403-24d52c4a045b" containerName="test-curl-7269-1a90b4"
Oct 30 21:21:51.693811 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:21:51.693717    6004 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="a92e4761-3b8f-41b8-a403-24d52c4a045b" containerName="test-curl-7269-1a90b4"
Oct 30 21:21:51.693811 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:21:51.693749    6004 cpu_manager.go:414] "containerMap: removing container" podUID="1a9526fe-0a73-4405-8e2f-f2aefa4cf495" containerName="discovery"
Oct 30 21:21:51.693811 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:21:51.693758    6004 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="1a9526fe-0a73-4405-8e2f-f2aefa4cf495" containerName="discovery"
Oct 30 21:21:51.693811 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:21:51.693798    6004 cpu_manager.go:414] "containerMap: removing container" podUID="e9682eea-c9d5-45ea-b421-587f14489dcf" containerName="maas-api"
Oct 30 21:21:51.693811 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:21:51.693807    6004 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="e9682eea-c9d5-45ea-b421-587f14489dcf" containerName="maas-api"
Oct 30 21:21:51.694116 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:21:51.693926    6004 memory_manager.go:365] "RemoveStaleState removing state" podUID="1a9526fe-0a73-4405-8e2f-f2aefa4cf495" containerName="discovery"
Oct 30 21:21:51.694116 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:21:51.693945    6004 memory_manager.go:365] "RemoveStaleState removing state" podUID="e9682eea-c9d5-45ea-b421-587f14489dcf" containerName="maas-api"
Oct 30 21:21:51.694116 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:21:51.693958    6004 memory_manager.go:365] "RemoveStaleState removing state" podUID="a92e4761-3b8f-41b8-a403-24d52c4a045b" containerName="test-curl-7269-1a90b4"
Oct 30 21:21:51.699342 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:21:51.699318    6004 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-d1b889bd-7d887b46cb-wk22v"
Oct 30 21:21:51.754010 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:21:51.753976    6004 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-d1b889bd-7d887b46cb-wk22v"]
Oct 30 21:21:51.801226 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:21:51.801195    6004 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-mt-d1b889bd-dockercfg-nm6mr\""
Oct 30 21:21:51.801855 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:21:51.801838    6004 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-mt-d1b889bd\""
Oct 30 21:21:51.804900 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:21:51.804880    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jd7v6\" (UniqueName: \"kubernetes.io/projected/020551c8-c3b9-4aec-bf4e-214c816f9c7f-kube-api-access-jd7v6\") pod \"payload-processing-e2e-mt-d1b889bd-7d887b46cb-wk22v\" (UID: \"020551c8-c3b9-4aec-bf4e-214c816f9c7f\") " pod="openshift-ingress/payload-processing-e2e-mt-d1b889bd-7d887b46cb-wk22v"
Oct 30 21:21:51.804969 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:21:51.804920    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/020551c8-c3b9-4aec-bf4e-214c816f9c7f-plugins-config-volume\") pod \"payload-processing-e2e-mt-d1b889bd-7d887b46cb-wk22v\" (UID: \"020551c8-c3b9-4aec-bf4e-214c816f9c7f\") " pod="openshift-ingress/payload-processing-e2e-mt-d1b889bd-7d887b46cb-wk22v"
Oct 30 21:21:51.855258 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:21:51.855222    6004 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-d1b889bd-bb457476c-zqc8k"]
Oct 30 21:21:51.859715 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:21:51.859689    6004 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-d1b889bd-bb457476c-zqc8k"
Oct 30 21:21:51.906291 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:21:51.906266    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jd7v6\" (UniqueName: \"kubernetes.io/projected/020551c8-c3b9-4aec-bf4e-214c816f9c7f-kube-api-access-jd7v6\") pod \"payload-processing-e2e-mt-d1b889bd-7d887b46cb-wk22v\" (UID: \"020551c8-c3b9-4aec-bf4e-214c816f9c7f\") " pod="openshift-ingress/payload-processing-e2e-mt-d1b889bd-7d887b46cb-wk22v"
Oct 30 21:21:51.906416 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:21:51.906318    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/020551c8-c3b9-4aec-bf4e-214c816f9c7f-plugins-config-volume\") pod \"payload-processing-e2e-mt-d1b889bd-7d887b46cb-wk22v\" (UID: \"020551c8-c3b9-4aec-bf4e-214c816f9c7f\") " pod="openshift-ingress/payload-processing-e2e-mt-d1b889bd-7d887b46cb-wk22v"
Oct 30 21:21:51.906468 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:21:51.906421    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/10b2809a-8076-443d-9d48-2e0da4f59401-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-d1b889bd-bb457476c-zqc8k\" (UID: \"10b2809a-8076-443d-9d48-2e0da4f59401\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-d1b889bd-bb457476c-zqc8k"
Oct 30 21:21:51.906514 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:21:51.906476    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m48pk\" (UniqueName: \"kubernetes.io/projected/10b2809a-8076-443d-9d48-2e0da4f59401-kube-api-access-m48pk\") pod \"payload-pre-processing-e2e-mt-d1b889bd-bb457476c-zqc8k\" (UID: \"10b2809a-8076-443d-9d48-2e0da4f59401\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-d1b889bd-bb457476c-zqc8k"
Oct 30 21:21:51.907045 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:21:51.907023    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/020551c8-c3b9-4aec-bf4e-214c816f9c7f-plugins-config-volume\") pod \"payload-processing-e2e-mt-d1b889bd-7d887b46cb-wk22v\" (UID: \"020551c8-c3b9-4aec-bf4e-214c816f9c7f\") " pod="openshift-ingress/payload-processing-e2e-mt-d1b889bd-7d887b46cb-wk22v"
Oct 30 21:21:51.913936 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:21:51.913910    6004 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-d1b889bd-bb457476c-zqc8k"]
Oct 30 21:21:51.964700 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:21:51.964629    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jd7v6\" (UniqueName: \"kubernetes.io/projected/020551c8-c3b9-4aec-bf4e-214c816f9c7f-kube-api-access-jd7v6\") pod \"payload-processing-e2e-mt-d1b889bd-7d887b46cb-wk22v\" (UID: \"020551c8-c3b9-4aec-bf4e-214c816f9c7f\") " pod="openshift-ingress/payload-processing-e2e-mt-d1b889bd-7d887b46cb-wk22v"
Oct 30 21:21:52.008022 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:21:52.007988    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/10b2809a-8076-443d-9d48-2e0da4f59401-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-d1b889bd-bb457476c-zqc8k\" (UID: \"10b2809a-8076-443d-9d48-2e0da4f59401\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-d1b889bd-bb457476c-zqc8k"
Oct 30 21:21:52.008190 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:21:52.008037    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m48pk\" (UniqueName: \"kubernetes.io/projected/10b2809a-8076-443d-9d48-2e0da4f59401-kube-api-access-m48pk\") pod \"payload-pre-processing-e2e-mt-d1b889bd-bb457476c-zqc8k\" (UID: \"10b2809a-8076-443d-9d48-2e0da4f59401\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-d1b889bd-bb457476c-zqc8k"
Oct 30 21:21:52.008674 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:21:52.008655    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/10b2809a-8076-443d-9d48-2e0da4f59401-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-d1b889bd-bb457476c-zqc8k\" (UID: \"10b2809a-8076-443d-9d48-2e0da4f59401\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-d1b889bd-bb457476c-zqc8k"
Oct 30 21:21:52.021780 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:21:52.021752    6004 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-d1b889bd-7d887b46cb-wk22v"
Oct 30 21:21:52.065308 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:21:52.065278    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m48pk\" (UniqueName: \"kubernetes.io/projected/10b2809a-8076-443d-9d48-2e0da4f59401-kube-api-access-m48pk\") pod \"payload-pre-processing-e2e-mt-d1b889bd-bb457476c-zqc8k\" (UID: \"10b2809a-8076-443d-9d48-2e0da4f59401\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-d1b889bd-bb457476c-zqc8k"
Oct 30 21:21:52.176936 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:21:52.176899    6004 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-d1b889bd-bb457476c-zqc8k"
Oct 30 21:21:52.400036 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:21:52.400009    6004 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-d1b889bd-7d887b46cb-wk22v"]
Oct 30 21:21:52.401228 ip-10-0-138-85 kubenswrapper[6004]: W1030 21:21:52.401205    6004 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod020551c8_c3b9_4aec_bf4e_214c816f9c7f.slice/crio-d313d118054bbebcc40c7cf25e0e2eaee182010fcfab26ccfb7234539dc0d7e3 WatchSource:0}: Error finding container d313d118054bbebcc40c7cf25e0e2eaee182010fcfab26ccfb7234539dc0d7e3: Status 404 returned error can't find the container with id d313d118054bbebcc40c7cf25e0e2eaee182010fcfab26ccfb7234539dc0d7e3
Oct 30 21:21:52.552694 ip-10-0-138-85 kubenswrapper[6004]: W1030 21:21:52.552653    6004 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod10b2809a_8076_443d_9d48_2e0da4f59401.slice/crio-426f39a79b648efd126714fdae8578542db7b3649e69ee63c6e8519a7e7b65b5 WatchSource:0}: Error finding container 426f39a79b648efd126714fdae8578542db7b3649e69ee63c6e8519a7e7b65b5: Status 404 returned error can't find the container with id 426f39a79b648efd126714fdae8578542db7b3649e69ee63c6e8519a7e7b65b5
Oct 30 21:21:52.552813 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:21:52.552776    6004 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-d1b889bd-bb457476c-zqc8k"]
Oct 30 21:21:53.102071 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:21:53.102005    6004 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-d1b889bd-7d887b46cb-wk22v" event={"ID":"020551c8-c3b9-4aec-bf4e-214c816f9c7f","Type":"ContainerStarted","Data":"92528b79acbd139987655f962377164bd5d8ce615d0b147cdece141e2b3f2eff"}
Oct 30 21:21:53.102554 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:21:53.102113    6004 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-d1b889bd-7d887b46cb-wk22v" event={"ID":"020551c8-c3b9-4aec-bf4e-214c816f9c7f","Type":"ContainerStarted","Data":"d313d118054bbebcc40c7cf25e0e2eaee182010fcfab26ccfb7234539dc0d7e3"}
Oct 30 21:21:53.102554 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:21:53.102231    6004 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-mt-d1b889bd-7d887b46cb-wk22v"
Oct 30 21:21:53.103608 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:21:53.103581    6004 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-d1b889bd-bb457476c-zqc8k" event={"ID":"10b2809a-8076-443d-9d48-2e0da4f59401","Type":"ContainerStarted","Data":"e8a14e26ba82bfe056be275f12e471bc2b95ab0efb2eb7bb97e9631a6b1dc9e0"}
Oct 30 21:21:53.103753 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:21:53.103623    6004 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-d1b889bd-bb457476c-zqc8k" event={"ID":"10b2809a-8076-443d-9d48-2e0da4f59401","Type":"ContainerStarted","Data":"426f39a79b648efd126714fdae8578542db7b3649e69ee63c6e8519a7e7b65b5"}
Oct 30 21:21:53.103753 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:21:53.103647    6004 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-d1b889bd-bb457476c-zqc8k"
Oct 30 21:21:53.217798 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:21:53.217745    6004 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-mt-d1b889bd-7d887b46cb-wk22v" podStartSLOduration=2.217731013 podStartE2EDuration="2.217731013s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:21:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:21:53.215821455 +0000 UTC m=+2619.135607574" watchObservedRunningTime="2026-10-30 21:21:53.217731013 +0000 UTC m=+2619.137517176"
Oct 30 21:21:53.329672 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:21:53.329610    6004 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-mt-d1b889bd-bb457476c-zqc8k" podStartSLOduration=2.32959176 podStartE2EDuration="2.32959176s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:21:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:21:53.328563671 +0000 UTC m=+2619.248349790" watchObservedRunningTime="2026-10-30 21:21:53.32959176 +0000 UTC m=+2619.249377879"
Oct 30 21:22:04.112604 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:22:04.112513    6004 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-d1b889bd-bb457476c-zqc8k"
Oct 30 21:22:04.112604 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:22:04.112600    6004 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-mt-d1b889bd-7d887b46cb-wk22v"
Oct 30 21:22:14.288653 ip-10-0-138-85 kubenswrapper[6004]: E1030 21:22:14.288614    6004 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-zz4wr" containerName="extractor"
Oct 30 21:22:29.325242 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:22:29.325210    6004 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-d1b889bd-7849b458b6-lcnlf"]
Oct 30 21:22:29.330273 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:22:29.330251    6004 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-d1b889bd-7849b458b6-lcnlf"
Oct 30 21:22:29.383344 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:22:29.383307    6004 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-d1b889bd-serving-cert\""
Oct 30 21:22:29.386234 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:22:29.386195    6004 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-d1b889bd-7849b458b6-lcnlf"]
Oct 30 21:22:29.401554 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:22:29.401520    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/098b86da-6c61-47d5-be96-ecda30ffeb60-metrics-certs\") pod \"maas-api-e2e-mt-d1b889bd-7849b458b6-lcnlf\" (UID: \"098b86da-6c61-47d5-be96-ecda30ffeb60\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-d1b889bd-7849b458b6-lcnlf"
Oct 30 21:22:29.401701 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:22:29.401676    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tz7wj\" (UniqueName: \"kubernetes.io/projected/098b86da-6c61-47d5-be96-ecda30ffeb60-kube-api-access-tz7wj\") pod \"maas-api-e2e-mt-d1b889bd-7849b458b6-lcnlf\" (UID: \"098b86da-6c61-47d5-be96-ecda30ffeb60\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-d1b889bd-7849b458b6-lcnlf"
Oct 30 21:22:29.401803 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:22:29.401786    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/098b86da-6c61-47d5-be96-ecda30ffeb60-maas-api-tls\") pod \"maas-api-e2e-mt-d1b889bd-7849b458b6-lcnlf\" (UID: \"098b86da-6c61-47d5-be96-ecda30ffeb60\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-d1b889bd-7849b458b6-lcnlf"
Oct 30 21:22:29.401920 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:22:29.401898    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/098b86da-6c61-47d5-be96-ecda30ffeb60-openshift-service-ca\") pod \"maas-api-e2e-mt-d1b889bd-7849b458b6-lcnlf\" (UID: \"098b86da-6c61-47d5-be96-ecda30ffeb60\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-d1b889bd-7849b458b6-lcnlf"
Oct 30 21:22:29.502803 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:22:29.502769    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/098b86da-6c61-47d5-be96-ecda30ffeb60-maas-api-tls\") pod \"maas-api-e2e-mt-d1b889bd-7849b458b6-lcnlf\" (UID: \"098b86da-6c61-47d5-be96-ecda30ffeb60\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-d1b889bd-7849b458b6-lcnlf"
Oct 30 21:22:29.503009 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:22:29.502845    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/098b86da-6c61-47d5-be96-ecda30ffeb60-openshift-service-ca\") pod \"maas-api-e2e-mt-d1b889bd-7849b458b6-lcnlf\" (UID: \"098b86da-6c61-47d5-be96-ecda30ffeb60\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-d1b889bd-7849b458b6-lcnlf"
Oct 30 21:22:29.503009 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:22:29.502883    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/098b86da-6c61-47d5-be96-ecda30ffeb60-metrics-certs\") pod \"maas-api-e2e-mt-d1b889bd-7849b458b6-lcnlf\" (UID: \"098b86da-6c61-47d5-be96-ecda30ffeb60\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-d1b889bd-7849b458b6-lcnlf"
Oct 30 21:22:29.503009 ip-10-0-138-85 kubenswrapper[6004]: E1030 21:22:29.502947    6004 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-mt-d1b889bd-serving-cert: secret "maas-api-e2e-mt-d1b889bd-serving-cert" not found
Oct 30 21:22:29.503009 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:22:29.502978    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tz7wj\" (UniqueName: \"kubernetes.io/projected/098b86da-6c61-47d5-be96-ecda30ffeb60-kube-api-access-tz7wj\") pod \"maas-api-e2e-mt-d1b889bd-7849b458b6-lcnlf\" (UID: \"098b86da-6c61-47d5-be96-ecda30ffeb60\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-d1b889bd-7849b458b6-lcnlf"
Oct 30 21:22:29.503009 ip-10-0-138-85 kubenswrapper[6004]: E1030 21:22:29.503011    6004 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/098b86da-6c61-47d5-be96-ecda30ffeb60-maas-api-tls podName:098b86da-6c61-47d5-be96-ecda30ffeb60 nodeName:}" failed. No retries permitted until 2026-10-30 21:22:30.002989991 +0000 UTC m=+2655.922776091 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/098b86da-6c61-47d5-be96-ecda30ffeb60-maas-api-tls") pod "maas-api-e2e-mt-d1b889bd-7849b458b6-lcnlf" (UID: "098b86da-6c61-47d5-be96-ecda30ffeb60") : secret "maas-api-e2e-mt-d1b889bd-serving-cert" not found
Oct 30 21:22:29.503789 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:22:29.503764    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/098b86da-6c61-47d5-be96-ecda30ffeb60-openshift-service-ca\") pod \"maas-api-e2e-mt-d1b889bd-7849b458b6-lcnlf\" (UID: \"098b86da-6c61-47d5-be96-ecda30ffeb60\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-d1b889bd-7849b458b6-lcnlf"
Oct 30 21:22:29.505447 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:22:29.505418    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/098b86da-6c61-47d5-be96-ecda30ffeb60-metrics-certs\") pod \"maas-api-e2e-mt-d1b889bd-7849b458b6-lcnlf\" (UID: \"098b86da-6c61-47d5-be96-ecda30ffeb60\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-d1b889bd-7849b458b6-lcnlf"
Oct 30 21:22:29.564767 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:22:29.564733    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tz7wj\" (UniqueName: \"kubernetes.io/projected/098b86da-6c61-47d5-be96-ecda30ffeb60-kube-api-access-tz7wj\") pod \"maas-api-e2e-mt-d1b889bd-7849b458b6-lcnlf\" (UID: \"098b86da-6c61-47d5-be96-ecda30ffeb60\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-d1b889bd-7849b458b6-lcnlf"
Oct 30 21:22:30.009160 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:22:30.009121    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/098b86da-6c61-47d5-be96-ecda30ffeb60-maas-api-tls\") pod \"maas-api-e2e-mt-d1b889bd-7849b458b6-lcnlf\" (UID: \"098b86da-6c61-47d5-be96-ecda30ffeb60\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-d1b889bd-7849b458b6-lcnlf"
Oct 30 21:22:30.011560 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:22:30.011532    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/098b86da-6c61-47d5-be96-ecda30ffeb60-maas-api-tls\") pod \"maas-api-e2e-mt-d1b889bd-7849b458b6-lcnlf\" (UID: \"098b86da-6c61-47d5-be96-ecda30ffeb60\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-d1b889bd-7849b458b6-lcnlf"
Oct 30 21:22:30.243840 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:22:30.243799    6004 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-d1b889bd-7849b458b6-lcnlf"
Oct 30 21:22:30.617945 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:22:30.617922    6004 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-d1b889bd-7849b458b6-lcnlf"]
Oct 30 21:22:30.620345 ip-10-0-138-85 kubenswrapper[6004]: W1030 21:22:30.620318    6004 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod098b86da_6c61_47d5_be96_ecda30ffeb60.slice/crio-478e29149d27270f69000f615c26ff9a3028802063d1ee8f589d2f2b872580a8 WatchSource:0}: Error finding container 478e29149d27270f69000f615c26ff9a3028802063d1ee8f589d2f2b872580a8: Status 404 returned error can't find the container with id 478e29149d27270f69000f615c26ff9a3028802063d1ee8f589d2f2b872580a8
Oct 30 21:22:30.622002 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:22:30.621980    6004 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Oct 30 21:22:31.340940 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:22:31.340883    6004 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-d1b889bd-7849b458b6-lcnlf" event={"ID":"098b86da-6c61-47d5-be96-ecda30ffeb60","Type":"ContainerStarted","Data":"478e29149d27270f69000f615c26ff9a3028802063d1ee8f589d2f2b872580a8"}
Oct 30 21:22:32.347910 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:22:32.347873    6004 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-d1b889bd-7849b458b6-lcnlf" event={"ID":"098b86da-6c61-47d5-be96-ecda30ffeb60","Type":"ContainerStarted","Data":"3fd639800a171a7d42231dc5d8c31c77e9d821b7c8b9a38bf4959c7ae435f18c"}
Oct 30 21:22:32.348443 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:22:32.347931    6004 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-d1b889bd-7849b458b6-lcnlf"
Oct 30 21:22:32.465848 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:22:32.465795    6004 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-d1b889bd-7849b458b6-lcnlf" podStartSLOduration=2.716545145 podStartE2EDuration="3.465780389s" totalImagesPullingTime="749.235244ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:22:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:22:32.463983917 +0000 UTC m=+2658.383770035" watchObservedRunningTime="2026-10-30 21:22:32.465780389 +0000 UTC m=+2658.385566507"
Oct 30 21:22:38.360727 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:22:38.360701    6004 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-d1b889bd-7849b458b6-lcnlf"
Oct 30 21:22:44.291300 ip-10-0-138-85 kubenswrapper[6004]: E1030 21:22:44.291249    6004 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-zz4wr" containerName="extractor"
Oct 30 21:22:53.846800 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:22:53.846762    6004 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-d1b889bd-openshift-default-566bd56c85-gtprk"]
Oct 30 21:22:53.850928 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:22:53.850905    6004 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-d1b889bd-openshift-default-566bd56c85-gtprk"
Oct 30 21:22:53.904290 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:22:53.904261    6004 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-d1b889bd-openshift-default-dockercfg-h9jb2\""
Oct 30 21:22:53.958135 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:22:53.958098    6004 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-d1b889bd-openshift-default-566bd56c85-gtprk"]
Oct 30 21:22:53.958689 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:22:53.958660    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/645f9519-1d21-4dd3-a807-86c9e7ecdab3-workload-certs\") pod \"e2e-mt-d1b889bd-openshift-default-566bd56c85-gtprk\" (UID: \"645f9519-1d21-4dd3-a807-86c9e7ecdab3\") " pod="openshift-ingress/e2e-mt-d1b889bd-openshift-default-566bd56c85-gtprk"
Oct 30 21:22:53.958772 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:22:53.958744    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/645f9519-1d21-4dd3-a807-86c9e7ecdab3-istio-podinfo\") pod \"e2e-mt-d1b889bd-openshift-default-566bd56c85-gtprk\" (UID: \"645f9519-1d21-4dd3-a807-86c9e7ecdab3\") " pod="openshift-ingress/e2e-mt-d1b889bd-openshift-default-566bd56c85-gtprk"
Oct 30 21:22:53.958772 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:22:53.958767    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/645f9519-1d21-4dd3-a807-86c9e7ecdab3-istio-envoy\") pod \"e2e-mt-d1b889bd-openshift-default-566bd56c85-gtprk\" (UID: \"645f9519-1d21-4dd3-a807-86c9e7ecdab3\") " pod="openshift-ingress/e2e-mt-d1b889bd-openshift-default-566bd56c85-gtprk"
Oct 30 21:22:53.958843 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:22:53.958823    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g5sfv\" (UniqueName: \"kubernetes.io/projected/645f9519-1d21-4dd3-a807-86c9e7ecdab3-kube-api-access-g5sfv\") pod \"e2e-mt-d1b889bd-openshift-default-566bd56c85-gtprk\" (UID: \"645f9519-1d21-4dd3-a807-86c9e7ecdab3\") " pod="openshift-ingress/e2e-mt-d1b889bd-openshift-default-566bd56c85-gtprk"
Oct 30 21:22:53.958876 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:22:53.958863    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/645f9519-1d21-4dd3-a807-86c9e7ecdab3-istio-token\") pod \"e2e-mt-d1b889bd-openshift-default-566bd56c85-gtprk\" (UID: \"645f9519-1d21-4dd3-a807-86c9e7ecdab3\") " pod="openshift-ingress/e2e-mt-d1b889bd-openshift-default-566bd56c85-gtprk"
Oct 30 21:22:53.958912 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:22:53.958886    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/645f9519-1d21-4dd3-a807-86c9e7ecdab3-istiod-ca-cert\") pod \"e2e-mt-d1b889bd-openshift-default-566bd56c85-gtprk\" (UID: \"645f9519-1d21-4dd3-a807-86c9e7ecdab3\") " pod="openshift-ingress/e2e-mt-d1b889bd-openshift-default-566bd56c85-gtprk"
Oct 30 21:22:53.958946 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:22:53.958917    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/645f9519-1d21-4dd3-a807-86c9e7ecdab3-istio-data\") pod \"e2e-mt-d1b889bd-openshift-default-566bd56c85-gtprk\" (UID: \"645f9519-1d21-4dd3-a807-86c9e7ecdab3\") " pod="openshift-ingress/e2e-mt-d1b889bd-openshift-default-566bd56c85-gtprk"
Oct 30 21:22:53.958982 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:22:53.958954    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/645f9519-1d21-4dd3-a807-86c9e7ecdab3-workload-socket\") pod \"e2e-mt-d1b889bd-openshift-default-566bd56c85-gtprk\" (UID: \"645f9519-1d21-4dd3-a807-86c9e7ecdab3\") " pod="openshift-ingress/e2e-mt-d1b889bd-openshift-default-566bd56c85-gtprk"
Oct 30 21:22:53.959036 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:22:53.959022    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/645f9519-1d21-4dd3-a807-86c9e7ecdab3-credential-socket\") pod \"e2e-mt-d1b889bd-openshift-default-566bd56c85-gtprk\" (UID: \"645f9519-1d21-4dd3-a807-86c9e7ecdab3\") " pod="openshift-ingress/e2e-mt-d1b889bd-openshift-default-566bd56c85-gtprk"
Oct 30 21:22:54.060613 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:22:54.060577    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/645f9519-1d21-4dd3-a807-86c9e7ecdab3-istio-data\") pod \"e2e-mt-d1b889bd-openshift-default-566bd56c85-gtprk\" (UID: \"645f9519-1d21-4dd3-a807-86c9e7ecdab3\") " pod="openshift-ingress/e2e-mt-d1b889bd-openshift-default-566bd56c85-gtprk"
Oct 30 21:22:54.060794 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:22:54.060627    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/645f9519-1d21-4dd3-a807-86c9e7ecdab3-workload-socket\") pod \"e2e-mt-d1b889bd-openshift-default-566bd56c85-gtprk\" (UID: \"645f9519-1d21-4dd3-a807-86c9e7ecdab3\") " pod="openshift-ingress/e2e-mt-d1b889bd-openshift-default-566bd56c85-gtprk"
Oct 30 21:22:54.060794 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:22:54.060690    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/645f9519-1d21-4dd3-a807-86c9e7ecdab3-credential-socket\") pod \"e2e-mt-d1b889bd-openshift-default-566bd56c85-gtprk\" (UID: \"645f9519-1d21-4dd3-a807-86c9e7ecdab3\") " pod="openshift-ingress/e2e-mt-d1b889bd-openshift-default-566bd56c85-gtprk"
Oct 30 21:22:54.060794 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:22:54.060731    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/645f9519-1d21-4dd3-a807-86c9e7ecdab3-workload-certs\") pod \"e2e-mt-d1b889bd-openshift-default-566bd56c85-gtprk\" (UID: \"645f9519-1d21-4dd3-a807-86c9e7ecdab3\") " pod="openshift-ingress/e2e-mt-d1b889bd-openshift-default-566bd56c85-gtprk"
Oct 30 21:22:54.061271 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:22:54.060798    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/645f9519-1d21-4dd3-a807-86c9e7ecdab3-istio-podinfo\") pod \"e2e-mt-d1b889bd-openshift-default-566bd56c85-gtprk\" (UID: \"645f9519-1d21-4dd3-a807-86c9e7ecdab3\") " pod="openshift-ingress/e2e-mt-d1b889bd-openshift-default-566bd56c85-gtprk"
Oct 30 21:22:54.061271 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:22:54.060825    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/645f9519-1d21-4dd3-a807-86c9e7ecdab3-istio-envoy\") pod \"e2e-mt-d1b889bd-openshift-default-566bd56c85-gtprk\" (UID: \"645f9519-1d21-4dd3-a807-86c9e7ecdab3\") " pod="openshift-ingress/e2e-mt-d1b889bd-openshift-default-566bd56c85-gtprk"
Oct 30 21:22:54.061271 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:22:54.060888    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g5sfv\" (UniqueName: \"kubernetes.io/projected/645f9519-1d21-4dd3-a807-86c9e7ecdab3-kube-api-access-g5sfv\") pod \"e2e-mt-d1b889bd-openshift-default-566bd56c85-gtprk\" (UID: \"645f9519-1d21-4dd3-a807-86c9e7ecdab3\") " pod="openshift-ingress/e2e-mt-d1b889bd-openshift-default-566bd56c85-gtprk"
Oct 30 21:22:54.061271 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:22:54.060929    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/645f9519-1d21-4dd3-a807-86c9e7ecdab3-istio-token\") pod \"e2e-mt-d1b889bd-openshift-default-566bd56c85-gtprk\" (UID: \"645f9519-1d21-4dd3-a807-86c9e7ecdab3\") " pod="openshift-ingress/e2e-mt-d1b889bd-openshift-default-566bd56c85-gtprk"
Oct 30 21:22:54.061271 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:22:54.060955    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/645f9519-1d21-4dd3-a807-86c9e7ecdab3-istiod-ca-cert\") pod \"e2e-mt-d1b889bd-openshift-default-566bd56c85-gtprk\" (UID: \"645f9519-1d21-4dd3-a807-86c9e7ecdab3\") " pod="openshift-ingress/e2e-mt-d1b889bd-openshift-default-566bd56c85-gtprk"
Oct 30 21:22:54.061271 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:22:54.061116    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/645f9519-1d21-4dd3-a807-86c9e7ecdab3-workload-socket\") pod \"e2e-mt-d1b889bd-openshift-default-566bd56c85-gtprk\" (UID: \"645f9519-1d21-4dd3-a807-86c9e7ecdab3\") " pod="openshift-ingress/e2e-mt-d1b889bd-openshift-default-566bd56c85-gtprk"
Oct 30 21:22:54.061271 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:22:54.061174    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/645f9519-1d21-4dd3-a807-86c9e7ecdab3-workload-certs\") pod \"e2e-mt-d1b889bd-openshift-default-566bd56c85-gtprk\" (UID: \"645f9519-1d21-4dd3-a807-86c9e7ecdab3\") " pod="openshift-ingress/e2e-mt-d1b889bd-openshift-default-566bd56c85-gtprk"
Oct 30 21:22:54.061604 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:22:54.061389    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/645f9519-1d21-4dd3-a807-86c9e7ecdab3-istio-data\") pod \"e2e-mt-d1b889bd-openshift-default-566bd56c85-gtprk\" (UID: \"645f9519-1d21-4dd3-a807-86c9e7ecdab3\") " pod="openshift-ingress/e2e-mt-d1b889bd-openshift-default-566bd56c85-gtprk"
Oct 30 21:22:54.061848 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:22:54.061822    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/645f9519-1d21-4dd3-a807-86c9e7ecdab3-credential-socket\") pod \"e2e-mt-d1b889bd-openshift-default-566bd56c85-gtprk\" (UID: \"645f9519-1d21-4dd3-a807-86c9e7ecdab3\") " pod="openshift-ingress/e2e-mt-d1b889bd-openshift-default-566bd56c85-gtprk"
Oct 30 21:22:54.062308 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:22:54.062281    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/645f9519-1d21-4dd3-a807-86c9e7ecdab3-istiod-ca-cert\") pod \"e2e-mt-d1b889bd-openshift-default-566bd56c85-gtprk\" (UID: \"645f9519-1d21-4dd3-a807-86c9e7ecdab3\") " pod="openshift-ingress/e2e-mt-d1b889bd-openshift-default-566bd56c85-gtprk"
Oct 30 21:22:54.064309 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:22:54.064285    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/645f9519-1d21-4dd3-a807-86c9e7ecdab3-istio-podinfo\") pod \"e2e-mt-d1b889bd-openshift-default-566bd56c85-gtprk\" (UID: \"645f9519-1d21-4dd3-a807-86c9e7ecdab3\") " pod="openshift-ingress/e2e-mt-d1b889bd-openshift-default-566bd56c85-gtprk"
Oct 30 21:22:54.072111 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:22:54.070613    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/645f9519-1d21-4dd3-a807-86c9e7ecdab3-istio-envoy\") pod \"e2e-mt-d1b889bd-openshift-default-566bd56c85-gtprk\" (UID: \"645f9519-1d21-4dd3-a807-86c9e7ecdab3\") " pod="openshift-ingress/e2e-mt-d1b889bd-openshift-default-566bd56c85-gtprk"
Oct 30 21:22:54.119601 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:22:54.119530    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/645f9519-1d21-4dd3-a807-86c9e7ecdab3-istio-token\") pod \"e2e-mt-d1b889bd-openshift-default-566bd56c85-gtprk\" (UID: \"645f9519-1d21-4dd3-a807-86c9e7ecdab3\") " pod="openshift-ingress/e2e-mt-d1b889bd-openshift-default-566bd56c85-gtprk"
Oct 30 21:22:54.119787 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:22:54.119763    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g5sfv\" (UniqueName: \"kubernetes.io/projected/645f9519-1d21-4dd3-a807-86c9e7ecdab3-kube-api-access-g5sfv\") pod \"e2e-mt-d1b889bd-openshift-default-566bd56c85-gtprk\" (UID: \"645f9519-1d21-4dd3-a807-86c9e7ecdab3\") " pod="openshift-ingress/e2e-mt-d1b889bd-openshift-default-566bd56c85-gtprk"
Oct 30 21:22:54.164075 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:22:54.164018    6004 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-d1b889bd-openshift-default-566bd56c85-gtprk"
Oct 30 21:22:54.592288 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:22:54.592253    6004 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-d1b889bd-openshift-default-566bd56c85-gtprk"]
Oct 30 21:22:54.593204 ip-10-0-138-85 kubenswrapper[6004]: W1030 21:22:54.593181    6004 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod645f9519_1d21_4dd3_a807_86c9e7ecdab3.slice/crio-af0fdbff54a0571fda5d7ba906fe195b93fbf9196333bb3a53be77b6b95b5221 WatchSource:0}: Error finding container af0fdbff54a0571fda5d7ba906fe195b93fbf9196333bb3a53be77b6b95b5221: Status 404 returned error can't find the container with id af0fdbff54a0571fda5d7ba906fe195b93fbf9196333bb3a53be77b6b95b5221
Oct 30 21:22:54.595572 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:22:54.595539    6004 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 21:22:54.595654 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:22:54.595603    6004 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 21:22:54.595654 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:22:54.595633    6004 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 21:22:55.486762 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:22:55.486722    6004 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-d1b889bd-openshift-default-566bd56c85-gtprk" event={"ID":"645f9519-1d21-4dd3-a807-86c9e7ecdab3","Type":"ContainerStarted","Data":"9740194aa44a7d77c4a44acea5d6585666e344d6002e79d5adbf534ebbac07c6"}
Oct 30 21:22:55.487269 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:22:55.486793    6004 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-d1b889bd-openshift-default-566bd56c85-gtprk" event={"ID":"645f9519-1d21-4dd3-a807-86c9e7ecdab3","Type":"ContainerStarted","Data":"af0fdbff54a0571fda5d7ba906fe195b93fbf9196333bb3a53be77b6b95b5221"}
Oct 30 21:22:55.669970 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:22:55.669910    6004 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-d1b889bd-openshift-default-566bd56c85-gtprk" podStartSLOduration=2.669895899 podStartE2EDuration="2.669895899s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:22:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:22:55.666708216 +0000 UTC m=+2681.586494333" watchObservedRunningTime="2026-10-30 21:22:55.669895899 +0000 UTC m=+2681.589682016"
Oct 30 21:22:56.165199 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:22:56.165144    6004 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-d1b889bd-openshift-default-566bd56c85-gtprk"
Oct 30 21:22:56.167135 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:22:56.167102    6004 patch_prober.go:29] interesting pod/e2e-mt-d1b889bd-openshift-default-566bd56c85-gtprk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.119:15021/healthz/ready\": dial tcp 10.132.0.119:15021: connect: connection refused" start-of-body=
Oct 30 21:22:56.167335 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:22:56.167158    6004 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-d1b889bd-openshift-default-566bd56c85-gtprk" podUID="645f9519-1d21-4dd3-a807-86c9e7ecdab3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.119:15021/healthz/ready\": dial tcp 10.132.0.119:15021: connect: connection refused"
Oct 30 21:22:57.164649 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:22:57.164608    6004 patch_prober.go:29] interesting pod/e2e-mt-d1b889bd-openshift-default-566bd56c85-gtprk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.119:15021/healthz/ready\": dial tcp 10.132.0.119:15021: connect: connection refused" start-of-body=
Oct 30 21:22:57.165162 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:22:57.164671    6004 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-d1b889bd-openshift-default-566bd56c85-gtprk" podUID="645f9519-1d21-4dd3-a807-86c9e7ecdab3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.119:15021/healthz/ready\": dial tcp 10.132.0.119:15021: connect: connection refused"
Oct 30 21:22:58.164569 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:22:58.164534    6004 patch_prober.go:29] interesting pod/e2e-mt-d1b889bd-openshift-default-566bd56c85-gtprk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.119:15021/healthz/ready\": dial tcp 10.132.0.119:15021: connect: connection refused" start-of-body=
Oct 30 21:22:58.164790 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:22:58.164592    6004 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-d1b889bd-openshift-default-566bd56c85-gtprk" podUID="645f9519-1d21-4dd3-a807-86c9e7ecdab3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.119:15021/healthz/ready\": dial tcp 10.132.0.119:15021: connect: connection refused"
Oct 30 21:22:59.165490 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:22:59.165449    6004 patch_prober.go:29] interesting pod/e2e-mt-d1b889bd-openshift-default-566bd56c85-gtprk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.119:15021/healthz/ready\": dial tcp 10.132.0.119:15021: connect: connection refused" start-of-body=
Oct 30 21:22:59.166144 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:22:59.166102    6004 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-d1b889bd-openshift-default-566bd56c85-gtprk" podUID="645f9519-1d21-4dd3-a807-86c9e7ecdab3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.119:15021/healthz/ready\": dial tcp 10.132.0.119:15021: connect: connection refused"
Oct 30 21:23:00.164629 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:23:00.164594    6004 patch_prober.go:29] interesting pod/e2e-mt-d1b889bd-openshift-default-566bd56c85-gtprk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.119:15021/healthz/ready\": dial tcp 10.132.0.119:15021: connect: connection refused" start-of-body=
Oct 30 21:23:00.164903 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:23:00.164873    6004 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-d1b889bd-openshift-default-566bd56c85-gtprk" podUID="645f9519-1d21-4dd3-a807-86c9e7ecdab3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.119:15021/healthz/ready\": dial tcp 10.132.0.119:15021: connect: connection refused"
Oct 30 21:23:01.169484 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:23:01.169453    6004 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-d1b889bd-openshift-default-566bd56c85-gtprk"
Oct 30 21:23:01.169930 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:23:01.169852    6004 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-d1b889bd-openshift-default-566bd56c85-gtprk"
Oct 30 21:23:01.170676 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:23:01.170652    6004 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-d1b889bd-openshift-default-566bd56c85-gtprk"
Oct 30 21:23:08.969846 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:23:08.969807    6004 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-d1b889bd-openshift-default-566bd56c85-hkzxf"]
Oct 30 21:23:08.973714 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:23:08.973695    6004 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-d1b889bd-openshift-default-566bd56c85-hkzxf"
Oct 30 21:23:09.075716 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:23:09.075681    6004 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-d1b889bd-openshift-default-566bd56c85-hkzxf"]
Oct 30 21:23:09.157524 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:23:09.157488    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a411974f-4789-4fd8-889a-590949a89a22-workload-certs\") pod \"e2e-mt-d1b889bd-openshift-default-566bd56c85-hkzxf\" (UID: \"a411974f-4789-4fd8-889a-590949a89a22\") " pod="openshift-ingress/e2e-mt-d1b889bd-openshift-default-566bd56c85-hkzxf"
Oct 30 21:23:09.157705 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:23:09.157531    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rfs6l\" (UniqueName: \"kubernetes.io/projected/a411974f-4789-4fd8-889a-590949a89a22-kube-api-access-rfs6l\") pod \"e2e-mt-d1b889bd-openshift-default-566bd56c85-hkzxf\" (UID: \"a411974f-4789-4fd8-889a-590949a89a22\") " pod="openshift-ingress/e2e-mt-d1b889bd-openshift-default-566bd56c85-hkzxf"
Oct 30 21:23:09.157705 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:23:09.157657    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a411974f-4789-4fd8-889a-590949a89a22-istio-data\") pod \"e2e-mt-d1b889bd-openshift-default-566bd56c85-hkzxf\" (UID: \"a411974f-4789-4fd8-889a-590949a89a22\") " pod="openshift-ingress/e2e-mt-d1b889bd-openshift-default-566bd56c85-hkzxf"
Oct 30 21:23:09.157705 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:23:09.157693    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a411974f-4789-4fd8-889a-590949a89a22-istio-token\") pod \"e2e-mt-d1b889bd-openshift-default-566bd56c85-hkzxf\" (UID: \"a411974f-4789-4fd8-889a-590949a89a22\") " pod="openshift-ingress/e2e-mt-d1b889bd-openshift-default-566bd56c85-hkzxf"
Oct 30 21:23:09.157840 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:23:09.157724    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a411974f-4789-4fd8-889a-590949a89a22-istio-envoy\") pod \"e2e-mt-d1b889bd-openshift-default-566bd56c85-hkzxf\" (UID: \"a411974f-4789-4fd8-889a-590949a89a22\") " pod="openshift-ingress/e2e-mt-d1b889bd-openshift-default-566bd56c85-hkzxf"
Oct 30 21:23:09.157840 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:23:09.157752    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a411974f-4789-4fd8-889a-590949a89a22-istiod-ca-cert\") pod \"e2e-mt-d1b889bd-openshift-default-566bd56c85-hkzxf\" (UID: \"a411974f-4789-4fd8-889a-590949a89a22\") " pod="openshift-ingress/e2e-mt-d1b889bd-openshift-default-566bd56c85-hkzxf"
Oct 30 21:23:09.157840 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:23:09.157827    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a411974f-4789-4fd8-889a-590949a89a22-workload-socket\") pod \"e2e-mt-d1b889bd-openshift-default-566bd56c85-hkzxf\" (UID: \"a411974f-4789-4fd8-889a-590949a89a22\") " pod="openshift-ingress/e2e-mt-d1b889bd-openshift-default-566bd56c85-hkzxf"
Oct 30 21:23:09.157971 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:23:09.157899    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a411974f-4789-4fd8-889a-590949a89a22-istio-podinfo\") pod \"e2e-mt-d1b889bd-openshift-default-566bd56c85-hkzxf\" (UID: \"a411974f-4789-4fd8-889a-590949a89a22\") " pod="openshift-ingress/e2e-mt-d1b889bd-openshift-default-566bd56c85-hkzxf"
Oct 30 21:23:09.158037 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:23:09.157979    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a411974f-4789-4fd8-889a-590949a89a22-credential-socket\") pod \"e2e-mt-d1b889bd-openshift-default-566bd56c85-hkzxf\" (UID: \"a411974f-4789-4fd8-889a-590949a89a22\") " pod="openshift-ingress/e2e-mt-d1b889bd-openshift-default-566bd56c85-hkzxf"
Oct 30 21:23:09.259260 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:23:09.259162    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a411974f-4789-4fd8-889a-590949a89a22-istio-data\") pod \"e2e-mt-d1b889bd-openshift-default-566bd56c85-hkzxf\" (UID: \"a411974f-4789-4fd8-889a-590949a89a22\") " pod="openshift-ingress/e2e-mt-d1b889bd-openshift-default-566bd56c85-hkzxf"
Oct 30 21:23:09.259260 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:23:09.259218    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a411974f-4789-4fd8-889a-590949a89a22-istio-token\") pod \"e2e-mt-d1b889bd-openshift-default-566bd56c85-hkzxf\" (UID: \"a411974f-4789-4fd8-889a-590949a89a22\") " pod="openshift-ingress/e2e-mt-d1b889bd-openshift-default-566bd56c85-hkzxf"
Oct 30 21:23:09.259260 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:23:09.259253    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a411974f-4789-4fd8-889a-590949a89a22-istio-envoy\") pod \"e2e-mt-d1b889bd-openshift-default-566bd56c85-hkzxf\" (UID: \"a411974f-4789-4fd8-889a-590949a89a22\") " pod="openshift-ingress/e2e-mt-d1b889bd-openshift-default-566bd56c85-hkzxf"
Oct 30 21:23:09.259563 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:23:09.259275    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a411974f-4789-4fd8-889a-590949a89a22-istiod-ca-cert\") pod \"e2e-mt-d1b889bd-openshift-default-566bd56c85-hkzxf\" (UID: \"a411974f-4789-4fd8-889a-590949a89a22\") " pod="openshift-ingress/e2e-mt-d1b889bd-openshift-default-566bd56c85-hkzxf"
Oct 30 21:23:09.259563 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:23:09.259318    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a411974f-4789-4fd8-889a-590949a89a22-workload-socket\") pod \"e2e-mt-d1b889bd-openshift-default-566bd56c85-hkzxf\" (UID: \"a411974f-4789-4fd8-889a-590949a89a22\") " pod="openshift-ingress/e2e-mt-d1b889bd-openshift-default-566bd56c85-hkzxf"
Oct 30 21:23:09.259563 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:23:09.259405    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a411974f-4789-4fd8-889a-590949a89a22-istio-podinfo\") pod \"e2e-mt-d1b889bd-openshift-default-566bd56c85-hkzxf\" (UID: \"a411974f-4789-4fd8-889a-590949a89a22\") " pod="openshift-ingress/e2e-mt-d1b889bd-openshift-default-566bd56c85-hkzxf"
Oct 30 21:23:09.259563 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:23:09.259427    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a411974f-4789-4fd8-889a-590949a89a22-credential-socket\") pod \"e2e-mt-d1b889bd-openshift-default-566bd56c85-hkzxf\" (UID: \"a411974f-4789-4fd8-889a-590949a89a22\") " pod="openshift-ingress/e2e-mt-d1b889bd-openshift-default-566bd56c85-hkzxf"
Oct 30 21:23:09.259563 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:23:09.259487    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a411974f-4789-4fd8-889a-590949a89a22-workload-certs\") pod \"e2e-mt-d1b889bd-openshift-default-566bd56c85-hkzxf\" (UID: \"a411974f-4789-4fd8-889a-590949a89a22\") " pod="openshift-ingress/e2e-mt-d1b889bd-openshift-default-566bd56c85-hkzxf"
Oct 30 21:23:09.259563 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:23:09.259520    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rfs6l\" (UniqueName: \"kubernetes.io/projected/a411974f-4789-4fd8-889a-590949a89a22-kube-api-access-rfs6l\") pod \"e2e-mt-d1b889bd-openshift-default-566bd56c85-hkzxf\" (UID: \"a411974f-4789-4fd8-889a-590949a89a22\") " pod="openshift-ingress/e2e-mt-d1b889bd-openshift-default-566bd56c85-hkzxf"
Oct 30 21:23:09.259883 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:23:09.259639    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a411974f-4789-4fd8-889a-590949a89a22-istio-data\") pod \"e2e-mt-d1b889bd-openshift-default-566bd56c85-hkzxf\" (UID: \"a411974f-4789-4fd8-889a-590949a89a22\") " pod="openshift-ingress/e2e-mt-d1b889bd-openshift-default-566bd56c85-hkzxf"
Oct 30 21:23:09.259947 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:23:09.259893    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a411974f-4789-4fd8-889a-590949a89a22-workload-socket\") pod \"e2e-mt-d1b889bd-openshift-default-566bd56c85-hkzxf\" (UID: \"a411974f-4789-4fd8-889a-590949a89a22\") " pod="openshift-ingress/e2e-mt-d1b889bd-openshift-default-566bd56c85-hkzxf"
Oct 30 21:23:09.260159 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:23:09.260136    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a411974f-4789-4fd8-889a-590949a89a22-credential-socket\") pod \"e2e-mt-d1b889bd-openshift-default-566bd56c85-hkzxf\" (UID: \"a411974f-4789-4fd8-889a-590949a89a22\") " pod="openshift-ingress/e2e-mt-d1b889bd-openshift-default-566bd56c85-hkzxf"
Oct 30 21:23:09.260485 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:23:09.260264    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a411974f-4789-4fd8-889a-590949a89a22-istiod-ca-cert\") pod \"e2e-mt-d1b889bd-openshift-default-566bd56c85-hkzxf\" (UID: \"a411974f-4789-4fd8-889a-590949a89a22\") " pod="openshift-ingress/e2e-mt-d1b889bd-openshift-default-566bd56c85-hkzxf"
Oct 30 21:23:09.260621 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:23:09.260438    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a411974f-4789-4fd8-889a-590949a89a22-workload-certs\") pod \"e2e-mt-d1b889bd-openshift-default-566bd56c85-hkzxf\" (UID: \"a411974f-4789-4fd8-889a-590949a89a22\") " pod="openshift-ingress/e2e-mt-d1b889bd-openshift-default-566bd56c85-hkzxf"
Oct 30 21:23:09.262133 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:23:09.262110    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a411974f-4789-4fd8-889a-590949a89a22-istio-envoy\") pod \"e2e-mt-d1b889bd-openshift-default-566bd56c85-hkzxf\" (UID: \"a411974f-4789-4fd8-889a-590949a89a22\") " pod="openshift-ingress/e2e-mt-d1b889bd-openshift-default-566bd56c85-hkzxf"
Oct 30 21:23:09.262782 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:23:09.262760    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a411974f-4789-4fd8-889a-590949a89a22-istio-podinfo\") pod \"e2e-mt-d1b889bd-openshift-default-566bd56c85-hkzxf\" (UID: \"a411974f-4789-4fd8-889a-590949a89a22\") " pod="openshift-ingress/e2e-mt-d1b889bd-openshift-default-566bd56c85-hkzxf"
Oct 30 21:23:09.319392 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:23:09.319359    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a411974f-4789-4fd8-889a-590949a89a22-istio-token\") pod \"e2e-mt-d1b889bd-openshift-default-566bd56c85-hkzxf\" (UID: \"a411974f-4789-4fd8-889a-590949a89a22\") " pod="openshift-ingress/e2e-mt-d1b889bd-openshift-default-566bd56c85-hkzxf"
Oct 30 21:23:09.319521 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:23:09.319442    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rfs6l\" (UniqueName: \"kubernetes.io/projected/a411974f-4789-4fd8-889a-590949a89a22-kube-api-access-rfs6l\") pod \"e2e-mt-d1b889bd-openshift-default-566bd56c85-hkzxf\" (UID: \"a411974f-4789-4fd8-889a-590949a89a22\") " pod="openshift-ingress/e2e-mt-d1b889bd-openshift-default-566bd56c85-hkzxf"
Oct 30 21:23:09.588045 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:23:09.587955    6004 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-d1b889bd-openshift-default-566bd56c85-hkzxf"
Oct 30 21:23:10.029682 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:23:10.029656    6004 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-d1b889bd-openshift-default-566bd56c85-hkzxf"]
Oct 30 21:23:10.030870 ip-10-0-138-85 kubenswrapper[6004]: W1030 21:23:10.030845    6004 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda411974f_4789_4fd8_889a_590949a89a22.slice/crio-02bbd35212cef94433f1e550b1b84466c7101916363e8e4d8a8340bb00e9fc86 WatchSource:0}: Error finding container 02bbd35212cef94433f1e550b1b84466c7101916363e8e4d8a8340bb00e9fc86: Status 404 returned error can't find the container with id 02bbd35212cef94433f1e550b1b84466c7101916363e8e4d8a8340bb00e9fc86
Oct 30 21:23:10.033357 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:23:10.033325    6004 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 21:23:10.033424 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:23:10.033391    6004 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 21:23:10.033424 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:23:10.033420    6004 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 21:23:10.580364 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:23:10.580328    6004 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-d1b889bd-openshift-default-566bd56c85-hkzxf" event={"ID":"a411974f-4789-4fd8-889a-590949a89a22","Type":"ContainerStarted","Data":"58999c9aacdb2ed1c5cf779f760338d61b37016f7c89d14a782946b3c7d4902a"}
Oct 30 21:23:10.580556 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:23:10.580389    6004 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-d1b889bd-openshift-default-566bd56c85-hkzxf" event={"ID":"a411974f-4789-4fd8-889a-590949a89a22","Type":"ContainerStarted","Data":"02bbd35212cef94433f1e550b1b84466c7101916363e8e4d8a8340bb00e9fc86"}
Oct 30 21:23:10.588908 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:23:10.588882    6004 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-d1b889bd-openshift-default-566bd56c85-hkzxf"
Oct 30 21:23:10.712988 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:23:10.712915    6004 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-d1b889bd-openshift-default-566bd56c85-hkzxf" podStartSLOduration=2.712895136 podStartE2EDuration="2.712895136s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:23:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:23:10.711396298 +0000 UTC m=+2696.631182414" watchObservedRunningTime="2026-10-30 21:23:10.712895136 +0000 UTC m=+2696.632681256"
Oct 30 21:23:11.590908 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:23:11.590871    6004 patch_prober.go:29] interesting pod/e2e-mt-d1b889bd-openshift-default-566bd56c85-hkzxf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.120:15021/healthz/ready\": dial tcp 10.132.0.120:15021: connect: connection refused" start-of-body=
Oct 30 21:23:11.591336 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:23:11.590920    6004 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-d1b889bd-openshift-default-566bd56c85-hkzxf" podUID="a411974f-4789-4fd8-889a-590949a89a22" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.120:15021/healthz/ready\": dial tcp 10.132.0.120:15021: connect: connection refused"
Oct 30 21:23:12.588675 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:23:12.588643    6004 patch_prober.go:29] interesting pod/e2e-mt-d1b889bd-openshift-default-566bd56c85-hkzxf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.120:15021/healthz/ready\": dial tcp 10.132.0.120:15021: connect: connection refused" start-of-body=
Oct 30 21:23:12.588862 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:23:12.588697    6004 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-d1b889bd-openshift-default-566bd56c85-hkzxf" podUID="a411974f-4789-4fd8-889a-590949a89a22" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.120:15021/healthz/ready\": dial tcp 10.132.0.120:15021: connect: connection refused"
Oct 30 21:23:13.589269 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:23:13.589235    6004 patch_prober.go:29] interesting pod/e2e-mt-d1b889bd-openshift-default-566bd56c85-hkzxf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.120:15021/healthz/ready\": dial tcp 10.132.0.120:15021: connect: connection refused" start-of-body=
Oct 30 21:23:13.589740 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:23:13.589297    6004 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-d1b889bd-openshift-default-566bd56c85-hkzxf" podUID="a411974f-4789-4fd8-889a-590949a89a22" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.120:15021/healthz/ready\": dial tcp 10.132.0.120:15021: connect: connection refused"
Oct 30 21:23:14.319396 ip-10-0-138-85 kubenswrapper[6004]: E1030 21:23:14.319356    6004 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-zz4wr" containerName="extractor"
Oct 30 21:23:14.588436 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:23:14.588354    6004 patch_prober.go:29] interesting pod/e2e-mt-d1b889bd-openshift-default-566bd56c85-hkzxf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.120:15021/healthz/ready\": dial tcp 10.132.0.120:15021: connect: connection refused" start-of-body=
Oct 30 21:23:14.588436 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:23:14.588410    6004 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-d1b889bd-openshift-default-566bd56c85-hkzxf" podUID="a411974f-4789-4fd8-889a-590949a89a22" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.120:15021/healthz/ready\": dial tcp 10.132.0.120:15021: connect: connection refused"
Oct 30 21:23:14.687033 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:23:14.687002    6004 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-sb7ds_90cd3de0-c573-41c2-bf3e-cf0e46a41d50/console-operator/2.log"
Oct 30 21:23:14.690389 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:23:14.690367    6004 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-sb7ds_90cd3de0-c573-41c2-bf3e-cf0e46a41d50/console-operator/2.log"
Oct 30 21:23:15.588827 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:23:15.588786    6004 patch_prober.go:29] interesting pod/e2e-mt-d1b889bd-openshift-default-566bd56c85-hkzxf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.120:15021/healthz/ready\": dial tcp 10.132.0.120:15021: connect: connection refused" start-of-body=
Oct 30 21:23:15.589018 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:23:15.588845    6004 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-d1b889bd-openshift-default-566bd56c85-hkzxf" podUID="a411974f-4789-4fd8-889a-590949a89a22" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.120:15021/healthz/ready\": dial tcp 10.132.0.120:15021: connect: connection refused"
Oct 30 21:23:16.593757 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:23:16.593722    6004 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-d1b889bd-openshift-default-566bd56c85-hkzxf"
Oct 30 21:23:16.594275 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:23:16.594083    6004 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-d1b889bd-openshift-default-566bd56c85-hkzxf"
Oct 30 21:23:16.594939 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:23:16.594918    6004 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-d1b889bd-openshift-default-566bd56c85-hkzxf"
Oct 30 21:23:33.605727 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:23:33.605631    6004 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7269-a7ddfb"]
Oct 30 21:23:33.610890 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:23:33.610862    6004 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7269-a7ddfb"
Oct 30 21:23:33.664513 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:23:33.664481    6004 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7269-a7ddfb"]
Oct 30 21:23:33.712065 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:23:33.712028    6004 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-p9bch\""
Oct 30 21:23:33.741025 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:23:33.740992    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ml472\" (UniqueName: \"kubernetes.io/projected/66ce9d30-2df0-4423-a462-1f621f32bb64-kube-api-access-ml472\") pod \"test-curl-7269-a7ddfb\" (UID: \"66ce9d30-2df0-4423-a462-1f621f32bb64\") " pod="opendatahub/test-curl-7269-a7ddfb"
Oct 30 21:23:33.842633 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:23:33.842598    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ml472\" (UniqueName: \"kubernetes.io/projected/66ce9d30-2df0-4423-a462-1f621f32bb64-kube-api-access-ml472\") pod \"test-curl-7269-a7ddfb\" (UID: \"66ce9d30-2df0-4423-a462-1f621f32bb64\") " pod="opendatahub/test-curl-7269-a7ddfb"
Oct 30 21:23:33.899674 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:23:33.899606    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ml472\" (UniqueName: \"kubernetes.io/projected/66ce9d30-2df0-4423-a462-1f621f32bb64-kube-api-access-ml472\") pod \"test-curl-7269-a7ddfb\" (UID: \"66ce9d30-2df0-4423-a462-1f621f32bb64\") " pod="opendatahub/test-curl-7269-a7ddfb"
Oct 30 21:23:33.923204 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:23:33.923177    6004 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7269-a7ddfb"
Oct 30 21:23:34.296575 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:23:34.296552    6004 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7269-a7ddfb"]
Oct 30 21:23:34.298295 ip-10-0-138-85 kubenswrapper[6004]: W1030 21:23:34.298263    6004 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod66ce9d30_2df0_4423_a462_1f621f32bb64.slice/crio-d6610e5d416f34a6d06542f161862a6b441cecfe8d462f06624f401750f08a95 WatchSource:0}: Error finding container d6610e5d416f34a6d06542f161862a6b441cecfe8d462f06624f401750f08a95: Status 404 returned error can't find the container with id d6610e5d416f34a6d06542f161862a6b441cecfe8d462f06624f401750f08a95
Oct 30 21:23:34.724772 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:23:34.724736    6004 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7269-a7ddfb" event={"ID":"66ce9d30-2df0-4423-a462-1f621f32bb64","Type":"ContainerStarted","Data":"1536b83bb3ba9ac5ab310785ddade0a51d1fc8dab1b3d0f274071143279e3b31"}
Oct 30 21:23:34.725187 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:23:34.724788    6004 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7269-a7ddfb" event={"ID":"66ce9d30-2df0-4423-a462-1f621f32bb64","Type":"ContainerStarted","Data":"d6610e5d416f34a6d06542f161862a6b441cecfe8d462f06624f401750f08a95"}
Oct 30 21:23:34.837637 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:23:34.837571    6004 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="opendatahub/test-curl-7269-a7ddfb" podStartSLOduration=1.837555188 podStartE2EDuration="1.837555188s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:23:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:23:34.836657852 +0000 UTC m=+2720.756443967" watchObservedRunningTime="2026-10-30 21:23:34.837555188 +0000 UTC m=+2720.757341305"
Oct 30 21:23:36.267352 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:23:36.267312    6004 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7269-a7ddfb"]
Oct 30 21:23:36.273307 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:23:36.273277    6004 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7269-a7ddfb"]
Oct 30 21:23:36.739353 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:23:36.739276    6004 kuberuntime_container.go:898] "Killing container with a grace period" pod="opendatahub/test-curl-7269-a7ddfb" podUID="66ce9d30-2df0-4423-a462-1f621f32bb64" containerName="test-curl-7269-a7ddfb" containerID="cri-o://1536b83bb3ba9ac5ab310785ddade0a51d1fc8dab1b3d0f274071143279e3b31" gracePeriod=2
Oct 30 21:23:36.790981 ip-10-0-138-85 kubenswrapper[6004]: E1030 21:23:36.790941    6004 status_manager.go:1045] "Failed to get status for pod" err="pods \"test-curl-7269-a7ddfb\" is forbidden: User \"system:node:ip-10-0-138-85.us-west-1.compute.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-138-85.us-west-1.compute.internal' and this object" podUID="66ce9d30-2df0-4423-a462-1f621f32bb64" pod="opendatahub/test-curl-7269-a7ddfb"
Oct 30 21:23:38.979530 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:23:38.979505    6004 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7269-a7ddfb"
Oct 30 21:23:39.109290 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:23:39.109196    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/66ce9d30-2df0-4423-a462-1f621f32bb64-kube-api-access-ml472\" (UniqueName: \"kubernetes.io/projected/66ce9d30-2df0-4423-a462-1f621f32bb64-kube-api-access-ml472\") pod \"66ce9d30-2df0-4423-a462-1f621f32bb64\" (UID: \"66ce9d30-2df0-4423-a462-1f621f32bb64\") "
Oct 30 21:23:39.111435 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:23:39.111408    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/66ce9d30-2df0-4423-a462-1f621f32bb64-kube-api-access-ml472" pod "66ce9d30-2df0-4423-a462-1f621f32bb64" (UID: "66ce9d30-2df0-4423-a462-1f621f32bb64"). InnerVolumeSpecName "kube-api-access-ml472". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:23:39.210710 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:23:39.210675    6004 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ml472\" (UniqueName: \"kubernetes.io/projected/66ce9d30-2df0-4423-a462-1f621f32bb64-kube-api-access-ml472\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:23:39.761192 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:23:39.761156    6004 generic.go:356] "Generic (PLEG): container finished" podID="66ce9d30-2df0-4423-a462-1f621f32bb64" containerID="1536b83bb3ba9ac5ab310785ddade0a51d1fc8dab1b3d0f274071143279e3b31" exitCode=137
Oct 30 21:23:39.761373 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:23:39.761207    6004 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7269-a7ddfb"
Oct 30 21:23:39.761373 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:23:39.761260    6004 scope.go:122] "RemoveContainer" containerID="1536b83bb3ba9ac5ab310785ddade0a51d1fc8dab1b3d0f274071143279e3b31"
Oct 30 21:23:39.772571 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:23:39.772550    6004 scope.go:122] "RemoveContainer" containerID="1536b83bb3ba9ac5ab310785ddade0a51d1fc8dab1b3d0f274071143279e3b31"
Oct 30 21:23:39.772890 ip-10-0-138-85 kubenswrapper[6004]: E1030 21:23:39.772868    6004 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1536b83bb3ba9ac5ab310785ddade0a51d1fc8dab1b3d0f274071143279e3b31\": container with ID starting with 1536b83bb3ba9ac5ab310785ddade0a51d1fc8dab1b3d0f274071143279e3b31 not found: ID does not exist" containerID="1536b83bb3ba9ac5ab310785ddade0a51d1fc8dab1b3d0f274071143279e3b31"
Oct 30 21:23:39.772956 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:23:39.772902    6004 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1536b83bb3ba9ac5ab310785ddade0a51d1fc8dab1b3d0f274071143279e3b31"} err="failed to get container status \"1536b83bb3ba9ac5ab310785ddade0a51d1fc8dab1b3d0f274071143279e3b31\": rpc error: code = NotFound desc = could not find container \"1536b83bb3ba9ac5ab310785ddade0a51d1fc8dab1b3d0f274071143279e3b31\": container with ID starting with 1536b83bb3ba9ac5ab310785ddade0a51d1fc8dab1b3d0f274071143279e3b31 not found: ID does not exist"
Oct 30 21:23:39.823318 ip-10-0-138-85 kubenswrapper[6004]: E1030 21:23:39.823273    6004 status_manager.go:1045] "Failed to get status for pod" err="pods \"test-curl-7269-a7ddfb\" is forbidden: User \"system:node:ip-10-0-138-85.us-west-1.compute.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-138-85.us-west-1.compute.internal' and this object" podUID="66ce9d30-2df0-4423-a462-1f621f32bb64" pod="opendatahub/test-curl-7269-a7ddfb"
Oct 30 21:23:40.231275 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:23:40.231237    6004 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="66ce9d30-2df0-4423-a462-1f621f32bb64" path="/var/lib/kubelet/pods/66ce9d30-2df0-4423-a462-1f621f32bb64/volumes"
Oct 30 21:23:44.287268 ip-10-0-138-85 kubenswrapper[6004]: E1030 21:23:44.287227    6004 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-zz4wr" containerName="extractor"
Oct 30 21:23:53.251257 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:23:53.251225    6004 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-d1b889bd-7d887b46cb-wk22v"]
Oct 30 21:23:53.358063 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:23:53.358005    6004 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-d1b889bd-bb457476c-zqc8k"]
Oct 30 21:23:53.407259 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:23:53.407219    6004 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-769df7846c-r8vgx"]
Oct 30 21:23:53.407459 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:23:53.407427    6004 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-r8vgx" podUID="bb7251a5-aa97-4ee2-a00d-27083704dc60" containerName="istio-proxy" containerID="cri-o://7a8411a35ea8f25307fe951149291b6a46fa3ff692de68f3154aa196266845e8" gracePeriod=30
Oct 30 21:23:53.420363 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:23:53.420334    6004 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-769df7846c-lvdfj"]
Oct 30 21:23:53.420626 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:23:53.420573    6004 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-lvdfj" podUID="44ec9e0c-2e06-45a6-a8bb-871640460980" containerName="istio-proxy" containerID="cri-o://fb3684cc1646ca1f6190899db5252143fd3a874b95f63fa88a452a51b5184ec1" gracePeriod=30
Oct 30 21:23:58.251721 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:23:58.251679    6004 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-mt-d1b889bd-7d887b46cb-wk22v" podUID="020551c8-c3b9-4aec-bf4e-214c816f9c7f" containerName="payload-processing" containerID="cri-o://92528b79acbd139987655f962377164bd5d8ce615d0b147cdece141e2b3f2eff" gracePeriod=25
Oct 30 21:23:58.359429 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:23:58.359385    6004 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-mt-d1b889bd-bb457476c-zqc8k" podUID="10b2809a-8076-443d-9d48-2e0da4f59401" containerName="payload-pre-processing" containerID="cri-o://e8a14e26ba82bfe056be275f12e471bc2b95ab0efb2eb7bb97e9631a6b1dc9e0" gracePeriod=25
Oct 30 21:23:58.559865 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:23:58.559838    6004 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-d1b889bd-7d887b46cb-wk22v"
Oct 30 21:23:58.626656 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:23:58.626617    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/020551c8-c3b9-4aec-bf4e-214c816f9c7f-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/020551c8-c3b9-4aec-bf4e-214c816f9c7f-plugins-config-volume\") pod \"020551c8-c3b9-4aec-bf4e-214c816f9c7f\" (UID: \"020551c8-c3b9-4aec-bf4e-214c816f9c7f\") "
Oct 30 21:23:58.626819 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:23:58.626787    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/020551c8-c3b9-4aec-bf4e-214c816f9c7f-kube-api-access-jd7v6\" (UniqueName: \"kubernetes.io/projected/020551c8-c3b9-4aec-bf4e-214c816f9c7f-kube-api-access-jd7v6\") pod \"020551c8-c3b9-4aec-bf4e-214c816f9c7f\" (UID: \"020551c8-c3b9-4aec-bf4e-214c816f9c7f\") "
Oct 30 21:23:58.628248 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:23:58.628197    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/020551c8-c3b9-4aec-bf4e-214c816f9c7f-plugins-config-volume" pod "020551c8-c3b9-4aec-bf4e-214c816f9c7f" (UID: "020551c8-c3b9-4aec-bf4e-214c816f9c7f"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:23:58.636512 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:23:58.636483    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/020551c8-c3b9-4aec-bf4e-214c816f9c7f-kube-api-access-jd7v6" pod "020551c8-c3b9-4aec-bf4e-214c816f9c7f" (UID: "020551c8-c3b9-4aec-bf4e-214c816f9c7f"). InnerVolumeSpecName "kube-api-access-jd7v6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:23:58.686639 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:23:58.686220    6004 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-r8vgx"
Oct 30 21:23:58.727940 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:23:58.727902    6004 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/020551c8-c3b9-4aec-bf4e-214c816f9c7f-plugins-config-volume\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:23:58.727940 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:23:58.727939    6004 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jd7v6\" (UniqueName: \"kubernetes.io/projected/020551c8-c3b9-4aec-bf4e-214c816f9c7f-kube-api-access-jd7v6\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:23:58.730731 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:23:58.730708    6004 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-d1b889bd-bb457476c-zqc8k"
Oct 30 21:23:58.794809 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:23:58.794783    6004 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-lvdfj"
Oct 30 21:23:58.832072 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:23:58.829226    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/bb7251a5-aa97-4ee2-a00d-27083704dc60-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bb7251a5-aa97-4ee2-a00d-27083704dc60-istio-data\") pod \"bb7251a5-aa97-4ee2-a00d-27083704dc60\" (UID: \"bb7251a5-aa97-4ee2-a00d-27083704dc60\") "
Oct 30 21:23:58.832072 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:23:58.829341    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/bb7251a5-aa97-4ee2-a00d-27083704dc60-kube-api-access-g748t\" (UniqueName: \"kubernetes.io/projected/bb7251a5-aa97-4ee2-a00d-27083704dc60-kube-api-access-g748t\") pod \"bb7251a5-aa97-4ee2-a00d-27083704dc60\" (UID: \"bb7251a5-aa97-4ee2-a00d-27083704dc60\") "
Oct 30 21:23:58.832072 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:23:58.829383    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/bb7251a5-aa97-4ee2-a00d-27083704dc60-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bb7251a5-aa97-4ee2-a00d-27083704dc60-workload-certs\") pod \"bb7251a5-aa97-4ee2-a00d-27083704dc60\" (UID: \"bb7251a5-aa97-4ee2-a00d-27083704dc60\") "
Oct 30 21:23:58.832072 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:23:58.829448    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/bb7251a5-aa97-4ee2-a00d-27083704dc60-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bb7251a5-aa97-4ee2-a00d-27083704dc60-istio-envoy\") pod \"bb7251a5-aa97-4ee2-a00d-27083704dc60\" (UID: \"bb7251a5-aa97-4ee2-a00d-27083704dc60\") "
Oct 30 21:23:58.832072 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:23:58.829485    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/bb7251a5-aa97-4ee2-a00d-27083704dc60-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bb7251a5-aa97-4ee2-a00d-27083704dc60-credential-socket\") pod \"bb7251a5-aa97-4ee2-a00d-27083704dc60\" (UID: \"bb7251a5-aa97-4ee2-a00d-27083704dc60\") "
Oct 30 21:23:58.832072 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:23:58.829541    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/bb7251a5-aa97-4ee2-a00d-27083704dc60-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bb7251a5-aa97-4ee2-a00d-27083704dc60-istio-podinfo\") pod \"bb7251a5-aa97-4ee2-a00d-27083704dc60\" (UID: \"bb7251a5-aa97-4ee2-a00d-27083704dc60\") "
Oct 30 21:23:58.832072 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:23:58.829569    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/10b2809a-8076-443d-9d48-2e0da4f59401-kube-api-access-m48pk\" (UniqueName: \"kubernetes.io/projected/10b2809a-8076-443d-9d48-2e0da4f59401-kube-api-access-m48pk\") pod \"10b2809a-8076-443d-9d48-2e0da4f59401\" (UID: \"10b2809a-8076-443d-9d48-2e0da4f59401\") "
Oct 30 21:23:58.832072 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:23:58.829625    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/10b2809a-8076-443d-9d48-2e0da4f59401-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/10b2809a-8076-443d-9d48-2e0da4f59401-plugins-config-volume\") pod \"10b2809a-8076-443d-9d48-2e0da4f59401\" (UID: \"10b2809a-8076-443d-9d48-2e0da4f59401\") "
Oct 30 21:23:58.832072 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:23:58.829694    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/bb7251a5-aa97-4ee2-a00d-27083704dc60-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bb7251a5-aa97-4ee2-a00d-27083704dc60-istiod-ca-cert\") pod \"bb7251a5-aa97-4ee2-a00d-27083704dc60\" (UID: \"bb7251a5-aa97-4ee2-a00d-27083704dc60\") "
Oct 30 21:23:58.832072 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:23:58.829728    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/bb7251a5-aa97-4ee2-a00d-27083704dc60-istio-token\" (UniqueName: \"kubernetes.io/projected/bb7251a5-aa97-4ee2-a00d-27083704dc60-istio-token\") pod \"bb7251a5-aa97-4ee2-a00d-27083704dc60\" (UID: \"bb7251a5-aa97-4ee2-a00d-27083704dc60\") "
Oct 30 21:23:58.832072 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:23:58.829786    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/bb7251a5-aa97-4ee2-a00d-27083704dc60-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bb7251a5-aa97-4ee2-a00d-27083704dc60-workload-socket\") pod \"bb7251a5-aa97-4ee2-a00d-27083704dc60\" (UID: \"bb7251a5-aa97-4ee2-a00d-27083704dc60\") "
Oct 30 21:23:58.832072 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:23:58.830571    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bb7251a5-aa97-4ee2-a00d-27083704dc60-credential-socket" pod "bb7251a5-aa97-4ee2-a00d-27083704dc60" (UID: "bb7251a5-aa97-4ee2-a00d-27083704dc60"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:23:58.832072 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:23:58.830768    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bb7251a5-aa97-4ee2-a00d-27083704dc60-workload-certs" pod "bb7251a5-aa97-4ee2-a00d-27083704dc60" (UID: "bb7251a5-aa97-4ee2-a00d-27083704dc60"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:23:58.832072 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:23:58.831123    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bb7251a5-aa97-4ee2-a00d-27083704dc60-workload-socket" pod "bb7251a5-aa97-4ee2-a00d-27083704dc60" (UID: "bb7251a5-aa97-4ee2-a00d-27083704dc60"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:23:58.832072 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:23:58.831443    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bb7251a5-aa97-4ee2-a00d-27083704dc60-istiod-ca-cert" pod "bb7251a5-aa97-4ee2-a00d-27083704dc60" (UID: "bb7251a5-aa97-4ee2-a00d-27083704dc60"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:23:58.832072 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:23:58.832009    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bb7251a5-aa97-4ee2-a00d-27083704dc60-istio-data" pod "bb7251a5-aa97-4ee2-a00d-27083704dc60" (UID: "bb7251a5-aa97-4ee2-a00d-27083704dc60"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:23:58.833125 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:23:58.832223    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/10b2809a-8076-443d-9d48-2e0da4f59401-plugins-config-volume" pod "10b2809a-8076-443d-9d48-2e0da4f59401" (UID: "10b2809a-8076-443d-9d48-2e0da4f59401"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:23:58.834162 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:23:58.834134    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/10b2809a-8076-443d-9d48-2e0da4f59401-kube-api-access-m48pk" pod "10b2809a-8076-443d-9d48-2e0da4f59401" (UID: "10b2809a-8076-443d-9d48-2e0da4f59401"). InnerVolumeSpecName "kube-api-access-m48pk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:23:58.838043 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:23:58.837558    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bb7251a5-aa97-4ee2-a00d-27083704dc60-istio-token" pod "bb7251a5-aa97-4ee2-a00d-27083704dc60" (UID: "bb7251a5-aa97-4ee2-a00d-27083704dc60"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:23:58.848762 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:23:58.848729    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bb7251a5-aa97-4ee2-a00d-27083704dc60-istio-envoy" pod "bb7251a5-aa97-4ee2-a00d-27083704dc60" (UID: "bb7251a5-aa97-4ee2-a00d-27083704dc60"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:23:58.848902 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:23:58.848846    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bb7251a5-aa97-4ee2-a00d-27083704dc60-kube-api-access-g748t" pod "bb7251a5-aa97-4ee2-a00d-27083704dc60" (UID: "bb7251a5-aa97-4ee2-a00d-27083704dc60"). InnerVolumeSpecName "kube-api-access-g748t". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:23:58.850562 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:23:58.850525    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/bb7251a5-aa97-4ee2-a00d-27083704dc60-istio-podinfo" pod "bb7251a5-aa97-4ee2-a00d-27083704dc60" (UID: "bb7251a5-aa97-4ee2-a00d-27083704dc60"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 21:23:58.876691 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:23:58.876657    6004 generic.go:356] "Generic (PLEG): container finished" podID="020551c8-c3b9-4aec-bf4e-214c816f9c7f" containerID="92528b79acbd139987655f962377164bd5d8ce615d0b147cdece141e2b3f2eff" exitCode=0
Oct 30 21:23:58.876841 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:23:58.876717    6004 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-d1b889bd-7d887b46cb-wk22v"
Oct 30 21:23:58.876841 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:23:58.876743    6004 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-d1b889bd-7d887b46cb-wk22v" event={"ID":"020551c8-c3b9-4aec-bf4e-214c816f9c7f","Type":"ContainerDied","Data":"92528b79acbd139987655f962377164bd5d8ce615d0b147cdece141e2b3f2eff"}
Oct 30 21:23:58.876934 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:23:58.876840    6004 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-d1b889bd-7d887b46cb-wk22v" event={"ID":"020551c8-c3b9-4aec-bf4e-214c816f9c7f","Type":"ContainerDied","Data":"d313d118054bbebcc40c7cf25e0e2eaee182010fcfab26ccfb7234539dc0d7e3"}
Oct 30 21:23:58.876934 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:23:58.876874    6004 scope.go:122] "RemoveContainer" containerID="92528b79acbd139987655f962377164bd5d8ce615d0b147cdece141e2b3f2eff"
Oct 30 21:23:58.878453 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:23:58.878430    6004 generic.go:356] "Generic (PLEG): container finished" podID="10b2809a-8076-443d-9d48-2e0da4f59401" containerID="e8a14e26ba82bfe056be275f12e471bc2b95ab0efb2eb7bb97e9631a6b1dc9e0" exitCode=0
Oct 30 21:23:58.878642 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:23:58.878475    6004 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-d1b889bd-bb457476c-zqc8k" event={"ID":"10b2809a-8076-443d-9d48-2e0da4f59401","Type":"ContainerDied","Data":"e8a14e26ba82bfe056be275f12e471bc2b95ab0efb2eb7bb97e9631a6b1dc9e0"}
Oct 30 21:23:58.878758 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:23:58.878680    6004 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-d1b889bd-bb457476c-zqc8k" event={"ID":"10b2809a-8076-443d-9d48-2e0da4f59401","Type":"ContainerDied","Data":"426f39a79b648efd126714fdae8578542db7b3649e69ee63c6e8519a7e7b65b5"}
Oct 30 21:23:58.878758 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:23:58.878483    6004 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-d1b889bd-bb457476c-zqc8k"
Oct 30 21:23:58.880245 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:23:58.880226    6004 generic.go:356] "Generic (PLEG): container finished" podID="44ec9e0c-2e06-45a6-a8bb-871640460980" containerID="fb3684cc1646ca1f6190899db5252143fd3a874b95f63fa88a452a51b5184ec1" exitCode=0
Oct 30 21:23:58.880356 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:23:58.880287    6004 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-lvdfj"
Oct 30 21:23:58.880356 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:23:58.880317    6004 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-lvdfj" event={"ID":"44ec9e0c-2e06-45a6-a8bb-871640460980","Type":"ContainerDied","Data":"fb3684cc1646ca1f6190899db5252143fd3a874b95f63fa88a452a51b5184ec1"}
Oct 30 21:23:58.880455 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:23:58.880357    6004 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-lvdfj" event={"ID":"44ec9e0c-2e06-45a6-a8bb-871640460980","Type":"ContainerDied","Data":"608368f2034be321895e590072ac6f58488582d14f18566e3836b6b6c045241f"}
Oct 30 21:23:58.882123 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:23:58.882099    6004 generic.go:356] "Generic (PLEG): container finished" podID="bb7251a5-aa97-4ee2-a00d-27083704dc60" containerID="7a8411a35ea8f25307fe951149291b6a46fa3ff692de68f3154aa196266845e8" exitCode=0
Oct 30 21:23:58.882239 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:23:58.882134    6004 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-r8vgx"
Oct 30 21:23:58.882239 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:23:58.882156    6004 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-r8vgx" event={"ID":"bb7251a5-aa97-4ee2-a00d-27083704dc60","Type":"ContainerDied","Data":"7a8411a35ea8f25307fe951149291b6a46fa3ff692de68f3154aa196266845e8"}
Oct 30 21:23:58.882239 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:23:58.882191    6004 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-r8vgx" event={"ID":"bb7251a5-aa97-4ee2-a00d-27083704dc60","Type":"ContainerDied","Data":"c20d51ae6995e02cceb59eabb40b679b700792f666239c5952eb0921b9db44c9"}
Oct 30 21:23:58.889396 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:23:58.889378    6004 scope.go:122] "RemoveContainer" containerID="92528b79acbd139987655f962377164bd5d8ce615d0b147cdece141e2b3f2eff"
Oct 30 21:23:58.889713 ip-10-0-138-85 kubenswrapper[6004]: E1030 21:23:58.889690    6004 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"92528b79acbd139987655f962377164bd5d8ce615d0b147cdece141e2b3f2eff\": container with ID starting with 92528b79acbd139987655f962377164bd5d8ce615d0b147cdece141e2b3f2eff not found: ID does not exist" containerID="92528b79acbd139987655f962377164bd5d8ce615d0b147cdece141e2b3f2eff"
Oct 30 21:23:58.889804 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:23:58.889724    6004 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"92528b79acbd139987655f962377164bd5d8ce615d0b147cdece141e2b3f2eff"} err="failed to get container status \"92528b79acbd139987655f962377164bd5d8ce615d0b147cdece141e2b3f2eff\": rpc error: code = NotFound desc = could not find container \"92528b79acbd139987655f962377164bd5d8ce615d0b147cdece141e2b3f2eff\": container with ID starting with 92528b79acbd139987655f962377164bd5d8ce615d0b147cdece141e2b3f2eff not found: ID does not exist"
Oct 30 21:23:58.889804 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:23:58.889745    6004 scope.go:122] "RemoveContainer" containerID="e8a14e26ba82bfe056be275f12e471bc2b95ab0efb2eb7bb97e9631a6b1dc9e0"
Oct 30 21:23:58.901385 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:23:58.901363    6004 scope.go:122] "RemoveContainer" containerID="e8a14e26ba82bfe056be275f12e471bc2b95ab0efb2eb7bb97e9631a6b1dc9e0"
Oct 30 21:23:58.901707 ip-10-0-138-85 kubenswrapper[6004]: E1030 21:23:58.901689    6004 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e8a14e26ba82bfe056be275f12e471bc2b95ab0efb2eb7bb97e9631a6b1dc9e0\": container with ID starting with e8a14e26ba82bfe056be275f12e471bc2b95ab0efb2eb7bb97e9631a6b1dc9e0 not found: ID does not exist" containerID="e8a14e26ba82bfe056be275f12e471bc2b95ab0efb2eb7bb97e9631a6b1dc9e0"
Oct 30 21:23:58.901779 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:23:58.901718    6004 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e8a14e26ba82bfe056be275f12e471bc2b95ab0efb2eb7bb97e9631a6b1dc9e0"} err="failed to get container status \"e8a14e26ba82bfe056be275f12e471bc2b95ab0efb2eb7bb97e9631a6b1dc9e0\": rpc error: code = NotFound desc = could not find container \"e8a14e26ba82bfe056be275f12e471bc2b95ab0efb2eb7bb97e9631a6b1dc9e0\": container with ID starting with e8a14e26ba82bfe056be275f12e471bc2b95ab0efb2eb7bb97e9631a6b1dc9e0 not found: ID does not exist"
Oct 30 21:23:58.901779 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:23:58.901741    6004 scope.go:122] "RemoveContainer" containerID="fb3684cc1646ca1f6190899db5252143fd3a874b95f63fa88a452a51b5184ec1"
Oct 30 21:23:58.911789 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:23:58.911399    6004 scope.go:122] "RemoveContainer" containerID="fb3684cc1646ca1f6190899db5252143fd3a874b95f63fa88a452a51b5184ec1"
Oct 30 21:23:58.911789 ip-10-0-138-85 kubenswrapper[6004]: E1030 21:23:58.911730    6004 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fb3684cc1646ca1f6190899db5252143fd3a874b95f63fa88a452a51b5184ec1\": container with ID starting with fb3684cc1646ca1f6190899db5252143fd3a874b95f63fa88a452a51b5184ec1 not found: ID does not exist" containerID="fb3684cc1646ca1f6190899db5252143fd3a874b95f63fa88a452a51b5184ec1"
Oct 30 21:23:58.911789 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:23:58.911762    6004 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fb3684cc1646ca1f6190899db5252143fd3a874b95f63fa88a452a51b5184ec1"} err="failed to get container status \"fb3684cc1646ca1f6190899db5252143fd3a874b95f63fa88a452a51b5184ec1\": rpc error: code = NotFound desc = could not find container \"fb3684cc1646ca1f6190899db5252143fd3a874b95f63fa88a452a51b5184ec1\": container with ID starting with fb3684cc1646ca1f6190899db5252143fd3a874b95f63fa88a452a51b5184ec1 not found: ID does not exist"
Oct 30 21:23:58.911789 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:23:58.911786    6004 scope.go:122] "RemoveContainer" containerID="7a8411a35ea8f25307fe951149291b6a46fa3ff692de68f3154aa196266845e8"
Oct 30 21:23:58.921610 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:23:58.921594    6004 scope.go:122] "RemoveContainer" containerID="7a8411a35ea8f25307fe951149291b6a46fa3ff692de68f3154aa196266845e8"
Oct 30 21:23:58.921927 ip-10-0-138-85 kubenswrapper[6004]: E1030 21:23:58.921903    6004 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7a8411a35ea8f25307fe951149291b6a46fa3ff692de68f3154aa196266845e8\": container with ID starting with 7a8411a35ea8f25307fe951149291b6a46fa3ff692de68f3154aa196266845e8 not found: ID does not exist" containerID="7a8411a35ea8f25307fe951149291b6a46fa3ff692de68f3154aa196266845e8"
Oct 30 21:23:58.922014 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:23:58.921940    6004 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7a8411a35ea8f25307fe951149291b6a46fa3ff692de68f3154aa196266845e8"} err="failed to get container status \"7a8411a35ea8f25307fe951149291b6a46fa3ff692de68f3154aa196266845e8\": rpc error: code = NotFound desc = could not find container \"7a8411a35ea8f25307fe951149291b6a46fa3ff692de68f3154aa196266845e8\": container with ID starting with 7a8411a35ea8f25307fe951149291b6a46fa3ff692de68f3154aa196266845e8 not found: ID does not exist"
Oct 30 21:23:58.931219 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:23:58.931191    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/44ec9e0c-2e06-45a6-a8bb-871640460980-kube-api-access-rlzj9\" (UniqueName: \"kubernetes.io/projected/44ec9e0c-2e06-45a6-a8bb-871640460980-kube-api-access-rlzj9\") pod \"44ec9e0c-2e06-45a6-a8bb-871640460980\" (UID: \"44ec9e0c-2e06-45a6-a8bb-871640460980\") "
Oct 30 21:23:58.931352 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:23:58.931235    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/44ec9e0c-2e06-45a6-a8bb-871640460980-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/44ec9e0c-2e06-45a6-a8bb-871640460980-istio-podinfo\") pod \"44ec9e0c-2e06-45a6-a8bb-871640460980\" (UID: \"44ec9e0c-2e06-45a6-a8bb-871640460980\") "
Oct 30 21:23:58.931352 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:23:58.931265    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/44ec9e0c-2e06-45a6-a8bb-871640460980-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/44ec9e0c-2e06-45a6-a8bb-871640460980-istiod-ca-cert\") pod \"44ec9e0c-2e06-45a6-a8bb-871640460980\" (UID: \"44ec9e0c-2e06-45a6-a8bb-871640460980\") "
Oct 30 21:23:58.931352 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:23:58.931337    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/44ec9e0c-2e06-45a6-a8bb-871640460980-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/44ec9e0c-2e06-45a6-a8bb-871640460980-istio-data\") pod \"44ec9e0c-2e06-45a6-a8bb-871640460980\" (UID: \"44ec9e0c-2e06-45a6-a8bb-871640460980\") "
Oct 30 21:23:58.931801 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:23:58.931375    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/44ec9e0c-2e06-45a6-a8bb-871640460980-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/44ec9e0c-2e06-45a6-a8bb-871640460980-istio-envoy\") pod \"44ec9e0c-2e06-45a6-a8bb-871640460980\" (UID: \"44ec9e0c-2e06-45a6-a8bb-871640460980\") "
Oct 30 21:23:58.931801 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:23:58.931447    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/44ec9e0c-2e06-45a6-a8bb-871640460980-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/44ec9e0c-2e06-45a6-a8bb-871640460980-workload-socket\") pod \"44ec9e0c-2e06-45a6-a8bb-871640460980\" (UID: \"44ec9e0c-2e06-45a6-a8bb-871640460980\") "
Oct 30 21:23:58.931801 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:23:58.931479    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/44ec9e0c-2e06-45a6-a8bb-871640460980-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/44ec9e0c-2e06-45a6-a8bb-871640460980-workload-certs\") pod \"44ec9e0c-2e06-45a6-a8bb-871640460980\" (UID: \"44ec9e0c-2e06-45a6-a8bb-871640460980\") "
Oct 30 21:23:58.931801 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:23:58.931522    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/44ec9e0c-2e06-45a6-a8bb-871640460980-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/44ec9e0c-2e06-45a6-a8bb-871640460980-credential-socket\") pod \"44ec9e0c-2e06-45a6-a8bb-871640460980\" (UID: \"44ec9e0c-2e06-45a6-a8bb-871640460980\") "
Oct 30 21:23:58.931801 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:23:58.931585    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/44ec9e0c-2e06-45a6-a8bb-871640460980-istio-token\" (UniqueName: \"kubernetes.io/projected/44ec9e0c-2e06-45a6-a8bb-871640460980-istio-token\") pod \"44ec9e0c-2e06-45a6-a8bb-871640460980\" (UID: \"44ec9e0c-2e06-45a6-a8bb-871640460980\") "
Oct 30 21:23:58.932116 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:23:58.932089    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/44ec9e0c-2e06-45a6-a8bb-871640460980-workload-certs" pod "44ec9e0c-2e06-45a6-a8bb-871640460980" (UID: "44ec9e0c-2e06-45a6-a8bb-871640460980"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:23:58.932571 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:23:58.932191    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/44ec9e0c-2e06-45a6-a8bb-871640460980-workload-socket" pod "44ec9e0c-2e06-45a6-a8bb-871640460980" (UID: "44ec9e0c-2e06-45a6-a8bb-871640460980"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:23:58.932571 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:23:58.932398    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/44ec9e0c-2e06-45a6-a8bb-871640460980-credential-socket" pod "44ec9e0c-2e06-45a6-a8bb-871640460980" (UID: "44ec9e0c-2e06-45a6-a8bb-871640460980"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:23:58.932571 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:23:58.932494    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/44ec9e0c-2e06-45a6-a8bb-871640460980-istiod-ca-cert" pod "44ec9e0c-2e06-45a6-a8bb-871640460980" (UID: "44ec9e0c-2e06-45a6-a8bb-871640460980"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:23:58.932571 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:23:58.932549    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/44ec9e0c-2e06-45a6-a8bb-871640460980-istio-data" pod "44ec9e0c-2e06-45a6-a8bb-871640460980" (UID: "44ec9e0c-2e06-45a6-a8bb-871640460980"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:23:58.933186 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:23:58.933160    6004 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bb7251a5-aa97-4ee2-a00d-27083704dc60-istio-envoy\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:23:58.933287 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:23:58.933191    6004 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bb7251a5-aa97-4ee2-a00d-27083704dc60-credential-socket\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:23:58.933287 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:23:58.933206    6004 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bb7251a5-aa97-4ee2-a00d-27083704dc60-istio-podinfo\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:23:58.933287 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:23:58.933219    6004 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m48pk\" (UniqueName: \"kubernetes.io/projected/10b2809a-8076-443d-9d48-2e0da4f59401-kube-api-access-m48pk\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:23:58.933287 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:23:58.933235    6004 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/10b2809a-8076-443d-9d48-2e0da4f59401-plugins-config-volume\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:23:58.933287 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:23:58.933248    6004 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/44ec9e0c-2e06-45a6-a8bb-871640460980-istiod-ca-cert\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:23:58.933287 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:23:58.933285    6004 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bb7251a5-aa97-4ee2-a00d-27083704dc60-istiod-ca-cert\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:23:58.933605 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:23:58.933299    6004 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bb7251a5-aa97-4ee2-a00d-27083704dc60-istio-token\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:23:58.933605 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:23:58.933312    6004 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/44ec9e0c-2e06-45a6-a8bb-871640460980-istio-data\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:23:58.933605 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:23:58.933327    6004 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bb7251a5-aa97-4ee2-a00d-27083704dc60-workload-socket\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:23:58.933605 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:23:58.933340    6004 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bb7251a5-aa97-4ee2-a00d-27083704dc60-istio-data\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:23:58.933605 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:23:58.933357    6004 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/44ec9e0c-2e06-45a6-a8bb-871640460980-workload-socket\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:23:58.933605 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:23:58.933371    6004 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/44ec9e0c-2e06-45a6-a8bb-871640460980-workload-certs\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:23:58.933605 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:23:58.933384    6004 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/44ec9e0c-2e06-45a6-a8bb-871640460980-credential-socket\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:23:58.933605 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:23:58.933397    6004 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g748t\" (UniqueName: \"kubernetes.io/projected/bb7251a5-aa97-4ee2-a00d-27083704dc60-kube-api-access-g748t\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:23:58.933605 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:23:58.933412    6004 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bb7251a5-aa97-4ee2-a00d-27083704dc60-workload-certs\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:23:58.941422 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:23:58.941396    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/44ec9e0c-2e06-45a6-a8bb-871640460980-istio-podinfo" pod "44ec9e0c-2e06-45a6-a8bb-871640460980" (UID: "44ec9e0c-2e06-45a6-a8bb-871640460980"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 21:23:58.941422 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:23:58.941393    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/44ec9e0c-2e06-45a6-a8bb-871640460980-istio-envoy" pod "44ec9e0c-2e06-45a6-a8bb-871640460980" (UID: "44ec9e0c-2e06-45a6-a8bb-871640460980"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:23:58.941594 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:23:58.941397    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/44ec9e0c-2e06-45a6-a8bb-871640460980-kube-api-access-rlzj9" pod "44ec9e0c-2e06-45a6-a8bb-871640460980" (UID: "44ec9e0c-2e06-45a6-a8bb-871640460980"). InnerVolumeSpecName "kube-api-access-rlzj9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:23:58.942600 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:23:58.942581    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/44ec9e0c-2e06-45a6-a8bb-871640460980-istio-token" pod "44ec9e0c-2e06-45a6-a8bb-871640460980" (UID: "44ec9e0c-2e06-45a6-a8bb-871640460980"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:23:59.034831 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:23:59.034788    6004 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rlzj9\" (UniqueName: \"kubernetes.io/projected/44ec9e0c-2e06-45a6-a8bb-871640460980-kube-api-access-rlzj9\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:23:59.034831 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:23:59.034832    6004 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/44ec9e0c-2e06-45a6-a8bb-871640460980-istio-podinfo\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:23:59.034831 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:23:59.034849    6004 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/44ec9e0c-2e06-45a6-a8bb-871640460980-istio-envoy\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:23:59.035185 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:23:59.034863    6004 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/44ec9e0c-2e06-45a6-a8bb-871640460980-istio-token\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:23:59.179155 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:23:59.179069    6004 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-769df7846c-r8vgx"]
Oct 30 21:23:59.185595 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:23:59.185565    6004 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-769df7846c-r8vgx"]
Oct 30 21:23:59.296739 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:23:59.296708    6004 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-d1b889bd-7d887b46cb-wk22v"]
Oct 30 21:23:59.298809 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:23:59.298786    6004 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-d1b889bd-7d887b46cb-wk22v"]
Oct 30 21:23:59.407744 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:23:59.407711    6004 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-d1b889bd-bb457476c-zqc8k"]
Oct 30 21:23:59.411816 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:23:59.411791    6004 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-d1b889bd-bb457476c-zqc8k"]
Oct 30 21:23:59.577645 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:23:59.577616    6004 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-769df7846c-lvdfj"]
Oct 30 21:23:59.581125 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:23:59.581099    6004 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-769df7846c-lvdfj"]
Oct 30 21:24:00.230803 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:24:00.230765    6004 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="020551c8-c3b9-4aec-bf4e-214c816f9c7f" path="/var/lib/kubelet/pods/020551c8-c3b9-4aec-bf4e-214c816f9c7f/volumes"
Oct 30 21:24:00.231200 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:24:00.231186    6004 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="10b2809a-8076-443d-9d48-2e0da4f59401" path="/var/lib/kubelet/pods/10b2809a-8076-443d-9d48-2e0da4f59401/volumes"
Oct 30 21:24:00.231609 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:24:00.231596    6004 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="44ec9e0c-2e06-45a6-a8bb-871640460980" path="/var/lib/kubelet/pods/44ec9e0c-2e06-45a6-a8bb-871640460980/volumes"
Oct 30 21:24:00.232301 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:24:00.232287    6004 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="bb7251a5-aa97-4ee2-a00d-27083704dc60" path="/var/lib/kubelet/pods/bb7251a5-aa97-4ee2-a00d-27083704dc60/volumes"
Oct 30 21:24:14.260287 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:24:14.260250    6004 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-d1b889bd-7849b458b6-lcnlf"]
Oct 30 21:24:14.260910 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:24:14.260461    6004 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-d1b889bd-7849b458b6-lcnlf" podUID="098b86da-6c61-47d5-be96-ecda30ffeb60" containerName="maas-api" containerID="cri-o://3fd639800a171a7d42231dc5d8c31c77e9d821b7c8b9a38bf4959c7ae435f18c" gracePeriod=30
Oct 30 21:24:14.294524 ip-10-0-138-85 kubenswrapper[6004]: E1030 21:24:14.294455    6004 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-zz4wr" containerName="extractor"
Oct 30 21:24:14.547539 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:24:14.547505    6004 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-d1b889bd-7849b458b6-lcnlf"
Oct 30 21:24:14.611653 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:24:14.611617    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/098b86da-6c61-47d5-be96-ecda30ffeb60-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/098b86da-6c61-47d5-be96-ecda30ffeb60-maas-api-tls\") pod \"098b86da-6c61-47d5-be96-ecda30ffeb60\" (UID: \"098b86da-6c61-47d5-be96-ecda30ffeb60\") "
Oct 30 21:24:14.611847 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:24:14.611668    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/098b86da-6c61-47d5-be96-ecda30ffeb60-kube-api-access-tz7wj\" (UniqueName: \"kubernetes.io/projected/098b86da-6c61-47d5-be96-ecda30ffeb60-kube-api-access-tz7wj\") pod \"098b86da-6c61-47d5-be96-ecda30ffeb60\" (UID: \"098b86da-6c61-47d5-be96-ecda30ffeb60\") "
Oct 30 21:24:14.611847 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:24:14.611826    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/098b86da-6c61-47d5-be96-ecda30ffeb60-metrics-certs\" (UniqueName: \"kubernetes.io/secret/098b86da-6c61-47d5-be96-ecda30ffeb60-metrics-certs\") pod \"098b86da-6c61-47d5-be96-ecda30ffeb60\" (UID: \"098b86da-6c61-47d5-be96-ecda30ffeb60\") "
Oct 30 21:24:14.611978 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:24:14.611871    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/098b86da-6c61-47d5-be96-ecda30ffeb60-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/098b86da-6c61-47d5-be96-ecda30ffeb60-openshift-service-ca\") pod \"098b86da-6c61-47d5-be96-ecda30ffeb60\" (UID: \"098b86da-6c61-47d5-be96-ecda30ffeb60\") "
Oct 30 21:24:14.612492 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:24:14.612465    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/098b86da-6c61-47d5-be96-ecda30ffeb60-openshift-service-ca" pod "098b86da-6c61-47d5-be96-ecda30ffeb60" (UID: "098b86da-6c61-47d5-be96-ecda30ffeb60"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:24:14.614011 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:24:14.613920    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/098b86da-6c61-47d5-be96-ecda30ffeb60-maas-api-tls" pod "098b86da-6c61-47d5-be96-ecda30ffeb60" (UID: "098b86da-6c61-47d5-be96-ecda30ffeb60"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:24:14.614281 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:24:14.614248    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/098b86da-6c61-47d5-be96-ecda30ffeb60-kube-api-access-tz7wj" pod "098b86da-6c61-47d5-be96-ecda30ffeb60" (UID: "098b86da-6c61-47d5-be96-ecda30ffeb60"). InnerVolumeSpecName "kube-api-access-tz7wj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:24:14.614389 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:24:14.614322    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/098b86da-6c61-47d5-be96-ecda30ffeb60-metrics-certs" pod "098b86da-6c61-47d5-be96-ecda30ffeb60" (UID: "098b86da-6c61-47d5-be96-ecda30ffeb60"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:24:14.712792 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:24:14.712761    6004 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/098b86da-6c61-47d5-be96-ecda30ffeb60-maas-api-tls\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:24:14.712792 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:24:14.712789    6004 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tz7wj\" (UniqueName: \"kubernetes.io/projected/098b86da-6c61-47d5-be96-ecda30ffeb60-kube-api-access-tz7wj\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:24:14.712792 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:24:14.712800    6004 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/098b86da-6c61-47d5-be96-ecda30ffeb60-metrics-certs\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:24:14.713023 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:24:14.712809    6004 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/098b86da-6c61-47d5-be96-ecda30ffeb60-openshift-service-ca\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:24:14.986379 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:24:14.986343    6004 generic.go:356] "Generic (PLEG): container finished" podID="098b86da-6c61-47d5-be96-ecda30ffeb60" containerID="3fd639800a171a7d42231dc5d8c31c77e9d821b7c8b9a38bf4959c7ae435f18c" exitCode=0
Oct 30 21:24:14.986563 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:24:14.986395    6004 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-d1b889bd-7849b458b6-lcnlf"
Oct 30 21:24:14.986563 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:24:14.986437    6004 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-d1b889bd-7849b458b6-lcnlf" event={"ID":"098b86da-6c61-47d5-be96-ecda30ffeb60","Type":"ContainerDied","Data":"3fd639800a171a7d42231dc5d8c31c77e9d821b7c8b9a38bf4959c7ae435f18c"}
Oct 30 21:24:14.986563 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:24:14.986536    6004 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-d1b889bd-7849b458b6-lcnlf" event={"ID":"098b86da-6c61-47d5-be96-ecda30ffeb60","Type":"ContainerDied","Data":"478e29149d27270f69000f615c26ff9a3028802063d1ee8f589d2f2b872580a8"}
Oct 30 21:24:14.986668 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:24:14.986568    6004 scope.go:122] "RemoveContainer" containerID="3fd639800a171a7d42231dc5d8c31c77e9d821b7c8b9a38bf4959c7ae435f18c"
Oct 30 21:24:14.996976 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:24:14.996953    6004 scope.go:122] "RemoveContainer" containerID="3fd639800a171a7d42231dc5d8c31c77e9d821b7c8b9a38bf4959c7ae435f18c"
Oct 30 21:24:14.997254 ip-10-0-138-85 kubenswrapper[6004]: E1030 21:24:14.997234    6004 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3fd639800a171a7d42231dc5d8c31c77e9d821b7c8b9a38bf4959c7ae435f18c\": container with ID starting with 3fd639800a171a7d42231dc5d8c31c77e9d821b7c8b9a38bf4959c7ae435f18c not found: ID does not exist" containerID="3fd639800a171a7d42231dc5d8c31c77e9d821b7c8b9a38bf4959c7ae435f18c"
Oct 30 21:24:14.997317 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:24:14.997262    6004 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3fd639800a171a7d42231dc5d8c31c77e9d821b7c8b9a38bf4959c7ae435f18c"} err="failed to get container status \"3fd639800a171a7d42231dc5d8c31c77e9d821b7c8b9a38bf4959c7ae435f18c\": rpc error: code = NotFound desc = could not find container \"3fd639800a171a7d42231dc5d8c31c77e9d821b7c8b9a38bf4959c7ae435f18c\": container with ID starting with 3fd639800a171a7d42231dc5d8c31c77e9d821b7c8b9a38bf4959c7ae435f18c not found: ID does not exist"
Oct 30 21:24:15.151711 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:24:15.151672    6004 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-d1b889bd-7849b458b6-lcnlf"]
Oct 30 21:24:15.158744 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:24:15.158714    6004 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-d1b889bd-7849b458b6-lcnlf"]
Oct 30 21:24:16.231193 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:24:16.231162    6004 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="098b86da-6c61-47d5-be96-ecda30ffeb60" path="/var/lib/kubelet/pods/098b86da-6c61-47d5-be96-ecda30ffeb60/volumes"
Oct 30 21:24:44.287877 ip-10-0-138-85 kubenswrapper[6004]: E1030 21:24:44.287838    6004 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-zz4wr" containerName="extractor"
Oct 30 21:25:05.668347 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:25:05.667795    6004 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-d1b889bd-openshift-default-566bd56c85-gtprk"]
Oct 30 21:25:05.668347 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:25:05.668012    6004 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-d1b889bd-openshift-default-566bd56c85-gtprk" podUID="645f9519-1d21-4dd3-a807-86c9e7ecdab3" containerName="istio-proxy" containerID="cri-o://9740194aa44a7d77c4a44acea5d6585666e344d6002e79d5adbf534ebbac07c6" gracePeriod=30
Oct 30 21:25:05.683402 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:25:05.683374    6004 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-d1b889bd-openshift-default-566bd56c85-hkzxf"]
Oct 30 21:25:05.683650 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:25:05.683620    6004 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-d1b889bd-openshift-default-566bd56c85-hkzxf" podUID="a411974f-4789-4fd8-889a-590949a89a22" containerName="istio-proxy" containerID="cri-o://58999c9aacdb2ed1c5cf779f760338d61b37016f7c89d14a782946b3c7d4902a" gracePeriod=30
Oct 30 21:25:10.954342 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:25:10.954313    6004 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-d1b889bd-openshift-default-566bd56c85-gtprk"
Oct 30 21:25:10.982960 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:25:10.982935    6004 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-d1b889bd-openshift-default-566bd56c85-hkzxf"
Oct 30 21:25:11.101557 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:25:11.101515    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/645f9519-1d21-4dd3-a807-86c9e7ecdab3-istio-token\" (UniqueName: \"kubernetes.io/projected/645f9519-1d21-4dd3-a807-86c9e7ecdab3-istio-token\") pod \"645f9519-1d21-4dd3-a807-86c9e7ecdab3\" (UID: \"645f9519-1d21-4dd3-a807-86c9e7ecdab3\") "
Oct 30 21:25:11.101724 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:25:11.101602    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/645f9519-1d21-4dd3-a807-86c9e7ecdab3-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/645f9519-1d21-4dd3-a807-86c9e7ecdab3-istio-envoy\") pod \"645f9519-1d21-4dd3-a807-86c9e7ecdab3\" (UID: \"645f9519-1d21-4dd3-a807-86c9e7ecdab3\") "
Oct 30 21:25:11.101724 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:25:11.101648    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/645f9519-1d21-4dd3-a807-86c9e7ecdab3-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/645f9519-1d21-4dd3-a807-86c9e7ecdab3-workload-certs\") pod \"645f9519-1d21-4dd3-a807-86c9e7ecdab3\" (UID: \"645f9519-1d21-4dd3-a807-86c9e7ecdab3\") "
Oct 30 21:25:11.101724 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:25:11.101683    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/a411974f-4789-4fd8-889a-590949a89a22-kube-api-access-rfs6l\" (UniqueName: \"kubernetes.io/projected/a411974f-4789-4fd8-889a-590949a89a22-kube-api-access-rfs6l\") pod \"a411974f-4789-4fd8-889a-590949a89a22\" (UID: \"a411974f-4789-4fd8-889a-590949a89a22\") "
Oct 30 21:25:11.101724 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:25:11.101720    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/645f9519-1d21-4dd3-a807-86c9e7ecdab3-kube-api-access-g5sfv\" (UniqueName: \"kubernetes.io/projected/645f9519-1d21-4dd3-a807-86c9e7ecdab3-kube-api-access-g5sfv\") pod \"645f9519-1d21-4dd3-a807-86c9e7ecdab3\" (UID: \"645f9519-1d21-4dd3-a807-86c9e7ecdab3\") "
Oct 30 21:25:11.101971 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:25:11.101766    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/a411974f-4789-4fd8-889a-590949a89a22-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a411974f-4789-4fd8-889a-590949a89a22-credential-socket\") pod \"a411974f-4789-4fd8-889a-590949a89a22\" (UID: \"a411974f-4789-4fd8-889a-590949a89a22\") "
Oct 30 21:25:11.101971 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:25:11.101793    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/645f9519-1d21-4dd3-a807-86c9e7ecdab3-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/645f9519-1d21-4dd3-a807-86c9e7ecdab3-workload-socket\") pod \"645f9519-1d21-4dd3-a807-86c9e7ecdab3\" (UID: \"645f9519-1d21-4dd3-a807-86c9e7ecdab3\") "
Oct 30 21:25:11.101971 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:25:11.101820    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/a411974f-4789-4fd8-889a-590949a89a22-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a411974f-4789-4fd8-889a-590949a89a22-istio-envoy\") pod \"a411974f-4789-4fd8-889a-590949a89a22\" (UID: \"a411974f-4789-4fd8-889a-590949a89a22\") "
Oct 30 21:25:11.101971 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:25:11.101854    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/a411974f-4789-4fd8-889a-590949a89a22-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a411974f-4789-4fd8-889a-590949a89a22-workload-socket\") pod \"a411974f-4789-4fd8-889a-590949a89a22\" (UID: \"a411974f-4789-4fd8-889a-590949a89a22\") "
Oct 30 21:25:11.101971 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:25:11.101920    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/645f9519-1d21-4dd3-a807-86c9e7ecdab3-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/645f9519-1d21-4dd3-a807-86c9e7ecdab3-istio-data\") pod \"645f9519-1d21-4dd3-a807-86c9e7ecdab3\" (UID: \"645f9519-1d21-4dd3-a807-86c9e7ecdab3\") "
Oct 30 21:25:11.101971 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:25:11.101952    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/a411974f-4789-4fd8-889a-590949a89a22-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a411974f-4789-4fd8-889a-590949a89a22-istio-podinfo\") pod \"a411974f-4789-4fd8-889a-590949a89a22\" (UID: \"a411974f-4789-4fd8-889a-590949a89a22\") "
Oct 30 21:25:11.103712 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:25:11.102365    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/645f9519-1d21-4dd3-a807-86c9e7ecdab3-workload-certs" pod "645f9519-1d21-4dd3-a807-86c9e7ecdab3" (UID: "645f9519-1d21-4dd3-a807-86c9e7ecdab3"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:25:11.103712 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:25:11.102392    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/645f9519-1d21-4dd3-a807-86c9e7ecdab3-workload-socket" pod "645f9519-1d21-4dd3-a807-86c9e7ecdab3" (UID: "645f9519-1d21-4dd3-a807-86c9e7ecdab3"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:25:11.103712 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:25:11.102343    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a411974f-4789-4fd8-889a-590949a89a22-workload-socket" pod "a411974f-4789-4fd8-889a-590949a89a22" (UID: "a411974f-4789-4fd8-889a-590949a89a22"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:25:11.103712 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:25:11.102436    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a411974f-4789-4fd8-889a-590949a89a22-credential-socket" pod "a411974f-4789-4fd8-889a-590949a89a22" (UID: "a411974f-4789-4fd8-889a-590949a89a22"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:25:11.103712 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:25:11.102587    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/645f9519-1d21-4dd3-a807-86c9e7ecdab3-istio-data" pod "645f9519-1d21-4dd3-a807-86c9e7ecdab3" (UID: "645f9519-1d21-4dd3-a807-86c9e7ecdab3"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:25:11.103712 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:25:11.102671    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/a411974f-4789-4fd8-889a-590949a89a22-istio-token\" (UniqueName: \"kubernetes.io/projected/a411974f-4789-4fd8-889a-590949a89a22-istio-token\") pod \"a411974f-4789-4fd8-889a-590949a89a22\" (UID: \"a411974f-4789-4fd8-889a-590949a89a22\") "
Oct 30 21:25:11.103712 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:25:11.102725    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/645f9519-1d21-4dd3-a807-86c9e7ecdab3-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/645f9519-1d21-4dd3-a807-86c9e7ecdab3-istiod-ca-cert\") pod \"645f9519-1d21-4dd3-a807-86c9e7ecdab3\" (UID: \"645f9519-1d21-4dd3-a807-86c9e7ecdab3\") "
Oct 30 21:25:11.103712 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:25:11.102762    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/a411974f-4789-4fd8-889a-590949a89a22-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a411974f-4789-4fd8-889a-590949a89a22-istiod-ca-cert\") pod \"a411974f-4789-4fd8-889a-590949a89a22\" (UID: \"a411974f-4789-4fd8-889a-590949a89a22\") "
Oct 30 21:25:11.103712 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:25:11.102799    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/645f9519-1d21-4dd3-a807-86c9e7ecdab3-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/645f9519-1d21-4dd3-a807-86c9e7ecdab3-credential-socket\") pod \"645f9519-1d21-4dd3-a807-86c9e7ecdab3\" (UID: \"645f9519-1d21-4dd3-a807-86c9e7ecdab3\") "
Oct 30 21:25:11.103712 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:25:11.102834    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/a411974f-4789-4fd8-889a-590949a89a22-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a411974f-4789-4fd8-889a-590949a89a22-workload-certs\") pod \"a411974f-4789-4fd8-889a-590949a89a22\" (UID: \"a411974f-4789-4fd8-889a-590949a89a22\") "
Oct 30 21:25:11.103712 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:25:11.102885    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/645f9519-1d21-4dd3-a807-86c9e7ecdab3-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/645f9519-1d21-4dd3-a807-86c9e7ecdab3-istio-podinfo\") pod \"645f9519-1d21-4dd3-a807-86c9e7ecdab3\" (UID: \"645f9519-1d21-4dd3-a807-86c9e7ecdab3\") "
Oct 30 21:25:11.103712 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:25:11.102917    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/a411974f-4789-4fd8-889a-590949a89a22-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a411974f-4789-4fd8-889a-590949a89a22-istio-data\") pod \"a411974f-4789-4fd8-889a-590949a89a22\" (UID: \"a411974f-4789-4fd8-889a-590949a89a22\") "
Oct 30 21:25:11.103712 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:25:11.103242    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/645f9519-1d21-4dd3-a807-86c9e7ecdab3-credential-socket" pod "645f9519-1d21-4dd3-a807-86c9e7ecdab3" (UID: "645f9519-1d21-4dd3-a807-86c9e7ecdab3"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:25:11.103712 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:25:11.103284    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a411974f-4789-4fd8-889a-590949a89a22-workload-certs" pod "a411974f-4789-4fd8-889a-590949a89a22" (UID: "a411974f-4789-4fd8-889a-590949a89a22"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:25:11.103712 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:25:11.103353    6004 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/645f9519-1d21-4dd3-a807-86c9e7ecdab3-workload-certs\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:25:11.103712 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:25:11.103370    6004 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a411974f-4789-4fd8-889a-590949a89a22-credential-socket\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:25:11.103712 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:25:11.103386    6004 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/645f9519-1d21-4dd3-a807-86c9e7ecdab3-workload-socket\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:25:11.103712 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:25:11.103421    6004 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a411974f-4789-4fd8-889a-590949a89a22-workload-socket\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:25:11.103712 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:25:11.103435    6004 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/645f9519-1d21-4dd3-a807-86c9e7ecdab3-istio-data\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:25:11.103712 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:25:11.103448    6004 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/645f9519-1d21-4dd3-a807-86c9e7ecdab3-credential-socket\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:25:11.103712 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:25:11.103453    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a411974f-4789-4fd8-889a-590949a89a22-istio-data" pod "a411974f-4789-4fd8-889a-590949a89a22" (UID: "a411974f-4789-4fd8-889a-590949a89a22"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:25:11.103712 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:25:11.103650    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/645f9519-1d21-4dd3-a807-86c9e7ecdab3-istiod-ca-cert" pod "645f9519-1d21-4dd3-a807-86c9e7ecdab3" (UID: "645f9519-1d21-4dd3-a807-86c9e7ecdab3"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:25:11.103712 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:25:11.103712    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a411974f-4789-4fd8-889a-590949a89a22-istiod-ca-cert" pod "a411974f-4789-4fd8-889a-590949a89a22" (UID: "a411974f-4789-4fd8-889a-590949a89a22"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:25:11.106080 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:25:11.106011    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/645f9519-1d21-4dd3-a807-86c9e7ecdab3-istio-envoy" pod "645f9519-1d21-4dd3-a807-86c9e7ecdab3" (UID: "645f9519-1d21-4dd3-a807-86c9e7ecdab3"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:25:11.106205 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:25:11.106146    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a411974f-4789-4fd8-889a-590949a89a22-kube-api-access-rfs6l" pod "a411974f-4789-4fd8-889a-590949a89a22" (UID: "a411974f-4789-4fd8-889a-590949a89a22"). InnerVolumeSpecName "kube-api-access-rfs6l". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:25:11.106347 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:25:11.106302    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/645f9519-1d21-4dd3-a807-86c9e7ecdab3-istio-token" pod "645f9519-1d21-4dd3-a807-86c9e7ecdab3" (UID: "645f9519-1d21-4dd3-a807-86c9e7ecdab3"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:25:11.106347 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:25:11.106334    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a411974f-4789-4fd8-889a-590949a89a22-istio-token" pod "a411974f-4789-4fd8-889a-590949a89a22" (UID: "a411974f-4789-4fd8-889a-590949a89a22"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:25:11.106557 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:25:11.106527    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/645f9519-1d21-4dd3-a807-86c9e7ecdab3-istio-podinfo" pod "645f9519-1d21-4dd3-a807-86c9e7ecdab3" (UID: "645f9519-1d21-4dd3-a807-86c9e7ecdab3"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 21:25:11.106711 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:25:11.106673    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/645f9519-1d21-4dd3-a807-86c9e7ecdab3-kube-api-access-g5sfv" pod "645f9519-1d21-4dd3-a807-86c9e7ecdab3" (UID: "645f9519-1d21-4dd3-a807-86c9e7ecdab3"). InnerVolumeSpecName "kube-api-access-g5sfv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:25:11.106935 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:25:11.106918    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a411974f-4789-4fd8-889a-590949a89a22-istio-envoy" pod "a411974f-4789-4fd8-889a-590949a89a22" (UID: "a411974f-4789-4fd8-889a-590949a89a22"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:25:11.107045 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:25:11.107027    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/a411974f-4789-4fd8-889a-590949a89a22-istio-podinfo" pod "a411974f-4789-4fd8-889a-590949a89a22" (UID: "a411974f-4789-4fd8-889a-590949a89a22"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 21:25:11.204660 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:25:11.204588    6004 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a411974f-4789-4fd8-889a-590949a89a22-istio-data\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:25:11.204660 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:25:11.204618    6004 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/645f9519-1d21-4dd3-a807-86c9e7ecdab3-istio-token\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:25:11.204660 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:25:11.204628    6004 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/645f9519-1d21-4dd3-a807-86c9e7ecdab3-istio-envoy\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:25:11.204660 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:25:11.204639    6004 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rfs6l\" (UniqueName: \"kubernetes.io/projected/a411974f-4789-4fd8-889a-590949a89a22-kube-api-access-rfs6l\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:25:11.204660 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:25:11.204652    6004 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g5sfv\" (UniqueName: \"kubernetes.io/projected/645f9519-1d21-4dd3-a807-86c9e7ecdab3-kube-api-access-g5sfv\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:25:11.204989 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:25:11.204666    6004 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a411974f-4789-4fd8-889a-590949a89a22-istio-envoy\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:25:11.204989 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:25:11.204675    6004 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a411974f-4789-4fd8-889a-590949a89a22-istio-podinfo\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:25:11.204989 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:25:11.204684    6004 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a411974f-4789-4fd8-889a-590949a89a22-istio-token\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:25:11.204989 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:25:11.204692    6004 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/645f9519-1d21-4dd3-a807-86c9e7ecdab3-istiod-ca-cert\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:25:11.204989 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:25:11.204700    6004 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a411974f-4789-4fd8-889a-590949a89a22-istiod-ca-cert\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:25:11.204989 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:25:11.204708    6004 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a411974f-4789-4fd8-889a-590949a89a22-workload-certs\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:25:11.204989 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:25:11.204716    6004 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/645f9519-1d21-4dd3-a807-86c9e7ecdab3-istio-podinfo\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:25:11.306249 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:25:11.306214    6004 generic.go:356] "Generic (PLEG): container finished" podID="a411974f-4789-4fd8-889a-590949a89a22" containerID="58999c9aacdb2ed1c5cf779f760338d61b37016f7c89d14a782946b3c7d4902a" exitCode=0
Oct 30 21:25:11.306249 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:25:11.306242    6004 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-d1b889bd-openshift-default-566bd56c85-hkzxf" event={"ID":"a411974f-4789-4fd8-889a-590949a89a22","Type":"ContainerDied","Data":"58999c9aacdb2ed1c5cf779f760338d61b37016f7c89d14a782946b3c7d4902a"}
Oct 30 21:25:11.306518 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:25:11.306292    6004 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-d1b889bd-openshift-default-566bd56c85-hkzxf"
Oct 30 21:25:11.306518 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:25:11.306324    6004 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-d1b889bd-openshift-default-566bd56c85-hkzxf" event={"ID":"a411974f-4789-4fd8-889a-590949a89a22","Type":"ContainerDied","Data":"02bbd35212cef94433f1e550b1b84466c7101916363e8e4d8a8340bb00e9fc86"}
Oct 30 21:25:11.306518 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:25:11.306355    6004 scope.go:122] "RemoveContainer" containerID="58999c9aacdb2ed1c5cf779f760338d61b37016f7c89d14a782946b3c7d4902a"
Oct 30 21:25:11.308491 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:25:11.308135    6004 generic.go:356] "Generic (PLEG): container finished" podID="645f9519-1d21-4dd3-a807-86c9e7ecdab3" containerID="9740194aa44a7d77c4a44acea5d6585666e344d6002e79d5adbf534ebbac07c6" exitCode=0
Oct 30 21:25:11.308491 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:25:11.308215    6004 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-d1b889bd-openshift-default-566bd56c85-gtprk"
Oct 30 21:25:11.308491 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:25:11.308221    6004 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-d1b889bd-openshift-default-566bd56c85-gtprk" event={"ID":"645f9519-1d21-4dd3-a807-86c9e7ecdab3","Type":"ContainerDied","Data":"9740194aa44a7d77c4a44acea5d6585666e344d6002e79d5adbf534ebbac07c6"}
Oct 30 21:25:11.308491 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:25:11.308340    6004 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-d1b889bd-openshift-default-566bd56c85-gtprk" event={"ID":"645f9519-1d21-4dd3-a807-86c9e7ecdab3","Type":"ContainerDied","Data":"af0fdbff54a0571fda5d7ba906fe195b93fbf9196333bb3a53be77b6b95b5221"}
Oct 30 21:25:11.321388 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:25:11.321362    6004 scope.go:122] "RemoveContainer" containerID="58999c9aacdb2ed1c5cf779f760338d61b37016f7c89d14a782946b3c7d4902a"
Oct 30 21:25:11.321721 ip-10-0-138-85 kubenswrapper[6004]: E1030 21:25:11.321698    6004 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"58999c9aacdb2ed1c5cf779f760338d61b37016f7c89d14a782946b3c7d4902a\": container with ID starting with 58999c9aacdb2ed1c5cf779f760338d61b37016f7c89d14a782946b3c7d4902a not found: ID does not exist" containerID="58999c9aacdb2ed1c5cf779f760338d61b37016f7c89d14a782946b3c7d4902a"
Oct 30 21:25:11.321801 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:25:11.321729    6004 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"58999c9aacdb2ed1c5cf779f760338d61b37016f7c89d14a782946b3c7d4902a"} err="failed to get container status \"58999c9aacdb2ed1c5cf779f760338d61b37016f7c89d14a782946b3c7d4902a\": rpc error: code = NotFound desc = could not find container \"58999c9aacdb2ed1c5cf779f760338d61b37016f7c89d14a782946b3c7d4902a\": container with ID starting with 58999c9aacdb2ed1c5cf779f760338d61b37016f7c89d14a782946b3c7d4902a not found: ID does not exist"
Oct 30 21:25:11.321801 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:25:11.321755    6004 scope.go:122] "RemoveContainer" containerID="9740194aa44a7d77c4a44acea5d6585666e344d6002e79d5adbf534ebbac07c6"
Oct 30 21:25:11.332289 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:25:11.332267    6004 scope.go:122] "RemoveContainer" containerID="9740194aa44a7d77c4a44acea5d6585666e344d6002e79d5adbf534ebbac07c6"
Oct 30 21:25:11.332591 ip-10-0-138-85 kubenswrapper[6004]: E1030 21:25:11.332565    6004 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9740194aa44a7d77c4a44acea5d6585666e344d6002e79d5adbf534ebbac07c6\": container with ID starting with 9740194aa44a7d77c4a44acea5d6585666e344d6002e79d5adbf534ebbac07c6 not found: ID does not exist" containerID="9740194aa44a7d77c4a44acea5d6585666e344d6002e79d5adbf534ebbac07c6"
Oct 30 21:25:11.332651 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:25:11.332603    6004 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9740194aa44a7d77c4a44acea5d6585666e344d6002e79d5adbf534ebbac07c6"} err="failed to get container status \"9740194aa44a7d77c4a44acea5d6585666e344d6002e79d5adbf534ebbac07c6\": rpc error: code = NotFound desc = could not find container \"9740194aa44a7d77c4a44acea5d6585666e344d6002e79d5adbf534ebbac07c6\": container with ID starting with 9740194aa44a7d77c4a44acea5d6585666e344d6002e79d5adbf534ebbac07c6 not found: ID does not exist"
Oct 30 21:25:11.473068 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:25:11.472968    6004 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-d1b889bd-openshift-default-566bd56c85-hkzxf"]
Oct 30 21:25:11.480644 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:25:11.480615    6004 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-d1b889bd-openshift-default-566bd56c85-hkzxf"]
Oct 30 21:25:11.612865 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:25:11.612831    6004 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-d1b889bd-openshift-default-566bd56c85-gtprk"]
Oct 30 21:25:11.622654 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:25:11.622629    6004 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-d1b889bd-openshift-default-566bd56c85-gtprk"]
Oct 30 21:25:12.232694 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:25:12.232663    6004 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="645f9519-1d21-4dd3-a807-86c9e7ecdab3" path="/var/lib/kubelet/pods/645f9519-1d21-4dd3-a807-86c9e7ecdab3/volumes"
Oct 30 21:25:12.233190 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:25:12.233108    6004 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="a411974f-4789-4fd8-889a-590949a89a22" path="/var/lib/kubelet/pods/a411974f-4789-4fd8-889a-590949a89a22/volumes"
Oct 30 21:25:13.976623 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:25:13.976586    6004 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-639b07-6f8d5c7898-jw9m6"]
Oct 30 21:25:13.977146 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:25:13.976861    6004 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-639b07-6f8d5c7898-jw9m6" podUID="766d43f7-3939-49dc-9829-db0918b2a138" containerName="maas-api" containerID="cri-o://e41a44f096fe6f25cf11b36be5d652a1033f82149c4f2a79c94b55ab6a314c92" gracePeriod=30
Oct 30 21:25:14.265004 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:25:14.264975    6004 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-639b07-6f8d5c7898-jw9m6"
Oct 30 21:25:14.286460 ip-10-0-138-85 kubenswrapper[6004]: E1030 21:25:14.286424    6004 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-zz4wr" containerName="extractor"
Oct 30 21:25:14.328844 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:25:14.328814    6004 generic.go:356] "Generic (PLEG): container finished" podID="766d43f7-3939-49dc-9829-db0918b2a138" containerID="e41a44f096fe6f25cf11b36be5d652a1033f82149c4f2a79c94b55ab6a314c92" exitCode=0
Oct 30 21:25:14.329064 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:25:14.328869    6004 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-639b07-6f8d5c7898-jw9m6"
Oct 30 21:25:14.329064 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:25:14.328895    6004 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-639b07-6f8d5c7898-jw9m6" event={"ID":"766d43f7-3939-49dc-9829-db0918b2a138","Type":"ContainerDied","Data":"e41a44f096fe6f25cf11b36be5d652a1033f82149c4f2a79c94b55ab6a314c92"}
Oct 30 21:25:14.329064 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:25:14.328965    6004 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-639b07-6f8d5c7898-jw9m6" event={"ID":"766d43f7-3939-49dc-9829-db0918b2a138","Type":"ContainerDied","Data":"7e9716cecc2836a47e50e9efd6dd2bb45c6355a3de5c9ea457403431e870fbdb"}
Oct 30 21:25:14.329064 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:25:14.329001    6004 scope.go:122] "RemoveContainer" containerID="e41a44f096fe6f25cf11b36be5d652a1033f82149c4f2a79c94b55ab6a314c92"
Oct 30 21:25:14.337810 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:25:14.337793    6004 scope.go:122] "RemoveContainer" containerID="e41a44f096fe6f25cf11b36be5d652a1033f82149c4f2a79c94b55ab6a314c92"
Oct 30 21:25:14.338091 ip-10-0-138-85 kubenswrapper[6004]: E1030 21:25:14.338065    6004 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e41a44f096fe6f25cf11b36be5d652a1033f82149c4f2a79c94b55ab6a314c92\": container with ID starting with e41a44f096fe6f25cf11b36be5d652a1033f82149c4f2a79c94b55ab6a314c92 not found: ID does not exist" containerID="e41a44f096fe6f25cf11b36be5d652a1033f82149c4f2a79c94b55ab6a314c92"
Oct 30 21:25:14.338186 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:25:14.338104    6004 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e41a44f096fe6f25cf11b36be5d652a1033f82149c4f2a79c94b55ab6a314c92"} err="failed to get container status \"e41a44f096fe6f25cf11b36be5d652a1033f82149c4f2a79c94b55ab6a314c92\": rpc error: code = NotFound desc = could not find container \"e41a44f096fe6f25cf11b36be5d652a1033f82149c4f2a79c94b55ab6a314c92\": container with ID starting with e41a44f096fe6f25cf11b36be5d652a1033f82149c4f2a79c94b55ab6a314c92 not found: ID does not exist"
Oct 30 21:25:14.440675 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:25:14.440638    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/766d43f7-3939-49dc-9829-db0918b2a138-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/766d43f7-3939-49dc-9829-db0918b2a138-maas-api-tls\") pod \"766d43f7-3939-49dc-9829-db0918b2a138\" (UID: \"766d43f7-3939-49dc-9829-db0918b2a138\") "
Oct 30 21:25:14.440877 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:25:14.440720    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/766d43f7-3939-49dc-9829-db0918b2a138-kube-api-access-sxqfr\" (UniqueName: \"kubernetes.io/projected/766d43f7-3939-49dc-9829-db0918b2a138-kube-api-access-sxqfr\") pod \"766d43f7-3939-49dc-9829-db0918b2a138\" (UID: \"766d43f7-3939-49dc-9829-db0918b2a138\") "
Oct 30 21:25:14.440877 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:25:14.440777    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/766d43f7-3939-49dc-9829-db0918b2a138-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/766d43f7-3939-49dc-9829-db0918b2a138-openshift-service-ca\") pod \"766d43f7-3939-49dc-9829-db0918b2a138\" (UID: \"766d43f7-3939-49dc-9829-db0918b2a138\") "
Oct 30 21:25:14.440877 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:25:14.440809    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/766d43f7-3939-49dc-9829-db0918b2a138-metrics-certs\" (UniqueName: \"kubernetes.io/secret/766d43f7-3939-49dc-9829-db0918b2a138-metrics-certs\") pod \"766d43f7-3939-49dc-9829-db0918b2a138\" (UID: \"766d43f7-3939-49dc-9829-db0918b2a138\") "
Oct 30 21:25:14.441376 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:25:14.441343    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/766d43f7-3939-49dc-9829-db0918b2a138-openshift-service-ca" pod "766d43f7-3939-49dc-9829-db0918b2a138" (UID: "766d43f7-3939-49dc-9829-db0918b2a138"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:25:14.443225 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:25:14.443192    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/766d43f7-3939-49dc-9829-db0918b2a138-metrics-certs" pod "766d43f7-3939-49dc-9829-db0918b2a138" (UID: "766d43f7-3939-49dc-9829-db0918b2a138"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:25:14.443436 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:25:14.443416    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/766d43f7-3939-49dc-9829-db0918b2a138-maas-api-tls" pod "766d43f7-3939-49dc-9829-db0918b2a138" (UID: "766d43f7-3939-49dc-9829-db0918b2a138"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:25:14.443503 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:25:14.443490    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/766d43f7-3939-49dc-9829-db0918b2a138-kube-api-access-sxqfr" pod "766d43f7-3939-49dc-9829-db0918b2a138" (UID: "766d43f7-3939-49dc-9829-db0918b2a138"). InnerVolumeSpecName "kube-api-access-sxqfr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:25:14.542081 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:25:14.541979    6004 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/766d43f7-3939-49dc-9829-db0918b2a138-maas-api-tls\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:25:14.542081 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:25:14.542007    6004 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sxqfr\" (UniqueName: \"kubernetes.io/projected/766d43f7-3939-49dc-9829-db0918b2a138-kube-api-access-sxqfr\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:25:14.542081 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:25:14.542017    6004 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/766d43f7-3939-49dc-9829-db0918b2a138-openshift-service-ca\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:25:14.542081 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:25:14.542026    6004 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/766d43f7-3939-49dc-9829-db0918b2a138-metrics-certs\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:25:14.749526 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:25:14.749495    6004 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-639b07-6f8d5c7898-jw9m6"]
Oct 30 21:25:14.753486 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:25:14.753458    6004 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-639b07-6f8d5c7898-jw9m6"]
Oct 30 21:25:16.239941 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:25:16.239905    6004 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="766d43f7-3939-49dc-9829-db0918b2a138" path="/var/lib/kubelet/pods/766d43f7-3939-49dc-9829-db0918b2a138/volumes"
Oct 30 21:25:35.860477 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:25:35.860439    6004 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w3-682999-5f9fdd855f-jgrfb"]
Oct 30 21:25:35.860978 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:25:35.860680    6004 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-682999-5f9fdd855f-jgrfb" podUID="dd092751-81b5-4a63-a88d-392410a436dd" containerName="maas-api" containerID="cri-o://cb858a158391ed5ce12c9a951c3f0903740968b81f50a3e6753a6e67119b7a01" gracePeriod=30
Oct 30 21:25:35.877850 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:25:35.877808    6004 prober.go:122] "Probe failed" probeType="Readiness" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-682999-5f9fdd855f-jgrfb" podUID="dd092751-81b5-4a63-a88d-392410a436dd" containerName="maas-api" probeResult="failure" output="Get \"https://10.132.0.55:8443/health\": dial tcp 10.132.0.55:8443: connect: connection refused"
Oct 30 21:25:36.143832 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:25:36.143795    6004 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-682999-5f9fdd855f-jgrfb"
Oct 30 21:25:36.252359 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:25:36.252324    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/dd092751-81b5-4a63-a88d-392410a436dd-kube-api-access-n9kzt\" (UniqueName: \"kubernetes.io/projected/dd092751-81b5-4a63-a88d-392410a436dd-kube-api-access-n9kzt\") pod \"dd092751-81b5-4a63-a88d-392410a436dd\" (UID: \"dd092751-81b5-4a63-a88d-392410a436dd\") "
Oct 30 21:25:36.252534 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:25:36.252399    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/dd092751-81b5-4a63-a88d-392410a436dd-metrics-certs\" (UniqueName: \"kubernetes.io/secret/dd092751-81b5-4a63-a88d-392410a436dd-metrics-certs\") pod \"dd092751-81b5-4a63-a88d-392410a436dd\" (UID: \"dd092751-81b5-4a63-a88d-392410a436dd\") "
Oct 30 21:25:36.252534 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:25:36.252504    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/dd092751-81b5-4a63-a88d-392410a436dd-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/dd092751-81b5-4a63-a88d-392410a436dd-openshift-service-ca\") pod \"dd092751-81b5-4a63-a88d-392410a436dd\" (UID: \"dd092751-81b5-4a63-a88d-392410a436dd\") "
Oct 30 21:25:36.252655 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:25:36.252536    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/dd092751-81b5-4a63-a88d-392410a436dd-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/dd092751-81b5-4a63-a88d-392410a436dd-maas-api-tls\") pod \"dd092751-81b5-4a63-a88d-392410a436dd\" (UID: \"dd092751-81b5-4a63-a88d-392410a436dd\") "
Oct 30 21:25:36.253091 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:25:36.253030    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dd092751-81b5-4a63-a88d-392410a436dd-openshift-service-ca" pod "dd092751-81b5-4a63-a88d-392410a436dd" (UID: "dd092751-81b5-4a63-a88d-392410a436dd"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:25:36.266075 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:25:36.261117    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dd092751-81b5-4a63-a88d-392410a436dd-maas-api-tls" pod "dd092751-81b5-4a63-a88d-392410a436dd" (UID: "dd092751-81b5-4a63-a88d-392410a436dd"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:25:36.266075 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:25:36.261717    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dd092751-81b5-4a63-a88d-392410a436dd-metrics-certs" pod "dd092751-81b5-4a63-a88d-392410a436dd" (UID: "dd092751-81b5-4a63-a88d-392410a436dd"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:25:36.266075 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:25:36.265179    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dd092751-81b5-4a63-a88d-392410a436dd-kube-api-access-n9kzt" pod "dd092751-81b5-4a63-a88d-392410a436dd" (UID: "dd092751-81b5-4a63-a88d-392410a436dd"). InnerVolumeSpecName "kube-api-access-n9kzt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:25:36.354410 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:25:36.354373    6004 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/dd092751-81b5-4a63-a88d-392410a436dd-metrics-certs\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:25:36.354598 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:25:36.354518    6004 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/dd092751-81b5-4a63-a88d-392410a436dd-openshift-service-ca\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:25:36.354598 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:25:36.354569    6004 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/dd092751-81b5-4a63-a88d-392410a436dd-maas-api-tls\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:25:36.354598 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:25:36.354585    6004 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n9kzt\" (UniqueName: \"kubernetes.io/projected/dd092751-81b5-4a63-a88d-392410a436dd-kube-api-access-n9kzt\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:25:36.452245 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:25:36.452208    6004 generic.go:356] "Generic (PLEG): container finished" podID="dd092751-81b5-4a63-a88d-392410a436dd" containerID="cb858a158391ed5ce12c9a951c3f0903740968b81f50a3e6753a6e67119b7a01" exitCode=0
Oct 30 21:25:36.452434 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:25:36.452263    6004 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-682999-5f9fdd855f-jgrfb"
Oct 30 21:25:36.452434 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:25:36.452275    6004 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-682999-5f9fdd855f-jgrfb" event={"ID":"dd092751-81b5-4a63-a88d-392410a436dd","Type":"ContainerDied","Data":"cb858a158391ed5ce12c9a951c3f0903740968b81f50a3e6753a6e67119b7a01"}
Oct 30 21:25:36.452434 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:25:36.452329    6004 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-682999-5f9fdd855f-jgrfb" event={"ID":"dd092751-81b5-4a63-a88d-392410a436dd","Type":"ContainerDied","Data":"ada934717c034c43ad4b25f0eedf75dfbda815234886d0c2b54477ffe71b036c"}
Oct 30 21:25:36.452434 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:25:36.452342    6004 scope.go:122] "RemoveContainer" containerID="cb858a158391ed5ce12c9a951c3f0903740968b81f50a3e6753a6e67119b7a01"
Oct 30 21:25:36.462010 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:25:36.461994    6004 scope.go:122] "RemoveContainer" containerID="cb858a158391ed5ce12c9a951c3f0903740968b81f50a3e6753a6e67119b7a01"
Oct 30 21:25:36.462274 ip-10-0-138-85 kubenswrapper[6004]: E1030 21:25:36.462257    6004 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cb858a158391ed5ce12c9a951c3f0903740968b81f50a3e6753a6e67119b7a01\": container with ID starting with cb858a158391ed5ce12c9a951c3f0903740968b81f50a3e6753a6e67119b7a01 not found: ID does not exist" containerID="cb858a158391ed5ce12c9a951c3f0903740968b81f50a3e6753a6e67119b7a01"
Oct 30 21:25:36.462319 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:25:36.462282    6004 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cb858a158391ed5ce12c9a951c3f0903740968b81f50a3e6753a6e67119b7a01"} err="failed to get container status \"cb858a158391ed5ce12c9a951c3f0903740968b81f50a3e6753a6e67119b7a01\": rpc error: code = NotFound desc = could not find container \"cb858a158391ed5ce12c9a951c3f0903740968b81f50a3e6753a6e67119b7a01\": container with ID starting with cb858a158391ed5ce12c9a951c3f0903740968b81f50a3e6753a6e67119b7a01 not found: ID does not exist"
Oct 30 21:25:36.618863 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:25:36.618829    6004 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w3-682999-5f9fdd855f-jgrfb"]
Oct 30 21:25:36.621238 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:25:36.621213    6004 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w3-682999-5f9fdd855f-jgrfb"]
Oct 30 21:25:38.232509 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:25:38.232473    6004 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="dd092751-81b5-4a63-a88d-392410a436dd" path="/var/lib/kubelet/pods/dd092751-81b5-4a63-a88d-392410a436dd/volumes"
Oct 30 21:25:42.120443 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:25:42.120410    6004 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w4-5c45e5-f8fc47765-x5c9d"]
Oct 30 21:25:42.120900 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:25:42.120604    6004 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w4-5c45e5-f8fc47765-x5c9d" podUID="5dcbdf4b-5aba-4987-b808-a45bf7117b4f" containerName="maas-api" containerID="cri-o://4a78fa01407e2441675f867bad740282c269f1be9ab9ea942d4b935124cbdee9" gracePeriod=30
Oct 30 21:25:42.400121 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:25:42.400096    6004 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w4-5c45e5-f8fc47765-x5c9d"
Oct 30 21:25:42.489257 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:25:42.489217    6004 generic.go:356] "Generic (PLEG): container finished" podID="5dcbdf4b-5aba-4987-b808-a45bf7117b4f" containerID="4a78fa01407e2441675f867bad740282c269f1be9ab9ea942d4b935124cbdee9" exitCode=0
Oct 30 21:25:42.489429 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:25:42.489265    6004 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w4-5c45e5-f8fc47765-x5c9d"
Oct 30 21:25:42.489429 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:25:42.489305    6004 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w4-5c45e5-f8fc47765-x5c9d" event={"ID":"5dcbdf4b-5aba-4987-b808-a45bf7117b4f","Type":"ContainerDied","Data":"4a78fa01407e2441675f867bad740282c269f1be9ab9ea942d4b935124cbdee9"}
Oct 30 21:25:42.489429 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:25:42.489394    6004 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w4-5c45e5-f8fc47765-x5c9d" event={"ID":"5dcbdf4b-5aba-4987-b808-a45bf7117b4f","Type":"ContainerDied","Data":"e9ccd95e2291726df4597e9a7f4aebad258c8fba06b931a69d6520a82e76d066"}
Oct 30 21:25:42.489429 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:25:42.489418    6004 scope.go:122] "RemoveContainer" containerID="4a78fa01407e2441675f867bad740282c269f1be9ab9ea942d4b935124cbdee9"
Oct 30 21:25:42.498713 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:25:42.498694    6004 scope.go:122] "RemoveContainer" containerID="4a78fa01407e2441675f867bad740282c269f1be9ab9ea942d4b935124cbdee9"
Oct 30 21:25:42.498993 ip-10-0-138-85 kubenswrapper[6004]: E1030 21:25:42.498975    6004 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4a78fa01407e2441675f867bad740282c269f1be9ab9ea942d4b935124cbdee9\": container with ID starting with 4a78fa01407e2441675f867bad740282c269f1be9ab9ea942d4b935124cbdee9 not found: ID does not exist" containerID="4a78fa01407e2441675f867bad740282c269f1be9ab9ea942d4b935124cbdee9"
Oct 30 21:25:42.499045 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:25:42.499002    6004 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4a78fa01407e2441675f867bad740282c269f1be9ab9ea942d4b935124cbdee9"} err="failed to get container status \"4a78fa01407e2441675f867bad740282c269f1be9ab9ea942d4b935124cbdee9\": rpc error: code = NotFound desc = could not find container \"4a78fa01407e2441675f867bad740282c269f1be9ab9ea942d4b935124cbdee9\": container with ID starting with 4a78fa01407e2441675f867bad740282c269f1be9ab9ea942d4b935124cbdee9 not found: ID does not exist"
Oct 30 21:25:42.515405 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:25:42.515373    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/5dcbdf4b-5aba-4987-b808-a45bf7117b4f-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5dcbdf4b-5aba-4987-b808-a45bf7117b4f-openshift-service-ca\") pod \"5dcbdf4b-5aba-4987-b808-a45bf7117b4f\" (UID: \"5dcbdf4b-5aba-4987-b808-a45bf7117b4f\") "
Oct 30 21:25:42.515405 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:25:42.515410    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/5dcbdf4b-5aba-4987-b808-a45bf7117b4f-kube-api-access-4jv8p\" (UniqueName: \"kubernetes.io/projected/5dcbdf4b-5aba-4987-b808-a45bf7117b4f-kube-api-access-4jv8p\") pod \"5dcbdf4b-5aba-4987-b808-a45bf7117b4f\" (UID: \"5dcbdf4b-5aba-4987-b808-a45bf7117b4f\") "
Oct 30 21:25:42.515629 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:25:42.515537    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/5dcbdf4b-5aba-4987-b808-a45bf7117b4f-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5dcbdf4b-5aba-4987-b808-a45bf7117b4f-maas-api-tls\") pod \"5dcbdf4b-5aba-4987-b808-a45bf7117b4f\" (UID: \"5dcbdf4b-5aba-4987-b808-a45bf7117b4f\") "
Oct 30 21:25:42.515629 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:25:42.515598    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/5dcbdf4b-5aba-4987-b808-a45bf7117b4f-metrics-certs\" (UniqueName: \"kubernetes.io/secret/5dcbdf4b-5aba-4987-b808-a45bf7117b4f-metrics-certs\") pod \"5dcbdf4b-5aba-4987-b808-a45bf7117b4f\" (UID: \"5dcbdf4b-5aba-4987-b808-a45bf7117b4f\") "
Oct 30 21:25:42.515773 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:25:42.515752    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5dcbdf4b-5aba-4987-b808-a45bf7117b4f-openshift-service-ca" pod "5dcbdf4b-5aba-4987-b808-a45bf7117b4f" (UID: "5dcbdf4b-5aba-4987-b808-a45bf7117b4f"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:25:42.516033 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:25:42.516009    6004 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5dcbdf4b-5aba-4987-b808-a45bf7117b4f-openshift-service-ca\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:25:42.517576 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:25:42.517550    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5dcbdf4b-5aba-4987-b808-a45bf7117b4f-metrics-certs" pod "5dcbdf4b-5aba-4987-b808-a45bf7117b4f" (UID: "5dcbdf4b-5aba-4987-b808-a45bf7117b4f"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:25:42.517664 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:25:42.517583    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5dcbdf4b-5aba-4987-b808-a45bf7117b4f-kube-api-access-4jv8p" pod "5dcbdf4b-5aba-4987-b808-a45bf7117b4f" (UID: "5dcbdf4b-5aba-4987-b808-a45bf7117b4f"). InnerVolumeSpecName "kube-api-access-4jv8p". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:25:42.517664 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:25:42.517635    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5dcbdf4b-5aba-4987-b808-a45bf7117b4f-maas-api-tls" pod "5dcbdf4b-5aba-4987-b808-a45bf7117b4f" (UID: "5dcbdf4b-5aba-4987-b808-a45bf7117b4f"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:25:42.617259 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:25:42.617223    6004 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4jv8p\" (UniqueName: \"kubernetes.io/projected/5dcbdf4b-5aba-4987-b808-a45bf7117b4f-kube-api-access-4jv8p\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:25:42.617259 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:25:42.617254    6004 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5dcbdf4b-5aba-4987-b808-a45bf7117b4f-maas-api-tls\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:25:42.617259 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:25:42.617264    6004 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5dcbdf4b-5aba-4987-b808-a45bf7117b4f-metrics-certs\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:25:42.912201 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:25:42.912166    6004 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w4-5c45e5-f8fc47765-x5c9d"]
Oct 30 21:25:42.915626 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:25:42.915600    6004 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w4-5c45e5-f8fc47765-x5c9d"]
Oct 30 21:25:44.230982 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:25:44.230947    6004 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="5dcbdf4b-5aba-4987-b808-a45bf7117b4f" path="/var/lib/kubelet/pods/5dcbdf4b-5aba-4987-b808-a45bf7117b4f/volumes"
Oct 30 21:25:44.286418 ip-10-0-138-85 kubenswrapper[6004]: E1030 21:25:44.286384    6004 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-zz4wr" containerName="extractor"
Oct 30 21:25:45.489801 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:25:45.489767    6004 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w3-682999-openshift-default-54dcb797b5-lpdjd"]
Oct 30 21:25:45.490258 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:25:45.490027    6004 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w3-682999-openshift-default-54dcb797b5-lpdjd" podUID="c155b964-e4f8-4a92-bcee-49cc435550b7" containerName="istio-proxy" containerID="cri-o://a6b2141433713ec7d1883eb66361ce24f62c42a712907c645b43ff884b194ba3" gracePeriod=30
Oct 30 21:25:50.760359 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:25:50.760294    6004 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-682999-openshift-default-54dcb797b5-lpdjd"
Oct 30 21:25:50.897788 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:25:50.897748    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/c155b964-e4f8-4a92-bcee-49cc435550b7-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c155b964-e4f8-4a92-bcee-49cc435550b7-workload-certs\") pod \"c155b964-e4f8-4a92-bcee-49cc435550b7\" (UID: \"c155b964-e4f8-4a92-bcee-49cc435550b7\") "
Oct 30 21:25:50.897980 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:25:50.897838    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/c155b964-e4f8-4a92-bcee-49cc435550b7-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c155b964-e4f8-4a92-bcee-49cc435550b7-credential-socket\") pod \"c155b964-e4f8-4a92-bcee-49cc435550b7\" (UID: \"c155b964-e4f8-4a92-bcee-49cc435550b7\") "
Oct 30 21:25:50.897980 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:25:50.897874    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/c155b964-e4f8-4a92-bcee-49cc435550b7-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c155b964-e4f8-4a92-bcee-49cc435550b7-istio-data\") pod \"c155b964-e4f8-4a92-bcee-49cc435550b7\" (UID: \"c155b964-e4f8-4a92-bcee-49cc435550b7\") "
Oct 30 21:25:50.897980 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:25:50.897901    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/c155b964-e4f8-4a92-bcee-49cc435550b7-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c155b964-e4f8-4a92-bcee-49cc435550b7-istio-podinfo\") pod \"c155b964-e4f8-4a92-bcee-49cc435550b7\" (UID: \"c155b964-e4f8-4a92-bcee-49cc435550b7\") "
Oct 30 21:25:50.897980 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:25:50.897950    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/c155b964-e4f8-4a92-bcee-49cc435550b7-kube-api-access-flzbw\" (UniqueName: \"kubernetes.io/projected/c155b964-e4f8-4a92-bcee-49cc435550b7-kube-api-access-flzbw\") pod \"c155b964-e4f8-4a92-bcee-49cc435550b7\" (UID: \"c155b964-e4f8-4a92-bcee-49cc435550b7\") "
Oct 30 21:25:50.898227 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:25:50.897984    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/c155b964-e4f8-4a92-bcee-49cc435550b7-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c155b964-e4f8-4a92-bcee-49cc435550b7-istiod-ca-cert\") pod \"c155b964-e4f8-4a92-bcee-49cc435550b7\" (UID: \"c155b964-e4f8-4a92-bcee-49cc435550b7\") "
Oct 30 21:25:50.898227 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:25:50.898020    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/c155b964-e4f8-4a92-bcee-49cc435550b7-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c155b964-e4f8-4a92-bcee-49cc435550b7-workload-socket\") pod \"c155b964-e4f8-4a92-bcee-49cc435550b7\" (UID: \"c155b964-e4f8-4a92-bcee-49cc435550b7\") "
Oct 30 21:25:50.898227 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:25:50.898038    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c155b964-e4f8-4a92-bcee-49cc435550b7-workload-certs" pod "c155b964-e4f8-4a92-bcee-49cc435550b7" (UID: "c155b964-e4f8-4a92-bcee-49cc435550b7"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:25:50.898227 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:25:50.898129    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c155b964-e4f8-4a92-bcee-49cc435550b7-istio-data" pod "c155b964-e4f8-4a92-bcee-49cc435550b7" (UID: "c155b964-e4f8-4a92-bcee-49cc435550b7"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:25:50.898227 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:25:50.898195    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/c155b964-e4f8-4a92-bcee-49cc435550b7-istio-token\" (UniqueName: \"kubernetes.io/projected/c155b964-e4f8-4a92-bcee-49cc435550b7-istio-token\") pod \"c155b964-e4f8-4a92-bcee-49cc435550b7\" (UID: \"c155b964-e4f8-4a92-bcee-49cc435550b7\") "
Oct 30 21:25:50.898512 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:25:50.898243    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/c155b964-e4f8-4a92-bcee-49cc435550b7-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c155b964-e4f8-4a92-bcee-49cc435550b7-istio-envoy\") pod \"c155b964-e4f8-4a92-bcee-49cc435550b7\" (UID: \"c155b964-e4f8-4a92-bcee-49cc435550b7\") "
Oct 30 21:25:50.898512 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:25:50.898345    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c155b964-e4f8-4a92-bcee-49cc435550b7-workload-socket" pod "c155b964-e4f8-4a92-bcee-49cc435550b7" (UID: "c155b964-e4f8-4a92-bcee-49cc435550b7"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:25:50.898512 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:25:50.898471    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c155b964-e4f8-4a92-bcee-49cc435550b7-istiod-ca-cert" pod "c155b964-e4f8-4a92-bcee-49cc435550b7" (UID: "c155b964-e4f8-4a92-bcee-49cc435550b7"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:25:50.898668 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:25:50.898524    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c155b964-e4f8-4a92-bcee-49cc435550b7-credential-socket" pod "c155b964-e4f8-4a92-bcee-49cc435550b7" (UID: "c155b964-e4f8-4a92-bcee-49cc435550b7"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:25:50.898730 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:25:50.898682    6004 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c155b964-e4f8-4a92-bcee-49cc435550b7-workload-certs\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:25:50.898730 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:25:50.898703    6004 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c155b964-e4f8-4a92-bcee-49cc435550b7-credential-socket\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:25:50.898730 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:25:50.898718    6004 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c155b964-e4f8-4a92-bcee-49cc435550b7-istio-data\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:25:50.898844 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:25:50.898732    6004 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c155b964-e4f8-4a92-bcee-49cc435550b7-istiod-ca-cert\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:25:50.898844 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:25:50.898746    6004 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c155b964-e4f8-4a92-bcee-49cc435550b7-workload-socket\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:25:50.900490 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:25:50.900463    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c155b964-e4f8-4a92-bcee-49cc435550b7-istio-token" pod "c155b964-e4f8-4a92-bcee-49cc435550b7" (UID: "c155b964-e4f8-4a92-bcee-49cc435550b7"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:25:50.900917 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:25:50.900889    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c155b964-e4f8-4a92-bcee-49cc435550b7-kube-api-access-flzbw" pod "c155b964-e4f8-4a92-bcee-49cc435550b7" (UID: "c155b964-e4f8-4a92-bcee-49cc435550b7"). InnerVolumeSpecName "kube-api-access-flzbw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:25:50.900991 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:25:50.900901    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c155b964-e4f8-4a92-bcee-49cc435550b7-istio-envoy" pod "c155b964-e4f8-4a92-bcee-49cc435550b7" (UID: "c155b964-e4f8-4a92-bcee-49cc435550b7"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:25:50.900991 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:25:50.900950    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/c155b964-e4f8-4a92-bcee-49cc435550b7-istio-podinfo" pod "c155b964-e4f8-4a92-bcee-49cc435550b7" (UID: "c155b964-e4f8-4a92-bcee-49cc435550b7"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 21:25:50.999400 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:25:50.999364    6004 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c155b964-e4f8-4a92-bcee-49cc435550b7-istio-envoy\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:25:50.999400 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:25:50.999394    6004 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c155b964-e4f8-4a92-bcee-49cc435550b7-istio-podinfo\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:25:50.999618 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:25:50.999408    6004 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-flzbw\" (UniqueName: \"kubernetes.io/projected/c155b964-e4f8-4a92-bcee-49cc435550b7-kube-api-access-flzbw\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:25:50.999618 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:25:50.999442    6004 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c155b964-e4f8-4a92-bcee-49cc435550b7-istio-token\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:25:51.540799 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:25:51.540763    6004 generic.go:356] "Generic (PLEG): container finished" podID="c155b964-e4f8-4a92-bcee-49cc435550b7" containerID="a6b2141433713ec7d1883eb66361ce24f62c42a712907c645b43ff884b194ba3" exitCode=0
Oct 30 21:25:51.541010 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:25:51.540827    6004 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-682999-openshift-default-54dcb797b5-lpdjd"
Oct 30 21:25:51.541010 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:25:51.540833    6004 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-682999-openshift-default-54dcb797b5-lpdjd" event={"ID":"c155b964-e4f8-4a92-bcee-49cc435550b7","Type":"ContainerDied","Data":"a6b2141433713ec7d1883eb66361ce24f62c42a712907c645b43ff884b194ba3"}
Oct 30 21:25:51.541010 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:25:51.540942    6004 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-682999-openshift-default-54dcb797b5-lpdjd" event={"ID":"c155b964-e4f8-4a92-bcee-49cc435550b7","Type":"ContainerDied","Data":"31170f153a322f7e804ac0454dde3371afc48ad26659ac9b31505a2e6e9520b1"}
Oct 30 21:25:51.541010 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:25:51.540965    6004 scope.go:122] "RemoveContainer" containerID="a6b2141433713ec7d1883eb66361ce24f62c42a712907c645b43ff884b194ba3"
Oct 30 21:25:51.550745 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:25:51.550725    6004 scope.go:122] "RemoveContainer" containerID="a6b2141433713ec7d1883eb66361ce24f62c42a712907c645b43ff884b194ba3"
Oct 30 21:25:51.551041 ip-10-0-138-85 kubenswrapper[6004]: E1030 21:25:51.551023    6004 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a6b2141433713ec7d1883eb66361ce24f62c42a712907c645b43ff884b194ba3\": container with ID starting with a6b2141433713ec7d1883eb66361ce24f62c42a712907c645b43ff884b194ba3 not found: ID does not exist" containerID="a6b2141433713ec7d1883eb66361ce24f62c42a712907c645b43ff884b194ba3"
Oct 30 21:25:51.551207 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:25:51.551074    6004 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a6b2141433713ec7d1883eb66361ce24f62c42a712907c645b43ff884b194ba3"} err="failed to get container status \"a6b2141433713ec7d1883eb66361ce24f62c42a712907c645b43ff884b194ba3\": rpc error: code = NotFound desc = could not find container \"a6b2141433713ec7d1883eb66361ce24f62c42a712907c645b43ff884b194ba3\": container with ID starting with a6b2141433713ec7d1883eb66361ce24f62c42a712907c645b43ff884b194ba3 not found: ID does not exist"
Oct 30 21:25:51.757098 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:25:51.757045    6004 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w3-682999-openshift-default-54dcb797b5-lpdjd"]
Oct 30 21:25:51.807532 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:25:51.807450    6004 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w3-682999-openshift-default-54dcb797b5-lpdjd"]
Oct 30 21:25:52.230925 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:25:52.230893    6004 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="c155b964-e4f8-4a92-bcee-49cc435550b7" path="/var/lib/kubelet/pods/c155b964-e4f8-4a92-bcee-49cc435550b7/volumes"
Oct 30 21:25:53.699288 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:25:53.699250    6004 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w6-8fa2a7-bcb7857c4-j462s"]
Oct 30 21:25:53.699760 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:25:53.699474    6004 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w6-8fa2a7-bcb7857c4-j462s" podUID="1e68c949-8e47-4bcd-afcd-780761bdc02a" containerName="maas-api" containerID="cri-o://3287f610fb0f82463a75a5cbb4618ff3f383294f185afb1550823b66cdffe6fa" gracePeriod=30
Oct 30 21:25:53.967125 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:25:53.967044    6004 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w6-8fa2a7-bcb7857c4-j462s"
Oct 30 21:25:54.129843 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:25:54.129808    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/1e68c949-8e47-4bcd-afcd-780761bdc02a-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1e68c949-8e47-4bcd-afcd-780761bdc02a-maas-api-tls\") pod \"1e68c949-8e47-4bcd-afcd-780761bdc02a\" (UID: \"1e68c949-8e47-4bcd-afcd-780761bdc02a\") "
Oct 30 21:25:54.129843 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:25:54.129846    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/1e68c949-8e47-4bcd-afcd-780761bdc02a-metrics-certs\" (UniqueName: \"kubernetes.io/secret/1e68c949-8e47-4bcd-afcd-780761bdc02a-metrics-certs\") pod \"1e68c949-8e47-4bcd-afcd-780761bdc02a\" (UID: \"1e68c949-8e47-4bcd-afcd-780761bdc02a\") "
Oct 30 21:25:54.130087 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:25:54.129886    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/1e68c949-8e47-4bcd-afcd-780761bdc02a-kube-api-access-xldqk\" (UniqueName: \"kubernetes.io/projected/1e68c949-8e47-4bcd-afcd-780761bdc02a-kube-api-access-xldqk\") pod \"1e68c949-8e47-4bcd-afcd-780761bdc02a\" (UID: \"1e68c949-8e47-4bcd-afcd-780761bdc02a\") "
Oct 30 21:25:54.130087 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:25:54.129922    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/1e68c949-8e47-4bcd-afcd-780761bdc02a-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1e68c949-8e47-4bcd-afcd-780761bdc02a-openshift-service-ca\") pod \"1e68c949-8e47-4bcd-afcd-780761bdc02a\" (UID: \"1e68c949-8e47-4bcd-afcd-780761bdc02a\") "
Oct 30 21:25:54.130373 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:25:54.130352    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1e68c949-8e47-4bcd-afcd-780761bdc02a-openshift-service-ca" pod "1e68c949-8e47-4bcd-afcd-780761bdc02a" (UID: "1e68c949-8e47-4bcd-afcd-780761bdc02a"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:25:54.132041 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:25:54.132018    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1e68c949-8e47-4bcd-afcd-780761bdc02a-kube-api-access-xldqk" pod "1e68c949-8e47-4bcd-afcd-780761bdc02a" (UID: "1e68c949-8e47-4bcd-afcd-780761bdc02a"). InnerVolumeSpecName "kube-api-access-xldqk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:25:54.132041 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:25:54.132033    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1e68c949-8e47-4bcd-afcd-780761bdc02a-maas-api-tls" pod "1e68c949-8e47-4bcd-afcd-780761bdc02a" (UID: "1e68c949-8e47-4bcd-afcd-780761bdc02a"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:25:54.132174 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:25:54.132118    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1e68c949-8e47-4bcd-afcd-780761bdc02a-metrics-certs" pod "1e68c949-8e47-4bcd-afcd-780761bdc02a" (UID: "1e68c949-8e47-4bcd-afcd-780761bdc02a"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:25:54.232540 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:25:54.232453    6004 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xldqk\" (UniqueName: \"kubernetes.io/projected/1e68c949-8e47-4bcd-afcd-780761bdc02a-kube-api-access-xldqk\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:25:54.232756 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:25:54.232739    6004 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1e68c949-8e47-4bcd-afcd-780761bdc02a-openshift-service-ca\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:25:54.232853 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:25:54.232839    6004 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1e68c949-8e47-4bcd-afcd-780761bdc02a-maas-api-tls\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:25:54.232932 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:25:54.232922    6004 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1e68c949-8e47-4bcd-afcd-780761bdc02a-metrics-certs\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:25:54.561465 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:25:54.561374    6004 generic.go:356] "Generic (PLEG): container finished" podID="1e68c949-8e47-4bcd-afcd-780761bdc02a" containerID="3287f610fb0f82463a75a5cbb4618ff3f383294f185afb1550823b66cdffe6fa" exitCode=0
Oct 30 21:25:54.561465 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:25:54.561448    6004 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w6-8fa2a7-bcb7857c4-j462s"
Oct 30 21:25:54.561645 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:25:54.561456    6004 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w6-8fa2a7-bcb7857c4-j462s" event={"ID":"1e68c949-8e47-4bcd-afcd-780761bdc02a","Type":"ContainerDied","Data":"3287f610fb0f82463a75a5cbb4618ff3f383294f185afb1550823b66cdffe6fa"}
Oct 30 21:25:54.561645 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:25:54.561519    6004 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w6-8fa2a7-bcb7857c4-j462s" event={"ID":"1e68c949-8e47-4bcd-afcd-780761bdc02a","Type":"ContainerDied","Data":"5f69600652ca5347a689e57dcb524696219bb2309261c34de84429fc2e06a611"}
Oct 30 21:25:54.561645 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:25:54.561541    6004 scope.go:122] "RemoveContainer" containerID="3287f610fb0f82463a75a5cbb4618ff3f383294f185afb1550823b66cdffe6fa"
Oct 30 21:25:54.570797 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:25:54.570773    6004 scope.go:122] "RemoveContainer" containerID="3287f610fb0f82463a75a5cbb4618ff3f383294f185afb1550823b66cdffe6fa"
Oct 30 21:25:54.571089 ip-10-0-138-85 kubenswrapper[6004]: E1030 21:25:54.571066    6004 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3287f610fb0f82463a75a5cbb4618ff3f383294f185afb1550823b66cdffe6fa\": container with ID starting with 3287f610fb0f82463a75a5cbb4618ff3f383294f185afb1550823b66cdffe6fa not found: ID does not exist" containerID="3287f610fb0f82463a75a5cbb4618ff3f383294f185afb1550823b66cdffe6fa"
Oct 30 21:25:54.571179 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:25:54.571102    6004 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3287f610fb0f82463a75a5cbb4618ff3f383294f185afb1550823b66cdffe6fa"} err="failed to get container status \"3287f610fb0f82463a75a5cbb4618ff3f383294f185afb1550823b66cdffe6fa\": rpc error: code = NotFound desc = could not find container \"3287f610fb0f82463a75a5cbb4618ff3f383294f185afb1550823b66cdffe6fa\": container with ID starting with 3287f610fb0f82463a75a5cbb4618ff3f383294f185afb1550823b66cdffe6fa not found: ID does not exist"
Oct 30 21:25:54.727180 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:25:54.727149    6004 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w6-8fa2a7-bcb7857c4-j462s"]
Oct 30 21:25:54.777462 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:25:54.777433    6004 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w6-8fa2a7-bcb7857c4-j462s"]
Oct 30 21:25:56.230742 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:25:56.230710    6004 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="1e68c949-8e47-4bcd-afcd-780761bdc02a" path="/var/lib/kubelet/pods/1e68c949-8e47-4bcd-afcd-780761bdc02a/volumes"
Oct 30 21:26:14.286403 ip-10-0-138-85 kubenswrapper[6004]: E1030 21:26:14.286359    6004 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-zz4wr" containerName="extractor"
Oct 30 21:26:23.757342 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:26:23.757298    6004 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w4-1fdaa7/distinct-2-w4-1fdaa7-kserve-59f4d6788b-b6gl4"]
Oct 30 21:26:38.777518 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:26:38.777473    6004 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-models-e2e-worker-w4-1fdaa7/distinct-2-w4-1fdaa7-kserve-59f4d6788b-b6gl4" podUID="f6d2856c-84b5-426d-bfcd-ef613ab44242" containerName="main" containerID="cri-o://9d0b8bd753049f6166c7e90dc378024c771f47fc971b347e5c53cafee01c55a4" gracePeriod=45
Oct 30 21:26:39.034395 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:26:39.034333    6004 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-1fdaa7/distinct-2-w4-1fdaa7-kserve-59f4d6788b-b6gl4"
Oct 30 21:26:39.157549 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:26:39.157506    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/f6d2856c-84b5-426d-bfcd-ef613ab44242-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f6d2856c-84b5-426d-bfcd-ef613ab44242-tmp-dir\") pod \"f6d2856c-84b5-426d-bfcd-ef613ab44242\" (UID: \"f6d2856c-84b5-426d-bfcd-ef613ab44242\") "
Oct 30 21:26:39.157737 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:26:39.157638    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/f6d2856c-84b5-426d-bfcd-ef613ab44242-home\" (UniqueName: \"kubernetes.io/empty-dir/f6d2856c-84b5-426d-bfcd-ef613ab44242-home\") pod \"f6d2856c-84b5-426d-bfcd-ef613ab44242\" (UID: \"f6d2856c-84b5-426d-bfcd-ef613ab44242\") "
Oct 30 21:26:39.157737 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:26:39.157676    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/f6d2856c-84b5-426d-bfcd-ef613ab44242-dshm\" (UniqueName: \"kubernetes.io/empty-dir/f6d2856c-84b5-426d-bfcd-ef613ab44242-dshm\") pod \"f6d2856c-84b5-426d-bfcd-ef613ab44242\" (UID: \"f6d2856c-84b5-426d-bfcd-ef613ab44242\") "
Oct 30 21:26:39.157737 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:26:39.157703    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/f6d2856c-84b5-426d-bfcd-ef613ab44242-kube-api-access-hb929\" (UniqueName: \"kubernetes.io/projected/f6d2856c-84b5-426d-bfcd-ef613ab44242-kube-api-access-hb929\") pod \"f6d2856c-84b5-426d-bfcd-ef613ab44242\" (UID: \"f6d2856c-84b5-426d-bfcd-ef613ab44242\") "
Oct 30 21:26:39.157737 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:26:39.157730    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/f6d2856c-84b5-426d-bfcd-ef613ab44242-tls-certs\" (UniqueName: \"kubernetes.io/secret/f6d2856c-84b5-426d-bfcd-ef613ab44242-tls-certs\") pod \"f6d2856c-84b5-426d-bfcd-ef613ab44242\" (UID: \"f6d2856c-84b5-426d-bfcd-ef613ab44242\") "
Oct 30 21:26:39.157949 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:26:39.157759    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/f6d2856c-84b5-426d-bfcd-ef613ab44242-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f6d2856c-84b5-426d-bfcd-ef613ab44242-model-cache\") pod \"f6d2856c-84b5-426d-bfcd-ef613ab44242\" (UID: \"f6d2856c-84b5-426d-bfcd-ef613ab44242\") "
Oct 30 21:26:39.157949 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:26:39.157816    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f6d2856c-84b5-426d-bfcd-ef613ab44242-tmp-dir" pod "f6d2856c-84b5-426d-bfcd-ef613ab44242" (UID: "f6d2856c-84b5-426d-bfcd-ef613ab44242"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:26:39.158077 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:26:39.157973    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f6d2856c-84b5-426d-bfcd-ef613ab44242-home" pod "f6d2856c-84b5-426d-bfcd-ef613ab44242" (UID: "f6d2856c-84b5-426d-bfcd-ef613ab44242"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:26:39.158156 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:26:39.158138    6004 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f6d2856c-84b5-426d-bfcd-ef613ab44242-tmp-dir\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:26:39.158244 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:26:39.158227    6004 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f6d2856c-84b5-426d-bfcd-ef613ab44242-home\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:26:39.158305 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:26:39.158230    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f6d2856c-84b5-426d-bfcd-ef613ab44242-model-cache" pod "f6d2856c-84b5-426d-bfcd-ef613ab44242" (UID: "f6d2856c-84b5-426d-bfcd-ef613ab44242"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:26:39.160919 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:26:39.160891    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f6d2856c-84b5-426d-bfcd-ef613ab44242-dshm" pod "f6d2856c-84b5-426d-bfcd-ef613ab44242" (UID: "f6d2856c-84b5-426d-bfcd-ef613ab44242"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:26:39.161153 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:26:39.161133    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f6d2856c-84b5-426d-bfcd-ef613ab44242-tls-certs" pod "f6d2856c-84b5-426d-bfcd-ef613ab44242" (UID: "f6d2856c-84b5-426d-bfcd-ef613ab44242"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:26:39.164214 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:26:39.164187    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f6d2856c-84b5-426d-bfcd-ef613ab44242-kube-api-access-hb929" pod "f6d2856c-84b5-426d-bfcd-ef613ab44242" (UID: "f6d2856c-84b5-426d-bfcd-ef613ab44242"). InnerVolumeSpecName "kube-api-access-hb929". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:26:39.259200 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:26:39.259165    6004 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f6d2856c-84b5-426d-bfcd-ef613ab44242-dshm\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:26:39.259200 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:26:39.259197    6004 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hb929\" (UniqueName: \"kubernetes.io/projected/f6d2856c-84b5-426d-bfcd-ef613ab44242-kube-api-access-hb929\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:26:39.259407 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:26:39.259210    6004 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f6d2856c-84b5-426d-bfcd-ef613ab44242-tls-certs\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:26:39.259407 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:26:39.259220    6004 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f6d2856c-84b5-426d-bfcd-ef613ab44242-model-cache\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:26:39.823451 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:26:39.823413    6004 generic.go:356] "Generic (PLEG): container finished" podID="f6d2856c-84b5-426d-bfcd-ef613ab44242" containerID="9d0b8bd753049f6166c7e90dc378024c771f47fc971b347e5c53cafee01c55a4" exitCode=0
Oct 30 21:26:39.823916 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:26:39.823458    6004 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-1fdaa7/distinct-2-w4-1fdaa7-kserve-59f4d6788b-b6gl4"
Oct 30 21:26:39.823916 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:26:39.823501    6004 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-1fdaa7/distinct-2-w4-1fdaa7-kserve-59f4d6788b-b6gl4" event={"ID":"f6d2856c-84b5-426d-bfcd-ef613ab44242","Type":"ContainerDied","Data":"9d0b8bd753049f6166c7e90dc378024c771f47fc971b347e5c53cafee01c55a4"}
Oct 30 21:26:39.823916 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:26:39.823543    6004 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-1fdaa7/distinct-2-w4-1fdaa7-kserve-59f4d6788b-b6gl4" event={"ID":"f6d2856c-84b5-426d-bfcd-ef613ab44242","Type":"ContainerDied","Data":"21d46dfdaabf30ef006d71cf49336e09675a19a96a75b9a071f123bcca64d502"}
Oct 30 21:26:39.823916 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:26:39.823559    6004 scope.go:122] "RemoveContainer" containerID="9d0b8bd753049f6166c7e90dc378024c771f47fc971b347e5c53cafee01c55a4"
Oct 30 21:26:39.833451 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:26:39.833432    6004 scope.go:122] "RemoveContainer" containerID="9d0b8bd753049f6166c7e90dc378024c771f47fc971b347e5c53cafee01c55a4"
Oct 30 21:26:39.833700 ip-10-0-138-85 kubenswrapper[6004]: E1030 21:26:39.833669    6004 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9d0b8bd753049f6166c7e90dc378024c771f47fc971b347e5c53cafee01c55a4\": container with ID starting with 9d0b8bd753049f6166c7e90dc378024c771f47fc971b347e5c53cafee01c55a4 not found: ID does not exist" containerID="9d0b8bd753049f6166c7e90dc378024c771f47fc971b347e5c53cafee01c55a4"
Oct 30 21:26:39.833796 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:26:39.833703    6004 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9d0b8bd753049f6166c7e90dc378024c771f47fc971b347e5c53cafee01c55a4"} err="failed to get container status \"9d0b8bd753049f6166c7e90dc378024c771f47fc971b347e5c53cafee01c55a4\": rpc error: code = NotFound desc = could not find container \"9d0b8bd753049f6166c7e90dc378024c771f47fc971b347e5c53cafee01c55a4\": container with ID starting with 9d0b8bd753049f6166c7e90dc378024c771f47fc971b347e5c53cafee01c55a4 not found: ID does not exist"
Oct 30 21:26:39.988758 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:26:39.988718    6004 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w4-1fdaa7/distinct-2-w4-1fdaa7-kserve-59f4d6788b-b6gl4"]
Oct 30 21:26:40.039035 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:26:40.039000    6004 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w4-1fdaa7/distinct-2-w4-1fdaa7-kserve-59f4d6788b-b6gl4"]
Oct 30 21:26:40.230289 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:26:40.230248    6004 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="f6d2856c-84b5-426d-bfcd-ef613ab44242" path="/var/lib/kubelet/pods/f6d2856c-84b5-426d-bfcd-ef613ab44242/volumes"
Oct 30 21:26:44.285085 ip-10-0-138-85 kubenswrapper[6004]: E1030 21:26:44.285026    6004 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-zz4wr" containerName="extractor"
Oct 30 21:27:01.650733 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:27:01.650692    6004 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w4-1fdaa7-openshift-default-84586db7d5-nk462"]
Oct 30 21:27:01.651437 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:27:01.650949    6004 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w4-1fdaa7-openshift-default-84586db7d5-nk462" podUID="86e216f8-8779-4e13-963f-c12b4af68042" containerName="istio-proxy" containerID="cri-o://b47ca309e2b25b5921f6a3c9a0ce695a7a351284ab3c57e08d5321ce2ca15955" gracePeriod=30
Oct 30 21:27:06.903068 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:27:06.903027    6004 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-1fdaa7-openshift-default-84586db7d5-nk462"
Oct 30 21:27:06.963280 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:27:06.963244    6004 generic.go:356] "Generic (PLEG): container finished" podID="86e216f8-8779-4e13-963f-c12b4af68042" containerID="b47ca309e2b25b5921f6a3c9a0ce695a7a351284ab3c57e08d5321ce2ca15955" exitCode=0
Oct 30 21:27:06.963480 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:27:06.963298    6004 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-1fdaa7-openshift-default-84586db7d5-nk462"
Oct 30 21:27:06.963480 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:27:06.963310    6004 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-1fdaa7-openshift-default-84586db7d5-nk462" event={"ID":"86e216f8-8779-4e13-963f-c12b4af68042","Type":"ContainerDied","Data":"b47ca309e2b25b5921f6a3c9a0ce695a7a351284ab3c57e08d5321ce2ca15955"}
Oct 30 21:27:06.963480 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:27:06.963366    6004 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-1fdaa7-openshift-default-84586db7d5-nk462" event={"ID":"86e216f8-8779-4e13-963f-c12b4af68042","Type":"ContainerDied","Data":"7e7eea6a83b122e2a1e252c139c083198423d3bc914b7c49c68745220bb6d8e7"}
Oct 30 21:27:06.963480 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:27:06.963397    6004 scope.go:122] "RemoveContainer" containerID="b47ca309e2b25b5921f6a3c9a0ce695a7a351284ab3c57e08d5321ce2ca15955"
Oct 30 21:27:06.972470 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:27:06.972452    6004 scope.go:122] "RemoveContainer" containerID="b47ca309e2b25b5921f6a3c9a0ce695a7a351284ab3c57e08d5321ce2ca15955"
Oct 30 21:27:06.972738 ip-10-0-138-85 kubenswrapper[6004]: E1030 21:27:06.972720    6004 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b47ca309e2b25b5921f6a3c9a0ce695a7a351284ab3c57e08d5321ce2ca15955\": container with ID starting with b47ca309e2b25b5921f6a3c9a0ce695a7a351284ab3c57e08d5321ce2ca15955 not found: ID does not exist" containerID="b47ca309e2b25b5921f6a3c9a0ce695a7a351284ab3c57e08d5321ce2ca15955"
Oct 30 21:27:06.972806 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:27:06.972747    6004 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b47ca309e2b25b5921f6a3c9a0ce695a7a351284ab3c57e08d5321ce2ca15955"} err="failed to get container status \"b47ca309e2b25b5921f6a3c9a0ce695a7a351284ab3c57e08d5321ce2ca15955\": rpc error: code = NotFound desc = could not find container \"b47ca309e2b25b5921f6a3c9a0ce695a7a351284ab3c57e08d5321ce2ca15955\": container with ID starting with b47ca309e2b25b5921f6a3c9a0ce695a7a351284ab3c57e08d5321ce2ca15955 not found: ID does not exist"
Oct 30 21:27:07.019584 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:27:07.019554    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/86e216f8-8779-4e13-963f-c12b4af68042-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/86e216f8-8779-4e13-963f-c12b4af68042-workload-socket\") pod \"86e216f8-8779-4e13-963f-c12b4af68042\" (UID: \"86e216f8-8779-4e13-963f-c12b4af68042\") "
Oct 30 21:27:07.019736 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:27:07.019594    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/86e216f8-8779-4e13-963f-c12b4af68042-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/86e216f8-8779-4e13-963f-c12b4af68042-istio-podinfo\") pod \"86e216f8-8779-4e13-963f-c12b4af68042\" (UID: \"86e216f8-8779-4e13-963f-c12b4af68042\") "
Oct 30 21:27:07.019736 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:27:07.019632    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/86e216f8-8779-4e13-963f-c12b4af68042-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/86e216f8-8779-4e13-963f-c12b4af68042-istio-data\") pod \"86e216f8-8779-4e13-963f-c12b4af68042\" (UID: \"86e216f8-8779-4e13-963f-c12b4af68042\") "
Oct 30 21:27:07.019736 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:27:07.019678    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/86e216f8-8779-4e13-963f-c12b4af68042-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/86e216f8-8779-4e13-963f-c12b4af68042-istiod-ca-cert\") pod \"86e216f8-8779-4e13-963f-c12b4af68042\" (UID: \"86e216f8-8779-4e13-963f-c12b4af68042\") "
Oct 30 21:27:07.019736 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:27:07.019718    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/86e216f8-8779-4e13-963f-c12b4af68042-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/86e216f8-8779-4e13-963f-c12b4af68042-credential-socket\") pod \"86e216f8-8779-4e13-963f-c12b4af68042\" (UID: \"86e216f8-8779-4e13-963f-c12b4af68042\") "
Oct 30 21:27:07.019971 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:27:07.019907    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/86e216f8-8779-4e13-963f-c12b4af68042-workload-socket" pod "86e216f8-8779-4e13-963f-c12b4af68042" (UID: "86e216f8-8779-4e13-963f-c12b4af68042"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:27:07.020026 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:27:07.020003    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/86e216f8-8779-4e13-963f-c12b4af68042-credential-socket" pod "86e216f8-8779-4e13-963f-c12b4af68042" (UID: "86e216f8-8779-4e13-963f-c12b4af68042"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:27:07.020098 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:27:07.019988    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/86e216f8-8779-4e13-963f-c12b4af68042-istio-data" pod "86e216f8-8779-4e13-963f-c12b4af68042" (UID: "86e216f8-8779-4e13-963f-c12b4af68042"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:27:07.020098 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:27:07.020045    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/86e216f8-8779-4e13-963f-c12b4af68042-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/86e216f8-8779-4e13-963f-c12b4af68042-istio-envoy\") pod \"86e216f8-8779-4e13-963f-c12b4af68042\" (UID: \"86e216f8-8779-4e13-963f-c12b4af68042\") "
Oct 30 21:27:07.020187 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:27:07.020147    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/86e216f8-8779-4e13-963f-c12b4af68042-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/86e216f8-8779-4e13-963f-c12b4af68042-workload-certs\") pod \"86e216f8-8779-4e13-963f-c12b4af68042\" (UID: \"86e216f8-8779-4e13-963f-c12b4af68042\") "
Oct 30 21:27:07.020187 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:27:07.020144    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/86e216f8-8779-4e13-963f-c12b4af68042-istiod-ca-cert" pod "86e216f8-8779-4e13-963f-c12b4af68042" (UID: "86e216f8-8779-4e13-963f-c12b4af68042"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:27:07.020187 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:27:07.020179    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/86e216f8-8779-4e13-963f-c12b4af68042-kube-api-access-v7kq8\" (UniqueName: \"kubernetes.io/projected/86e216f8-8779-4e13-963f-c12b4af68042-kube-api-access-v7kq8\") pod \"86e216f8-8779-4e13-963f-c12b4af68042\" (UID: \"86e216f8-8779-4e13-963f-c12b4af68042\") "
Oct 30 21:27:07.020331 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:27:07.020213    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/86e216f8-8779-4e13-963f-c12b4af68042-istio-token\" (UniqueName: \"kubernetes.io/projected/86e216f8-8779-4e13-963f-c12b4af68042-istio-token\") pod \"86e216f8-8779-4e13-963f-c12b4af68042\" (UID: \"86e216f8-8779-4e13-963f-c12b4af68042\") "
Oct 30 21:27:07.020453 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:27:07.020434    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/86e216f8-8779-4e13-963f-c12b4af68042-workload-certs" pod "86e216f8-8779-4e13-963f-c12b4af68042" (UID: "86e216f8-8779-4e13-963f-c12b4af68042"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:27:07.020582 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:27:07.020562    6004 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/86e216f8-8779-4e13-963f-c12b4af68042-workload-socket\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:27:07.020651 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:27:07.020587    6004 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/86e216f8-8779-4e13-963f-c12b4af68042-istio-data\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:27:07.020651 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:27:07.020601    6004 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/86e216f8-8779-4e13-963f-c12b4af68042-istiod-ca-cert\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:27:07.020651 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:27:07.020616    6004 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/86e216f8-8779-4e13-963f-c12b4af68042-credential-socket\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:27:07.020651 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:27:07.020631    6004 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/86e216f8-8779-4e13-963f-c12b4af68042-workload-certs\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:27:07.022284 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:27:07.022246    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/86e216f8-8779-4e13-963f-c12b4af68042-istio-podinfo" pod "86e216f8-8779-4e13-963f-c12b4af68042" (UID: "86e216f8-8779-4e13-963f-c12b4af68042"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 21:27:07.022710 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:27:07.022682    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/86e216f8-8779-4e13-963f-c12b4af68042-istio-envoy" pod "86e216f8-8779-4e13-963f-c12b4af68042" (UID: "86e216f8-8779-4e13-963f-c12b4af68042"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:27:07.023029 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:27:07.022747    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/86e216f8-8779-4e13-963f-c12b4af68042-kube-api-access-v7kq8" pod "86e216f8-8779-4e13-963f-c12b4af68042" (UID: "86e216f8-8779-4e13-963f-c12b4af68042"). InnerVolumeSpecName "kube-api-access-v7kq8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:27:07.023029 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:27:07.022807    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/86e216f8-8779-4e13-963f-c12b4af68042-istio-token" pod "86e216f8-8779-4e13-963f-c12b4af68042" (UID: "86e216f8-8779-4e13-963f-c12b4af68042"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:27:07.121696 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:27:07.121657    6004 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/86e216f8-8779-4e13-963f-c12b4af68042-istio-podinfo\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:27:07.121696 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:27:07.121694    6004 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/86e216f8-8779-4e13-963f-c12b4af68042-istio-envoy\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:27:07.121936 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:27:07.121704    6004 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v7kq8\" (UniqueName: \"kubernetes.io/projected/86e216f8-8779-4e13-963f-c12b4af68042-kube-api-access-v7kq8\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:27:07.121936 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:27:07.121714    6004 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/86e216f8-8779-4e13-963f-c12b4af68042-istio-token\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:27:07.387392 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:27:07.387359    6004 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w4-1fdaa7-openshift-default-84586db7d5-nk462"]
Oct 30 21:27:07.391270 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:27:07.391244    6004 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w4-1fdaa7-openshift-default-84586db7d5-nk462"]
Oct 30 21:27:08.229748 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:27:08.229707    6004 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="86e216f8-8779-4e13-963f-c12b4af68042" path="/var/lib/kubelet/pods/86e216f8-8779-4e13-963f-c12b4af68042/volumes"
Oct 30 21:27:14.286086 ip-10-0-138-85 kubenswrapper[6004]: E1030 21:27:14.286030    6004 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-zz4wr" containerName="extractor"
Oct 30 21:27:25.016435 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:27:25.016399    6004 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-769df7846c-t9zxd"]
Oct 30 21:27:25.016834 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:27:25.016780    6004 cpu_manager.go:414] "containerMap: removing container" podUID="dd092751-81b5-4a63-a88d-392410a436dd" containerName="maas-api"
Oct 30 21:27:25.016834 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:27:25.016790    6004 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="dd092751-81b5-4a63-a88d-392410a436dd" containerName="maas-api"
Oct 30 21:27:25.016834 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:27:25.016804    6004 cpu_manager.go:414] "containerMap: removing container" podUID="66ce9d30-2df0-4423-a462-1f621f32bb64" containerName="test-curl-7269-a7ddfb"
Oct 30 21:27:25.016834 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:27:25.016810    6004 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="66ce9d30-2df0-4423-a462-1f621f32bb64" containerName="test-curl-7269-a7ddfb"
Oct 30 21:27:25.016834 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:27:25.016820    6004 cpu_manager.go:414] "containerMap: removing container" podUID="f6d2856c-84b5-426d-bfcd-ef613ab44242" containerName="main"
Oct 30 21:27:25.016834 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:27:25.016826    6004 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="f6d2856c-84b5-426d-bfcd-ef613ab44242" containerName="main"
Oct 30 21:27:25.017026 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:27:25.016840    6004 cpu_manager.go:414] "containerMap: removing container" podUID="10b2809a-8076-443d-9d48-2e0da4f59401" containerName="payload-pre-processing"
Oct 30 21:27:25.017026 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:27:25.016845    6004 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="10b2809a-8076-443d-9d48-2e0da4f59401" containerName="payload-pre-processing"
Oct 30 21:27:25.017026 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:27:25.016851    6004 cpu_manager.go:414] "containerMap: removing container" podUID="1e68c949-8e47-4bcd-afcd-780761bdc02a" containerName="maas-api"
Oct 30 21:27:25.017026 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:27:25.016856    6004 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="1e68c949-8e47-4bcd-afcd-780761bdc02a" containerName="maas-api"
Oct 30 21:27:25.017026 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:27:25.016863    6004 cpu_manager.go:414] "containerMap: removing container" podUID="86e216f8-8779-4e13-963f-c12b4af68042" containerName="istio-proxy"
Oct 30 21:27:25.017026 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:27:25.016868    6004 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="86e216f8-8779-4e13-963f-c12b4af68042" containerName="istio-proxy"
Oct 30 21:27:25.017026 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:27:25.016875    6004 cpu_manager.go:414] "containerMap: removing container" podUID="645f9519-1d21-4dd3-a807-86c9e7ecdab3" containerName="istio-proxy"
Oct 30 21:27:25.017026 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:27:25.016880    6004 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="645f9519-1d21-4dd3-a807-86c9e7ecdab3" containerName="istio-proxy"
Oct 30 21:27:25.017026 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:27:25.016890    6004 cpu_manager.go:414] "containerMap: removing container" podUID="098b86da-6c61-47d5-be96-ecda30ffeb60" containerName="maas-api"
Oct 30 21:27:25.017026 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:27:25.016894    6004 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="098b86da-6c61-47d5-be96-ecda30ffeb60" containerName="maas-api"
Oct 30 21:27:25.017026 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:27:25.016904    6004 cpu_manager.go:414] "containerMap: removing container" podUID="766d43f7-3939-49dc-9829-db0918b2a138" containerName="maas-api"
Oct 30 21:27:25.017026 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:27:25.016908    6004 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="766d43f7-3939-49dc-9829-db0918b2a138" containerName="maas-api"
Oct 30 21:27:25.017026 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:27:25.016921    6004 cpu_manager.go:414] "containerMap: removing container" podUID="a411974f-4789-4fd8-889a-590949a89a22" containerName="istio-proxy"
Oct 30 21:27:25.017026 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:27:25.016926    6004 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="a411974f-4789-4fd8-889a-590949a89a22" containerName="istio-proxy"
Oct 30 21:27:25.017026 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:27:25.016932    6004 cpu_manager.go:414] "containerMap: removing container" podUID="c155b964-e4f8-4a92-bcee-49cc435550b7" containerName="istio-proxy"
Oct 30 21:27:25.017026 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:27:25.016937    6004 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="c155b964-e4f8-4a92-bcee-49cc435550b7" containerName="istio-proxy"
Oct 30 21:27:25.017026 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:27:25.016942    6004 cpu_manager.go:414] "containerMap: removing container" podUID="44ec9e0c-2e06-45a6-a8bb-871640460980" containerName="istio-proxy"
Oct 30 21:27:25.017026 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:27:25.016947    6004 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="44ec9e0c-2e06-45a6-a8bb-871640460980" containerName="istio-proxy"
Oct 30 21:27:25.017026 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:27:25.016953    6004 cpu_manager.go:414] "containerMap: removing container" podUID="bb7251a5-aa97-4ee2-a00d-27083704dc60" containerName="istio-proxy"
Oct 30 21:27:25.017026 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:27:25.016958    6004 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="bb7251a5-aa97-4ee2-a00d-27083704dc60" containerName="istio-proxy"
Oct 30 21:27:25.017026 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:27:25.016964    6004 cpu_manager.go:414] "containerMap: removing container" podUID="020551c8-c3b9-4aec-bf4e-214c816f9c7f" containerName="payload-processing"
Oct 30 21:27:25.017026 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:27:25.016968    6004 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="020551c8-c3b9-4aec-bf4e-214c816f9c7f" containerName="payload-processing"
Oct 30 21:27:25.017026 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:27:25.016978    6004 cpu_manager.go:414] "containerMap: removing container" podUID="5dcbdf4b-5aba-4987-b808-a45bf7117b4f" containerName="maas-api"
Oct 30 21:27:25.017026 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:27:25.016983    6004 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="5dcbdf4b-5aba-4987-b808-a45bf7117b4f" containerName="maas-api"
Oct 30 21:27:25.017818 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:27:25.017039    6004 memory_manager.go:365] "RemoveStaleState removing state" podUID="a411974f-4789-4fd8-889a-590949a89a22" containerName="istio-proxy"
Oct 30 21:27:25.017818 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:27:25.017061    6004 memory_manager.go:365] "RemoveStaleState removing state" podUID="c155b964-e4f8-4a92-bcee-49cc435550b7" containerName="istio-proxy"
Oct 30 21:27:25.017818 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:27:25.017068    6004 memory_manager.go:365] "RemoveStaleState removing state" podUID="44ec9e0c-2e06-45a6-a8bb-871640460980" containerName="istio-proxy"
Oct 30 21:27:25.017818 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:27:25.017074    6004 memory_manager.go:365] "RemoveStaleState removing state" podUID="bb7251a5-aa97-4ee2-a00d-27083704dc60" containerName="istio-proxy"
Oct 30 21:27:25.017818 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:27:25.017078    6004 memory_manager.go:365] "RemoveStaleState removing state" podUID="020551c8-c3b9-4aec-bf4e-214c816f9c7f" containerName="payload-processing"
Oct 30 21:27:25.017818 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:27:25.017084    6004 memory_manager.go:365] "RemoveStaleState removing state" podUID="5dcbdf4b-5aba-4987-b808-a45bf7117b4f" containerName="maas-api"
Oct 30 21:27:25.017818 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:27:25.017090    6004 memory_manager.go:365] "RemoveStaleState removing state" podUID="dd092751-81b5-4a63-a88d-392410a436dd" containerName="maas-api"
Oct 30 21:27:25.017818 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:27:25.017096    6004 memory_manager.go:365] "RemoveStaleState removing state" podUID="66ce9d30-2df0-4423-a462-1f621f32bb64" containerName="test-curl-7269-a7ddfb"
Oct 30 21:27:25.017818 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:27:25.017101    6004 memory_manager.go:365] "RemoveStaleState removing state" podUID="f6d2856c-84b5-426d-bfcd-ef613ab44242" containerName="main"
Oct 30 21:27:25.017818 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:27:25.017108    6004 memory_manager.go:365] "RemoveStaleState removing state" podUID="10b2809a-8076-443d-9d48-2e0da4f59401" containerName="payload-pre-processing"
Oct 30 21:27:25.017818 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:27:25.017112    6004 memory_manager.go:365] "RemoveStaleState removing state" podUID="1e68c949-8e47-4bcd-afcd-780761bdc02a" containerName="maas-api"
Oct 30 21:27:25.017818 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:27:25.017117    6004 memory_manager.go:365] "RemoveStaleState removing state" podUID="86e216f8-8779-4e13-963f-c12b4af68042" containerName="istio-proxy"
Oct 30 21:27:25.017818 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:27:25.017120    6004 memory_manager.go:365] "RemoveStaleState removing state" podUID="645f9519-1d21-4dd3-a807-86c9e7ecdab3" containerName="istio-proxy"
Oct 30 21:27:25.017818 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:27:25.017127    6004 memory_manager.go:365] "RemoveStaleState removing state" podUID="098b86da-6c61-47d5-be96-ecda30ffeb60" containerName="maas-api"
Oct 30 21:27:25.017818 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:27:25.017132    6004 memory_manager.go:365] "RemoveStaleState removing state" podUID="766d43f7-3939-49dc-9829-db0918b2a138" containerName="maas-api"
Oct 30 21:27:25.021576 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:27:25.021559    6004 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-t9zxd"
Oct 30 21:27:25.193870 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:27:25.193831    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/63f0a1f2-255c-4159-8d3f-6c79a470a2c7-workload-socket\") pod \"maas-default-gateway-openshift-default-769df7846c-t9zxd\" (UID: \"63f0a1f2-255c-4159-8d3f-6c79a470a2c7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-t9zxd"
Oct 30 21:27:25.193870 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:27:25.193869    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/63f0a1f2-255c-4159-8d3f-6c79a470a2c7-istio-data\") pod \"maas-default-gateway-openshift-default-769df7846c-t9zxd\" (UID: \"63f0a1f2-255c-4159-8d3f-6c79a470a2c7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-t9zxd"
Oct 30 21:27:25.194107 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:27:25.193895    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/63f0a1f2-255c-4159-8d3f-6c79a470a2c7-istio-envoy\") pod \"maas-default-gateway-openshift-default-769df7846c-t9zxd\" (UID: \"63f0a1f2-255c-4159-8d3f-6c79a470a2c7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-t9zxd"
Oct 30 21:27:25.194107 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:27:25.194004    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/63f0a1f2-255c-4159-8d3f-6c79a470a2c7-istio-podinfo\") pod \"maas-default-gateway-openshift-default-769df7846c-t9zxd\" (UID: \"63f0a1f2-255c-4159-8d3f-6c79a470a2c7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-t9zxd"
Oct 30 21:27:25.194107 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:27:25.194035    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/63f0a1f2-255c-4159-8d3f-6c79a470a2c7-credential-socket\") pod \"maas-default-gateway-openshift-default-769df7846c-t9zxd\" (UID: \"63f0a1f2-255c-4159-8d3f-6c79a470a2c7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-t9zxd"
Oct 30 21:27:25.194107 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:27:25.194095    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/63f0a1f2-255c-4159-8d3f-6c79a470a2c7-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-769df7846c-t9zxd\" (UID: \"63f0a1f2-255c-4159-8d3f-6c79a470a2c7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-t9zxd"
Oct 30 21:27:25.194261 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:27:25.194123    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/63f0a1f2-255c-4159-8d3f-6c79a470a2c7-istio-token\") pod \"maas-default-gateway-openshift-default-769df7846c-t9zxd\" (UID: \"63f0a1f2-255c-4159-8d3f-6c79a470a2c7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-t9zxd"
Oct 30 21:27:25.194261 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:27:25.194227    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kvz2k\" (UniqueName: \"kubernetes.io/projected/63f0a1f2-255c-4159-8d3f-6c79a470a2c7-kube-api-access-kvz2k\") pod \"maas-default-gateway-openshift-default-769df7846c-t9zxd\" (UID: \"63f0a1f2-255c-4159-8d3f-6c79a470a2c7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-t9zxd"
Oct 30 21:27:25.194261 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:27:25.194258    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/63f0a1f2-255c-4159-8d3f-6c79a470a2c7-workload-certs\") pod \"maas-default-gateway-openshift-default-769df7846c-t9zxd\" (UID: \"63f0a1f2-255c-4159-8d3f-6c79a470a2c7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-t9zxd"
Oct 30 21:27:25.224241 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:27:25.224207    6004 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-769df7846c-t9zxd"]
Oct 30 21:27:25.295531 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:27:25.295431    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kvz2k\" (UniqueName: \"kubernetes.io/projected/63f0a1f2-255c-4159-8d3f-6c79a470a2c7-kube-api-access-kvz2k\") pod \"maas-default-gateway-openshift-default-769df7846c-t9zxd\" (UID: \"63f0a1f2-255c-4159-8d3f-6c79a470a2c7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-t9zxd"
Oct 30 21:27:25.295531 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:27:25.295479    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/63f0a1f2-255c-4159-8d3f-6c79a470a2c7-workload-certs\") pod \"maas-default-gateway-openshift-default-769df7846c-t9zxd\" (UID: \"63f0a1f2-255c-4159-8d3f-6c79a470a2c7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-t9zxd"
Oct 30 21:27:25.295786 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:27:25.295619    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/63f0a1f2-255c-4159-8d3f-6c79a470a2c7-workload-socket\") pod \"maas-default-gateway-openshift-default-769df7846c-t9zxd\" (UID: \"63f0a1f2-255c-4159-8d3f-6c79a470a2c7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-t9zxd"
Oct 30 21:27:25.295786 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:27:25.295654    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/63f0a1f2-255c-4159-8d3f-6c79a470a2c7-istio-data\") pod \"maas-default-gateway-openshift-default-769df7846c-t9zxd\" (UID: \"63f0a1f2-255c-4159-8d3f-6c79a470a2c7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-t9zxd"
Oct 30 21:27:25.295786 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:27:25.295676    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/63f0a1f2-255c-4159-8d3f-6c79a470a2c7-istio-envoy\") pod \"maas-default-gateway-openshift-default-769df7846c-t9zxd\" (UID: \"63f0a1f2-255c-4159-8d3f-6c79a470a2c7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-t9zxd"
Oct 30 21:27:25.295786 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:27:25.295702    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/63f0a1f2-255c-4159-8d3f-6c79a470a2c7-istio-podinfo\") pod \"maas-default-gateway-openshift-default-769df7846c-t9zxd\" (UID: \"63f0a1f2-255c-4159-8d3f-6c79a470a2c7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-t9zxd"
Oct 30 21:27:25.295786 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:27:25.295723    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/63f0a1f2-255c-4159-8d3f-6c79a470a2c7-credential-socket\") pod \"maas-default-gateway-openshift-default-769df7846c-t9zxd\" (UID: \"63f0a1f2-255c-4159-8d3f-6c79a470a2c7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-t9zxd"
Oct 30 21:27:25.295786 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:27:25.295767    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/63f0a1f2-255c-4159-8d3f-6c79a470a2c7-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-769df7846c-t9zxd\" (UID: \"63f0a1f2-255c-4159-8d3f-6c79a470a2c7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-t9zxd"
Oct 30 21:27:25.296153 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:27:25.295812    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/63f0a1f2-255c-4159-8d3f-6c79a470a2c7-istio-token\") pod \"maas-default-gateway-openshift-default-769df7846c-t9zxd\" (UID: \"63f0a1f2-255c-4159-8d3f-6c79a470a2c7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-t9zxd"
Oct 30 21:27:25.296153 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:27:25.295894    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/63f0a1f2-255c-4159-8d3f-6c79a470a2c7-workload-certs\") pod \"maas-default-gateway-openshift-default-769df7846c-t9zxd\" (UID: \"63f0a1f2-255c-4159-8d3f-6c79a470a2c7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-t9zxd"
Oct 30 21:27:25.296153 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:27:25.295988    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/63f0a1f2-255c-4159-8d3f-6c79a470a2c7-workload-socket\") pod \"maas-default-gateway-openshift-default-769df7846c-t9zxd\" (UID: \"63f0a1f2-255c-4159-8d3f-6c79a470a2c7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-t9zxd"
Oct 30 21:27:25.296153 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:27:25.296043    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/63f0a1f2-255c-4159-8d3f-6c79a470a2c7-istio-data\") pod \"maas-default-gateway-openshift-default-769df7846c-t9zxd\" (UID: \"63f0a1f2-255c-4159-8d3f-6c79a470a2c7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-t9zxd"
Oct 30 21:27:25.296372 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:27:25.296281    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/63f0a1f2-255c-4159-8d3f-6c79a470a2c7-credential-socket\") pod \"maas-default-gateway-openshift-default-769df7846c-t9zxd\" (UID: \"63f0a1f2-255c-4159-8d3f-6c79a470a2c7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-t9zxd"
Oct 30 21:27:25.296587 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:27:25.296565    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/63f0a1f2-255c-4159-8d3f-6c79a470a2c7-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-769df7846c-t9zxd\" (UID: \"63f0a1f2-255c-4159-8d3f-6c79a470a2c7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-t9zxd"
Oct 30 21:27:25.298167 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:27:25.298135    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/63f0a1f2-255c-4159-8d3f-6c79a470a2c7-istio-envoy\") pod \"maas-default-gateway-openshift-default-769df7846c-t9zxd\" (UID: \"63f0a1f2-255c-4159-8d3f-6c79a470a2c7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-t9zxd"
Oct 30 21:27:25.298292 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:27:25.298248    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/63f0a1f2-255c-4159-8d3f-6c79a470a2c7-istio-podinfo\") pod \"maas-default-gateway-openshift-default-769df7846c-t9zxd\" (UID: \"63f0a1f2-255c-4159-8d3f-6c79a470a2c7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-t9zxd"
Oct 30 21:27:25.353166 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:27:25.353136    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/63f0a1f2-255c-4159-8d3f-6c79a470a2c7-istio-token\") pod \"maas-default-gateway-openshift-default-769df7846c-t9zxd\" (UID: \"63f0a1f2-255c-4159-8d3f-6c79a470a2c7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-t9zxd"
Oct 30 21:27:25.353320 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:27:25.353197    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kvz2k\" (UniqueName: \"kubernetes.io/projected/63f0a1f2-255c-4159-8d3f-6c79a470a2c7-kube-api-access-kvz2k\") pod \"maas-default-gateway-openshift-default-769df7846c-t9zxd\" (UID: \"63f0a1f2-255c-4159-8d3f-6c79a470a2c7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-t9zxd"
Oct 30 21:27:25.633692 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:27:25.633591    6004 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-t9zxd"
Oct 30 21:27:26.056330 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:27:26.056305    6004 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-769df7846c-t9zxd"]
Oct 30 21:27:26.057738 ip-10-0-138-85 kubenswrapper[6004]: W1030 21:27:26.057711    6004 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod63f0a1f2_255c_4159_8d3f_6c79a470a2c7.slice/crio-f8c591dae3cc2726dc64deca31239544649c053b74db266785cb4edffd706862 WatchSource:0}: Error finding container f8c591dae3cc2726dc64deca31239544649c053b74db266785cb4edffd706862: Status 404 returned error can't find the container with id f8c591dae3cc2726dc64deca31239544649c053b74db266785cb4edffd706862
Oct 30 21:27:26.059951 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:27:26.059916    6004 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 21:27:26.060086 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:27:26.060000    6004 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 21:27:26.060086 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:27:26.060061    6004 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 21:27:27.069419 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:27:27.069371    6004 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-t9zxd" event={"ID":"63f0a1f2-255c-4159-8d3f-6c79a470a2c7","Type":"ContainerStarted","Data":"2789ebe483f6ae822e61f77db7f1bd21bbd35f7786dd50d13b877fd59a1a2378"}
Oct 30 21:27:27.069916 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:27:27.069438    6004 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-t9zxd" event={"ID":"63f0a1f2-255c-4159-8d3f-6c79a470a2c7","Type":"ContainerStarted","Data":"f8c591dae3cc2726dc64deca31239544649c053b74db266785cb4edffd706862"}
Oct 30 21:27:27.285778 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:27:27.285723    6004 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-t9zxd" podStartSLOduration=3.285707881 podStartE2EDuration="3.285707881s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:27:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:27:27.234399277 +0000 UTC m=+2953.154185395" watchObservedRunningTime="2026-10-30 21:27:27.285707881 +0000 UTC m=+2953.205494005"
Oct 30 21:27:27.648086 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:27:27.647598    6004 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-t9zxd"
Oct 30 21:27:27.660234 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:27:27.660197    6004 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-769df7846c-t9zxd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.122:15021/healthz/ready\": dial tcp 10.132.0.122:15021: connect: connection refused" start-of-body=
Oct 30 21:27:27.660395 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:27:27.660251    6004 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-t9zxd" podUID="63f0a1f2-255c-4159-8d3f-6c79a470a2c7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.122:15021/healthz/ready\": dial tcp 10.132.0.122:15021: connect: connection refused"
Oct 30 21:27:28.650073 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:27:28.639154    6004 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-769df7846c-t9zxd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.122:15021/healthz/ready\": dial tcp 10.132.0.122:15021: connect: connection refused" start-of-body=
Oct 30 21:27:28.650073 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:27:28.639220    6004 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-t9zxd" podUID="63f0a1f2-255c-4159-8d3f-6c79a470a2c7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.122:15021/healthz/ready\": dial tcp 10.132.0.122:15021: connect: connection refused"
Oct 30 21:27:29.656073 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:27:29.645113    6004 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-769df7846c-t9zxd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.122:15021/healthz/ready\": dial tcp 10.132.0.122:15021: connect: connection refused" start-of-body=
Oct 30 21:27:29.656073 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:27:29.645184    6004 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-t9zxd" podUID="63f0a1f2-255c-4159-8d3f-6c79a470a2c7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.122:15021/healthz/ready\": dial tcp 10.132.0.122:15021: connect: connection refused"
Oct 30 21:27:30.655075 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:27:30.651206    6004 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-769df7846c-t9zxd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.122:15021/healthz/ready\": dial tcp 10.132.0.122:15021: connect: connection refused" start-of-body=
Oct 30 21:27:30.655075 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:27:30.651346    6004 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-t9zxd" podUID="63f0a1f2-255c-4159-8d3f-6c79a470a2c7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.122:15021/healthz/ready\": dial tcp 10.132.0.122:15021: connect: connection refused"
Oct 30 21:27:31.634368 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:27:31.634330    6004 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-769df7846c-t9zxd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.122:15021/healthz/ready\": dial tcp 10.132.0.122:15021: connect: connection refused" start-of-body=
Oct 30 21:27:31.634980 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:27:31.634947    6004 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-t9zxd" podUID="63f0a1f2-255c-4159-8d3f-6c79a470a2c7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.122:15021/healthz/ready\": dial tcp 10.132.0.122:15021: connect: connection refused"
Oct 30 21:27:32.634618 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:27:32.634577    6004 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-769df7846c-t9zxd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.122:15021/healthz/ready\": dial tcp 10.132.0.122:15021: connect: connection refused" start-of-body=
Oct 30 21:27:32.635122 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:27:32.634661    6004 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-t9zxd" podUID="63f0a1f2-255c-4159-8d3f-6c79a470a2c7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.122:15021/healthz/ready\": dial tcp 10.132.0.122:15021: connect: connection refused"
Oct 30 21:27:34.635501 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:27:34.635450    6004 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-769df7846c-t9zxd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.122:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 30 21:27:34.636024 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:27:34.635526    6004 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-t9zxd" podUID="63f0a1f2-255c-4159-8d3f-6c79a470a2c7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.122:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:27:35.677256 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:27:35.677213    6004 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-769df7846c-t9zxd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.122:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 30 21:27:35.677719 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:27:35.677290    6004 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-t9zxd" podUID="63f0a1f2-255c-4159-8d3f-6c79a470a2c7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.122:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:27:36.330927 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:27:36.330863    6004 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-t9zxd"
Oct 30 21:27:36.331282 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:27:36.331250    6004 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-t9zxd"
Oct 30 21:27:36.332005 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:27:36.331979    6004 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-t9zxd"
Oct 30 21:27:44.285583 ip-10-0-138-85 kubenswrapper[6004]: E1030 21:27:44.285545    6004 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-zz4wr" containerName="extractor"
Oct 30 21:28:14.285492 ip-10-0-138-85 kubenswrapper[6004]: E1030 21:28:14.285451    6004 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-zz4wr" containerName="extractor"
Oct 30 21:28:14.726931 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:28:14.726904    6004 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-sb7ds_90cd3de0-c573-41c2-bf3e-cf0e46a41d50/console-operator/2.log"
Oct 30 21:28:14.731686 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:28:14.731661    6004 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-sb7ds_90cd3de0-c573-41c2-bf3e-cf0e46a41d50/console-operator/2.log"
Oct 30 21:28:40.592186 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:28:40.592143    6004 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-769df7846c-vnwz7"]
Oct 30 21:28:40.595801 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:28:40.595779    6004 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-vnwz7"
Oct 30 21:28:40.689790 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:28:40.689753    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/484fe8d9-f020-44dc-a06c-5e294b8370ae-credential-socket\") pod \"maas-default-gateway-openshift-default-769df7846c-vnwz7\" (UID: \"484fe8d9-f020-44dc-a06c-5e294b8370ae\") " pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-vnwz7"
Oct 30 21:28:40.689977 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:28:40.689806    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/484fe8d9-f020-44dc-a06c-5e294b8370ae-istio-data\") pod \"maas-default-gateway-openshift-default-769df7846c-vnwz7\" (UID: \"484fe8d9-f020-44dc-a06c-5e294b8370ae\") " pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-vnwz7"
Oct 30 21:28:40.689977 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:28:40.689919    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/484fe8d9-f020-44dc-a06c-5e294b8370ae-istio-podinfo\") pod \"maas-default-gateway-openshift-default-769df7846c-vnwz7\" (UID: \"484fe8d9-f020-44dc-a06c-5e294b8370ae\") " pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-vnwz7"
Oct 30 21:28:40.689977 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:28:40.689953    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d2mf7\" (UniqueName: \"kubernetes.io/projected/484fe8d9-f020-44dc-a06c-5e294b8370ae-kube-api-access-d2mf7\") pod \"maas-default-gateway-openshift-default-769df7846c-vnwz7\" (UID: \"484fe8d9-f020-44dc-a06c-5e294b8370ae\") " pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-vnwz7"
Oct 30 21:28:40.690177 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:28:40.690037    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/484fe8d9-f020-44dc-a06c-5e294b8370ae-istio-envoy\") pod \"maas-default-gateway-openshift-default-769df7846c-vnwz7\" (UID: \"484fe8d9-f020-44dc-a06c-5e294b8370ae\") " pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-vnwz7"
Oct 30 21:28:40.690177 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:28:40.690155    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/484fe8d9-f020-44dc-a06c-5e294b8370ae-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-769df7846c-vnwz7\" (UID: \"484fe8d9-f020-44dc-a06c-5e294b8370ae\") " pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-vnwz7"
Oct 30 21:28:40.690274 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:28:40.690193    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/484fe8d9-f020-44dc-a06c-5e294b8370ae-istio-token\") pod \"maas-default-gateway-openshift-default-769df7846c-vnwz7\" (UID: \"484fe8d9-f020-44dc-a06c-5e294b8370ae\") " pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-vnwz7"
Oct 30 21:28:40.690274 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:28:40.690214    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/484fe8d9-f020-44dc-a06c-5e294b8370ae-workload-certs\") pod \"maas-default-gateway-openshift-default-769df7846c-vnwz7\" (UID: \"484fe8d9-f020-44dc-a06c-5e294b8370ae\") " pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-vnwz7"
Oct 30 21:28:40.690274 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:28:40.690256    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/484fe8d9-f020-44dc-a06c-5e294b8370ae-workload-socket\") pod \"maas-default-gateway-openshift-default-769df7846c-vnwz7\" (UID: \"484fe8d9-f020-44dc-a06c-5e294b8370ae\") " pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-vnwz7"
Oct 30 21:28:40.702033 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:28:40.702010    6004 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-769df7846c-vnwz7"]
Oct 30 21:28:40.790955 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:28:40.790923    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/484fe8d9-f020-44dc-a06c-5e294b8370ae-credential-socket\") pod \"maas-default-gateway-openshift-default-769df7846c-vnwz7\" (UID: \"484fe8d9-f020-44dc-a06c-5e294b8370ae\") " pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-vnwz7"
Oct 30 21:28:40.791174 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:28:40.790964    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/484fe8d9-f020-44dc-a06c-5e294b8370ae-istio-data\") pod \"maas-default-gateway-openshift-default-769df7846c-vnwz7\" (UID: \"484fe8d9-f020-44dc-a06c-5e294b8370ae\") " pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-vnwz7"
Oct 30 21:28:40.791174 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:28:40.791006    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/484fe8d9-f020-44dc-a06c-5e294b8370ae-istio-podinfo\") pod \"maas-default-gateway-openshift-default-769df7846c-vnwz7\" (UID: \"484fe8d9-f020-44dc-a06c-5e294b8370ae\") " pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-vnwz7"
Oct 30 21:28:40.791174 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:28:40.791028    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d2mf7\" (UniqueName: \"kubernetes.io/projected/484fe8d9-f020-44dc-a06c-5e294b8370ae-kube-api-access-d2mf7\") pod \"maas-default-gateway-openshift-default-769df7846c-vnwz7\" (UID: \"484fe8d9-f020-44dc-a06c-5e294b8370ae\") " pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-vnwz7"
Oct 30 21:28:40.791174 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:28:40.791073    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/484fe8d9-f020-44dc-a06c-5e294b8370ae-istio-envoy\") pod \"maas-default-gateway-openshift-default-769df7846c-vnwz7\" (UID: \"484fe8d9-f020-44dc-a06c-5e294b8370ae\") " pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-vnwz7"
Oct 30 21:28:40.791174 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:28:40.791107    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/484fe8d9-f020-44dc-a06c-5e294b8370ae-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-769df7846c-vnwz7\" (UID: \"484fe8d9-f020-44dc-a06c-5e294b8370ae\") " pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-vnwz7"
Oct 30 21:28:40.791174 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:28:40.791140    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/484fe8d9-f020-44dc-a06c-5e294b8370ae-istio-token\") pod \"maas-default-gateway-openshift-default-769df7846c-vnwz7\" (UID: \"484fe8d9-f020-44dc-a06c-5e294b8370ae\") " pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-vnwz7"
Oct 30 21:28:40.791174 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:28:40.791172    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/484fe8d9-f020-44dc-a06c-5e294b8370ae-workload-certs\") pod \"maas-default-gateway-openshift-default-769df7846c-vnwz7\" (UID: \"484fe8d9-f020-44dc-a06c-5e294b8370ae\") " pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-vnwz7"
Oct 30 21:28:40.791564 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:28:40.791202    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/484fe8d9-f020-44dc-a06c-5e294b8370ae-workload-socket\") pod \"maas-default-gateway-openshift-default-769df7846c-vnwz7\" (UID: \"484fe8d9-f020-44dc-a06c-5e294b8370ae\") " pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-vnwz7"
Oct 30 21:28:40.791564 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:28:40.791436    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/484fe8d9-f020-44dc-a06c-5e294b8370ae-credential-socket\") pod \"maas-default-gateway-openshift-default-769df7846c-vnwz7\" (UID: \"484fe8d9-f020-44dc-a06c-5e294b8370ae\") " pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-vnwz7"
Oct 30 21:28:40.791678 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:28:40.791615    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/484fe8d9-f020-44dc-a06c-5e294b8370ae-workload-socket\") pod \"maas-default-gateway-openshift-default-769df7846c-vnwz7\" (UID: \"484fe8d9-f020-44dc-a06c-5e294b8370ae\") " pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-vnwz7"
Oct 30 21:28:40.791678 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:28:40.791659    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/484fe8d9-f020-44dc-a06c-5e294b8370ae-workload-certs\") pod \"maas-default-gateway-openshift-default-769df7846c-vnwz7\" (UID: \"484fe8d9-f020-44dc-a06c-5e294b8370ae\") " pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-vnwz7"
Oct 30 21:28:40.791781 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:28:40.791723    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/484fe8d9-f020-44dc-a06c-5e294b8370ae-istio-data\") pod \"maas-default-gateway-openshift-default-769df7846c-vnwz7\" (UID: \"484fe8d9-f020-44dc-a06c-5e294b8370ae\") " pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-vnwz7"
Oct 30 21:28:40.792006 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:28:40.791981    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/484fe8d9-f020-44dc-a06c-5e294b8370ae-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-769df7846c-vnwz7\" (UID: \"484fe8d9-f020-44dc-a06c-5e294b8370ae\") " pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-vnwz7"
Oct 30 21:28:40.793442 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:28:40.793413    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/484fe8d9-f020-44dc-a06c-5e294b8370ae-istio-envoy\") pod \"maas-default-gateway-openshift-default-769df7846c-vnwz7\" (UID: \"484fe8d9-f020-44dc-a06c-5e294b8370ae\") " pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-vnwz7"
Oct 30 21:28:40.793597 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:28:40.793581    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/484fe8d9-f020-44dc-a06c-5e294b8370ae-istio-podinfo\") pod \"maas-default-gateway-openshift-default-769df7846c-vnwz7\" (UID: \"484fe8d9-f020-44dc-a06c-5e294b8370ae\") " pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-vnwz7"
Oct 30 21:28:40.848987 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:28:40.848914    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/484fe8d9-f020-44dc-a06c-5e294b8370ae-istio-token\") pod \"maas-default-gateway-openshift-default-769df7846c-vnwz7\" (UID: \"484fe8d9-f020-44dc-a06c-5e294b8370ae\") " pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-vnwz7"
Oct 30 21:28:40.849155 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:28:40.848991    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d2mf7\" (UniqueName: \"kubernetes.io/projected/484fe8d9-f020-44dc-a06c-5e294b8370ae-kube-api-access-d2mf7\") pod \"maas-default-gateway-openshift-default-769df7846c-vnwz7\" (UID: \"484fe8d9-f020-44dc-a06c-5e294b8370ae\") " pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-vnwz7"
Oct 30 21:28:40.909146 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:28:40.909110    6004 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-vnwz7"
Oct 30 21:28:41.330462 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:28:41.330431    6004 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-769df7846c-vnwz7"]
Oct 30 21:28:41.332498 ip-10-0-138-85 kubenswrapper[6004]: W1030 21:28:41.332471    6004 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod484fe8d9_f020_44dc_a06c_5e294b8370ae.slice/crio-a019bcb79a1132ecd875342c5588eecb9e11492ab025e144563e0dc01e846e26 WatchSource:0}: Error finding container a019bcb79a1132ecd875342c5588eecb9e11492ab025e144563e0dc01e846e26: Status 404 returned error can't find the container with id a019bcb79a1132ecd875342c5588eecb9e11492ab025e144563e0dc01e846e26
Oct 30 21:28:41.334936 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:28:41.334907    6004 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 21:28:41.335002 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:28:41.334973    6004 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 21:28:41.335038 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:28:41.335001    6004 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 21:28:41.465277 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:28:41.465240    6004 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-vnwz7" event={"ID":"484fe8d9-f020-44dc-a06c-5e294b8370ae","Type":"ContainerStarted","Data":"4677fe3c86c5ff60557e099616ec95a0d48834a4c254dca036b0b3ac0826dffd"}
Oct 30 21:28:41.465438 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:28:41.465300    6004 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-vnwz7" event={"ID":"484fe8d9-f020-44dc-a06c-5e294b8370ae","Type":"ContainerStarted","Data":"a019bcb79a1132ecd875342c5588eecb9e11492ab025e144563e0dc01e846e26"}
Oct 30 21:28:41.586849 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:28:41.586723    6004 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-vnwz7" podStartSLOduration=1.586704842 podStartE2EDuration="1.586704842s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:28:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:28:41.585613426 +0000 UTC m=+3027.505399546" watchObservedRunningTime="2026-10-30 21:28:41.586704842 +0000 UTC m=+3027.506490963"
Oct 30 21:28:41.909667 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:28:41.909581    6004 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-vnwz7"
Oct 30 21:28:42.910917 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:28:42.910877    6004 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-769df7846c-vnwz7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.123:15021/healthz/ready\": dial tcp 10.132.0.123:15021: connect: connection refused" start-of-body=
Oct 30 21:28:42.911339 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:28:42.910933    6004 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-vnwz7" podUID="484fe8d9-f020-44dc-a06c-5e294b8370ae" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.123:15021/healthz/ready\": dial tcp 10.132.0.123:15021: connect: connection refused"
Oct 30 21:28:43.910153 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:28:43.910120    6004 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-769df7846c-vnwz7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.123:15021/healthz/ready\": dial tcp 10.132.0.123:15021: connect: connection refused" start-of-body=
Oct 30 21:28:43.910340 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:28:43.910172    6004 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-vnwz7" podUID="484fe8d9-f020-44dc-a06c-5e294b8370ae" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.123:15021/healthz/ready\": dial tcp 10.132.0.123:15021: connect: connection refused"
Oct 30 21:28:44.285486 ip-10-0-138-85 kubenswrapper[6004]: E1030 21:28:44.285442    6004 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-zz4wr" containerName="extractor"
Oct 30 21:28:44.910064 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:28:44.910023    6004 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-769df7846c-vnwz7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.123:15021/healthz/ready\": dial tcp 10.132.0.123:15021: connect: connection refused" start-of-body=
Oct 30 21:28:44.910267 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:28:44.910103    6004 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-vnwz7" podUID="484fe8d9-f020-44dc-a06c-5e294b8370ae" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.123:15021/healthz/ready\": dial tcp 10.132.0.123:15021: connect: connection refused"
Oct 30 21:28:45.910117 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:28:45.910081    6004 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-769df7846c-vnwz7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.123:15021/healthz/ready\": dial tcp 10.132.0.123:15021: connect: connection refused" start-of-body=
Oct 30 21:28:45.910593 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:28:45.910133    6004 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-vnwz7" podUID="484fe8d9-f020-44dc-a06c-5e294b8370ae" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.123:15021/healthz/ready\": dial tcp 10.132.0.123:15021: connect: connection refused"
Oct 30 21:28:46.909852 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:28:46.909816    6004 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-769df7846c-vnwz7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.123:15021/healthz/ready\": dial tcp 10.132.0.123:15021: connect: connection refused" start-of-body=
Oct 30 21:28:46.910034 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:28:46.909871    6004 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-vnwz7" podUID="484fe8d9-f020-44dc-a06c-5e294b8370ae" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.123:15021/healthz/ready\": dial tcp 10.132.0.123:15021: connect: connection refused"
Oct 30 21:28:47.910127 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:28:47.910090    6004 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-769df7846c-vnwz7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.123:15021/healthz/ready\": dial tcp 10.132.0.123:15021: connect: connection refused" start-of-body=
Oct 30 21:28:47.910529 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:28:47.910145    6004 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-vnwz7" podUID="484fe8d9-f020-44dc-a06c-5e294b8370ae" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.123:15021/healthz/ready\": dial tcp 10.132.0.123:15021: connect: connection refused"
Oct 30 21:28:48.910263 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:28:48.910226    6004 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-769df7846c-vnwz7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.123:15021/healthz/ready\": dial tcp 10.132.0.123:15021: connect: connection refused" start-of-body=
Oct 30 21:28:48.910685 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:28:48.910284    6004 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-vnwz7" podUID="484fe8d9-f020-44dc-a06c-5e294b8370ae" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.123:15021/healthz/ready\": dial tcp 10.132.0.123:15021: connect: connection refused"
Oct 30 21:28:50.072358 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:28:50.072323    6004 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-vnwz7"
Oct 30 21:28:50.072772 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:28:50.072726    6004 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-vnwz7"
Oct 30 21:28:50.073512 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:28:50.073490    6004 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-vnwz7"
Oct 30 21:29:14.285409 ip-10-0-138-85 kubenswrapper[6004]: E1030 21:29:14.285372    6004 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-zz4wr" containerName="extractor"
Oct 30 21:29:44.285379 ip-10-0-138-85 kubenswrapper[6004]: E1030 21:29:44.285345    6004 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-zz4wr" containerName="extractor"
Oct 30 21:30:14.287058 ip-10-0-138-85 kubenswrapper[6004]: E1030 21:30:14.287006    6004 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-zz4wr" containerName="extractor"
Oct 30 21:30:44.285292 ip-10-0-138-85 kubenswrapper[6004]: E1030 21:30:44.285251    6004 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-zz4wr" containerName="extractor"
Oct 30 21:31:14.285101 ip-10-0-138-85 kubenswrapper[6004]: E1030 21:31:14.285064    6004 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-zz4wr" containerName="extractor"
Oct 30 21:31:44.285319 ip-10-0-138-85 kubenswrapper[6004]: E1030 21:31:44.285280    6004 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-zz4wr" containerName="extractor"
Oct 30 21:32:14.289205 ip-10-0-138-85 kubenswrapper[6004]: E1030 21:32:14.289161    6004 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-zz4wr" containerName="extractor"
Oct 30 21:32:44.285659 ip-10-0-138-85 kubenswrapper[6004]: E1030 21:32:44.285620    6004 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-zz4wr" containerName="extractor"
Oct 30 21:33:14.284339 ip-10-0-138-85 kubenswrapper[6004]: E1030 21:33:14.284304    6004 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-zz4wr" containerName="extractor"
Oct 30 21:33:14.761855 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:33:14.761827    6004 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-sb7ds_90cd3de0-c573-41c2-bf3e-cf0e46a41d50/console-operator/2.log"
Oct 30 21:33:14.766457 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:33:14.766434    6004 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-sb7ds_90cd3de0-c573-41c2-bf3e-cf0e46a41d50/console-operator/2.log"
Oct 30 21:33:44.285723 ip-10-0-138-85 kubenswrapper[6004]: E1030 21:33:44.285686    6004 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-zz4wr" containerName="extractor"
Oct 30 21:34:14.287101 ip-10-0-138-85 kubenswrapper[6004]: E1030 21:34:14.287041    6004 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-zz4wr" containerName="extractor"
Oct 30 21:34:44.285232 ip-10-0-138-85 kubenswrapper[6004]: E1030 21:34:44.285194    6004 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-zz4wr" containerName="extractor"
Oct 30 21:35:14.285469 ip-10-0-138-85 kubenswrapper[6004]: E1030 21:35:14.285422    6004 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-zz4wr" containerName="extractor"
Oct 30 21:35:44.285587 ip-10-0-138-85 kubenswrapper[6004]: E1030 21:35:44.285543    6004 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-zz4wr" containerName="extractor"
Oct 30 21:36:14.285664 ip-10-0-138-85 kubenswrapper[6004]: E1030 21:36:14.285629    6004 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-zz4wr" containerName="extractor"
Oct 30 21:36:14.581080 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:36:14.580981    6004 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-678d87766f-btzg6"]
Oct 30 21:36:14.581271 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:36:14.581244    6004 kuberuntime_container.go:898] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-btzg6" podUID="8a47c9b5-f2d9-4ec7-98f9-77903f9098d5" containerName="manager" containerID="cri-o://11a20059dcc69cb71ace73ec7f51723ac910a3acf366b87d72a248cf371df633" gracePeriod=10
Oct 30 21:36:14.840625 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:36:14.840559    6004 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-btzg6"
Oct 30 21:36:14.889235 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:36:14.889205    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/8a47c9b5-f2d9-4ec7-98f9-77903f9098d5-kube-api-access-jw7d2\" (UniqueName: \"kubernetes.io/projected/8a47c9b5-f2d9-4ec7-98f9-77903f9098d5-kube-api-access-jw7d2\") pod \"8a47c9b5-f2d9-4ec7-98f9-77903f9098d5\" (UID: \"8a47c9b5-f2d9-4ec7-98f9-77903f9098d5\") "
Oct 30 21:36:14.889397 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:36:14.889329    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/8a47c9b5-f2d9-4ec7-98f9-77903f9098d5-extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/8a47c9b5-f2d9-4ec7-98f9-77903f9098d5-extensions-socket-volume\") pod \"8a47c9b5-f2d9-4ec7-98f9-77903f9098d5\" (UID: \"8a47c9b5-f2d9-4ec7-98f9-77903f9098d5\") "
Oct 30 21:36:14.889710 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:36:14.889682    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8a47c9b5-f2d9-4ec7-98f9-77903f9098d5-extensions-socket-volume" pod "8a47c9b5-f2d9-4ec7-98f9-77903f9098d5" (UID: "8a47c9b5-f2d9-4ec7-98f9-77903f9098d5"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:36:14.891236 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:36:14.891213    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8a47c9b5-f2d9-4ec7-98f9-77903f9098d5-kube-api-access-jw7d2" pod "8a47c9b5-f2d9-4ec7-98f9-77903f9098d5" (UID: "8a47c9b5-f2d9-4ec7-98f9-77903f9098d5"). InnerVolumeSpecName "kube-api-access-jw7d2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:36:14.990811 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:36:14.990777    6004 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/8a47c9b5-f2d9-4ec7-98f9-77903f9098d5-extensions-socket-volume\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:36:14.990811 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:36:14.990810    6004 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jw7d2\" (UniqueName: \"kubernetes.io/projected/8a47c9b5-f2d9-4ec7-98f9-77903f9098d5-kube-api-access-jw7d2\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:36:15.022564 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:36:15.022522    6004 generic.go:356] "Generic (PLEG): container finished" podID="8a47c9b5-f2d9-4ec7-98f9-77903f9098d5" containerID="11a20059dcc69cb71ace73ec7f51723ac910a3acf366b87d72a248cf371df633" exitCode=0
Oct 30 21:36:15.022742 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:36:15.022583    6004 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-btzg6"
Oct 30 21:36:15.022742 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:36:15.022599    6004 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-btzg6" event={"ID":"8a47c9b5-f2d9-4ec7-98f9-77903f9098d5","Type":"ContainerDied","Data":"11a20059dcc69cb71ace73ec7f51723ac910a3acf366b87d72a248cf371df633"}
Oct 30 21:36:15.022742 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:36:15.022664    6004 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-btzg6" event={"ID":"8a47c9b5-f2d9-4ec7-98f9-77903f9098d5","Type":"ContainerDied","Data":"3db2b3a9b28e378ad0bff04c6726fc200e8412daeeca4f80825bb75f7f75da86"}
Oct 30 21:36:15.022742 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:36:15.022694    6004 scope.go:122] "RemoveContainer" containerID="11a20059dcc69cb71ace73ec7f51723ac910a3acf366b87d72a248cf371df633"
Oct 30 21:36:15.032960 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:36:15.032942    6004 scope.go:122] "RemoveContainer" containerID="11a20059dcc69cb71ace73ec7f51723ac910a3acf366b87d72a248cf371df633"
Oct 30 21:36:15.033280 ip-10-0-138-85 kubenswrapper[6004]: E1030 21:36:15.033251    6004 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"11a20059dcc69cb71ace73ec7f51723ac910a3acf366b87d72a248cf371df633\": container with ID starting with 11a20059dcc69cb71ace73ec7f51723ac910a3acf366b87d72a248cf371df633 not found: ID does not exist" containerID="11a20059dcc69cb71ace73ec7f51723ac910a3acf366b87d72a248cf371df633"
Oct 30 21:36:15.033398 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:36:15.033289    6004 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"11a20059dcc69cb71ace73ec7f51723ac910a3acf366b87d72a248cf371df633"} err="failed to get container status \"11a20059dcc69cb71ace73ec7f51723ac910a3acf366b87d72a248cf371df633\": rpc error: code = NotFound desc = could not find container \"11a20059dcc69cb71ace73ec7f51723ac910a3acf366b87d72a248cf371df633\": container with ID starting with 11a20059dcc69cb71ace73ec7f51723ac910a3acf366b87d72a248cf371df633 not found: ID does not exist"
Oct 30 21:36:15.190028 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:36:15.189999    6004 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-678d87766f-btzg6"]
Oct 30 21:36:15.196130 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:36:15.196106    6004 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-678d87766f-btzg6"]
Oct 30 21:36:16.230296 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:36:16.230261    6004 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="8a47c9b5-f2d9-4ec7-98f9-77903f9098d5" path="/var/lib/kubelet/pods/8a47c9b5-f2d9-4ec7-98f9-77903f9098d5/volumes"
Oct 30 21:36:44.286134 ip-10-0-138-85 kubenswrapper[6004]: E1030 21:36:44.286092    6004 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-zz4wr" containerName="extractor"
Oct 30 21:37:14.286037 ip-10-0-138-85 kubenswrapper[6004]: E1030 21:37:14.286004    6004 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-zz4wr" containerName="extractor"
Oct 30 21:37:18.229683 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:37:18.229652    6004 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-678d87766f-bjdgq"]
Oct 30 21:37:18.230202 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:37:18.230043    6004 cpu_manager.go:414] "containerMap: removing container" podUID="8a47c9b5-f2d9-4ec7-98f9-77903f9098d5" containerName="manager"
Oct 30 21:37:18.230202 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:37:18.230071    6004 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="8a47c9b5-f2d9-4ec7-98f9-77903f9098d5" containerName="manager"
Oct 30 21:37:18.230202 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:37:18.230153    6004 memory_manager.go:365] "RemoveStaleState removing state" podUID="8a47c9b5-f2d9-4ec7-98f9-77903f9098d5" containerName="manager"
Oct 30 21:37:18.233148 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:37:18.233123    6004 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-bjdgq"
Oct 30 21:37:18.279810 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:37:18.279783    6004 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-678d87766f-bjdgq"]
Oct 30 21:37:18.328756 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:37:18.328727    6004 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-zsc5j\""
Oct 30 21:37:18.377534 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:37:18.377499    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ee6a6b41-b28b-4ee5-8d22-97a3aaadc6d8-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-678d87766f-bjdgq\" (UID: \"ee6a6b41-b28b-4ee5-8d22-97a3aaadc6d8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-bjdgq"
Oct 30 21:37:18.377690 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:37:18.377556    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8zjcv\" (UniqueName: \"kubernetes.io/projected/ee6a6b41-b28b-4ee5-8d22-97a3aaadc6d8-kube-api-access-8zjcv\") pod \"kuadrant-operator-controller-manager-678d87766f-bjdgq\" (UID: \"ee6a6b41-b28b-4ee5-8d22-97a3aaadc6d8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-bjdgq"
Oct 30 21:37:18.478769 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:37:18.478738    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ee6a6b41-b28b-4ee5-8d22-97a3aaadc6d8-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-678d87766f-bjdgq\" (UID: \"ee6a6b41-b28b-4ee5-8d22-97a3aaadc6d8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-bjdgq"
Oct 30 21:37:18.478927 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:37:18.478782    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8zjcv\" (UniqueName: \"kubernetes.io/projected/ee6a6b41-b28b-4ee5-8d22-97a3aaadc6d8-kube-api-access-8zjcv\") pod \"kuadrant-operator-controller-manager-678d87766f-bjdgq\" (UID: \"ee6a6b41-b28b-4ee5-8d22-97a3aaadc6d8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-bjdgq"
Oct 30 21:37:18.479139 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:37:18.479121    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ee6a6b41-b28b-4ee5-8d22-97a3aaadc6d8-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-678d87766f-bjdgq\" (UID: \"ee6a6b41-b28b-4ee5-8d22-97a3aaadc6d8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-bjdgq"
Oct 30 21:37:18.537200 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:37:18.537131    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8zjcv\" (UniqueName: \"kubernetes.io/projected/ee6a6b41-b28b-4ee5-8d22-97a3aaadc6d8-kube-api-access-8zjcv\") pod \"kuadrant-operator-controller-manager-678d87766f-bjdgq\" (UID: \"ee6a6b41-b28b-4ee5-8d22-97a3aaadc6d8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-bjdgq"
Oct 30 21:37:18.545692 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:37:18.545671    6004 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-bjdgq"
Oct 30 21:37:18.967551 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:37:18.967516    6004 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-678d87766f-bjdgq"]
Oct 30 21:37:19.005948 ip-10-0-138-85 kubenswrapper[6004]: W1030 21:37:19.005919    6004 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podee6a6b41_b28b_4ee5_8d22_97a3aaadc6d8.slice/crio-4387c381ff4c78f6837f0e6fdc7596085bc42d27690b47430a62f17b3d7ea4c8 WatchSource:0}: Error finding container 4387c381ff4c78f6837f0e6fdc7596085bc42d27690b47430a62f17b3d7ea4c8: Status 404 returned error can't find the container with id 4387c381ff4c78f6837f0e6fdc7596085bc42d27690b47430a62f17b3d7ea4c8
Oct 30 21:37:19.353223 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:37:19.353133    6004 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-bjdgq" event={"ID":"ee6a6b41-b28b-4ee5-8d22-97a3aaadc6d8","Type":"ContainerStarted","Data":"7feb030724d60afc6deaf0aa11503605c1ba41fddbf687f69a0c4bed1ee47027"}
Oct 30 21:37:19.353223 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:37:19.353198    6004 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-bjdgq" event={"ID":"ee6a6b41-b28b-4ee5-8d22-97a3aaadc6d8","Type":"ContainerStarted","Data":"4387c381ff4c78f6837f0e6fdc7596085bc42d27690b47430a62f17b3d7ea4c8"}
Oct 30 21:37:19.353904 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:37:19.353348    6004 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-bjdgq"
Oct 30 21:37:19.473279 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:37:19.473222    6004 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-bjdgq" podStartSLOduration=1.473204126 podStartE2EDuration="1.473204126s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:37:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:37:19.470926681 +0000 UTC m=+3545.390712801" watchObservedRunningTime="2026-10-30 21:37:19.473204126 +0000 UTC m=+3545.392990244"
Oct 30 21:37:30.360511 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:37:30.360481    6004 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-bjdgq"
Oct 30 21:37:44.285173 ip-10-0-138-85 kubenswrapper[6004]: E1030 21:37:44.285136    6004 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-zz4wr" containerName="extractor"
Oct 30 21:38:14.284834 ip-10-0-138-85 kubenswrapper[6004]: E1030 21:38:14.284796    6004 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-zz4wr" containerName="extractor"
Oct 30 21:38:14.795438 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:38:14.795330    6004 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-sb7ds_90cd3de0-c573-41c2-bf3e-cf0e46a41d50/console-operator/2.log"
Oct 30 21:38:14.802673 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:38:14.802654    6004 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-sb7ds_90cd3de0-c573-41c2-bf3e-cf0e46a41d50/console-operator/2.log"
Oct 30 21:38:44.286357 ip-10-0-138-85 kubenswrapper[6004]: E1030 21:38:44.286307    6004 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-zz4wr" containerName="extractor"
Oct 30 21:39:14.286044 ip-10-0-138-85 kubenswrapper[6004]: E1030 21:39:14.286000    6004 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-zz4wr" containerName="extractor"
Oct 30 21:39:44.285858 ip-10-0-138-85 kubenswrapper[6004]: E1030 21:39:44.285819    6004 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-zz4wr" containerName="extractor"
Oct 30 21:40:14.290997 ip-10-0-138-85 kubenswrapper[6004]: E1030 21:40:14.290954    6004 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-zz4wr" containerName="extractor"
Oct 30 21:40:37.382075 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:40:37.381159    6004 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-769df7846c-t9zxd container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.122:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 30 21:40:37.382075 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:40:37.381268    6004 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-t9zxd" podUID="63f0a1f2-255c-4159-8d3f-6c79a470a2c7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.122:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:40:44.285434 ip-10-0-138-85 kubenswrapper[6004]: E1030 21:40:44.285395    6004 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-zz4wr" containerName="extractor"
Oct 30 21:41:14.285205 ip-10-0-138-85 kubenswrapper[6004]: E1030 21:41:14.285169    6004 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-zz4wr" containerName="extractor"
Oct 30 21:41:21.100016 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:41:21.099967    6004 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-769df7846c-vnwz7 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.123:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 30 21:41:21.100536 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:41:21.100045    6004 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-vnwz7" podUID="484fe8d9-f020-44dc-a06c-5e294b8370ae" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.123:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:41:44.290878 ip-10-0-138-85 kubenswrapper[6004]: E1030 21:41:44.290835    6004 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-zz4wr" containerName="extractor"
Oct 30 21:42:14.306967 ip-10-0-138-85 kubenswrapper[6004]: E1030 21:42:14.306893    6004 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-zz4wr" containerName="extractor"
Oct 30 21:42:44.285923 ip-10-0-138-85 kubenswrapper[6004]: E1030 21:42:44.285883    6004 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-zz4wr" containerName="extractor"
Oct 30 21:43:06.943228 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:43:06.943146    6004 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-6b964d9667-7kwdn"]
Oct 30 21:43:06.946932 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:43:06.946915    6004 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-6b964d9667-7kwdn"
Oct 30 21:43:07.013812 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:43:07.013775    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/940054e3-e435-4c68-a009-991bf42b5355-metrics-certs\") pod \"maas-api-6b964d9667-7kwdn\" (UID: \"940054e3-e435-4c68-a009-991bf42b5355\") " pod="odh-ai-gateway-infra/maas-api-6b964d9667-7kwdn"
Oct 30 21:43:07.014024 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:43:07.013839    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/940054e3-e435-4c68-a009-991bf42b5355-maas-api-tls\") pod \"maas-api-6b964d9667-7kwdn\" (UID: \"940054e3-e435-4c68-a009-991bf42b5355\") " pod="odh-ai-gateway-infra/maas-api-6b964d9667-7kwdn"
Oct 30 21:43:07.014024 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:43:07.013916    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/940054e3-e435-4c68-a009-991bf42b5355-openshift-service-ca\") pod \"maas-api-6b964d9667-7kwdn\" (UID: \"940054e3-e435-4c68-a009-991bf42b5355\") " pod="odh-ai-gateway-infra/maas-api-6b964d9667-7kwdn"
Oct 30 21:43:07.014024 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:43:07.013956    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lfpp2\" (UniqueName: \"kubernetes.io/projected/940054e3-e435-4c68-a009-991bf42b5355-kube-api-access-lfpp2\") pod \"maas-api-6b964d9667-7kwdn\" (UID: \"940054e3-e435-4c68-a009-991bf42b5355\") " pod="odh-ai-gateway-infra/maas-api-6b964d9667-7kwdn"
Oct 30 21:43:07.053281 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:43:07.053243    6004 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-6b964d9667-7kwdn"]
Oct 30 21:43:07.114725 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:43:07.114689    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/940054e3-e435-4c68-a009-991bf42b5355-maas-api-tls\") pod \"maas-api-6b964d9667-7kwdn\" (UID: \"940054e3-e435-4c68-a009-991bf42b5355\") " pod="odh-ai-gateway-infra/maas-api-6b964d9667-7kwdn"
Oct 30 21:43:07.114902 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:43:07.114727    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/940054e3-e435-4c68-a009-991bf42b5355-openshift-service-ca\") pod \"maas-api-6b964d9667-7kwdn\" (UID: \"940054e3-e435-4c68-a009-991bf42b5355\") " pod="odh-ai-gateway-infra/maas-api-6b964d9667-7kwdn"
Oct 30 21:43:07.114902 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:43:07.114761    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lfpp2\" (UniqueName: \"kubernetes.io/projected/940054e3-e435-4c68-a009-991bf42b5355-kube-api-access-lfpp2\") pod \"maas-api-6b964d9667-7kwdn\" (UID: \"940054e3-e435-4c68-a009-991bf42b5355\") " pod="odh-ai-gateway-infra/maas-api-6b964d9667-7kwdn"
Oct 30 21:43:07.114902 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:43:07.114833    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/940054e3-e435-4c68-a009-991bf42b5355-metrics-certs\") pod \"maas-api-6b964d9667-7kwdn\" (UID: \"940054e3-e435-4c68-a009-991bf42b5355\") " pod="odh-ai-gateway-infra/maas-api-6b964d9667-7kwdn"
Oct 30 21:43:07.115429 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:43:07.115400    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/940054e3-e435-4c68-a009-991bf42b5355-openshift-service-ca\") pod \"maas-api-6b964d9667-7kwdn\" (UID: \"940054e3-e435-4c68-a009-991bf42b5355\") " pod="odh-ai-gateway-infra/maas-api-6b964d9667-7kwdn"
Oct 30 21:43:07.117463 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:43:07.117436    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/940054e3-e435-4c68-a009-991bf42b5355-maas-api-tls\") pod \"maas-api-6b964d9667-7kwdn\" (UID: \"940054e3-e435-4c68-a009-991bf42b5355\") " pod="odh-ai-gateway-infra/maas-api-6b964d9667-7kwdn"
Oct 30 21:43:07.117577 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:43:07.117467    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/940054e3-e435-4c68-a009-991bf42b5355-metrics-certs\") pod \"maas-api-6b964d9667-7kwdn\" (UID: \"940054e3-e435-4c68-a009-991bf42b5355\") " pod="odh-ai-gateway-infra/maas-api-6b964d9667-7kwdn"
Oct 30 21:43:07.172110 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:43:07.172074    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lfpp2\" (UniqueName: \"kubernetes.io/projected/940054e3-e435-4c68-a009-991bf42b5355-kube-api-access-lfpp2\") pod \"maas-api-6b964d9667-7kwdn\" (UID: \"940054e3-e435-4c68-a009-991bf42b5355\") " pod="odh-ai-gateway-infra/maas-api-6b964d9667-7kwdn"
Oct 30 21:43:07.262565 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:43:07.262487    6004 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-6b964d9667-7kwdn"
Oct 30 21:43:07.643593 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:43:07.643566    6004 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-6b964d9667-7kwdn"]
Oct 30 21:43:07.645613 ip-10-0-138-85 kubenswrapper[6004]: W1030 21:43:07.645585    6004 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod940054e3_e435_4c68_a009_991bf42b5355.slice/crio-1c1f2eec415361921a169bec7b8f57e06ee4c4505ac6e533a61aec6669fb51e6 WatchSource:0}: Error finding container 1c1f2eec415361921a169bec7b8f57e06ee4c4505ac6e533a61aec6669fb51e6: Status 404 returned error can't find the container with id 1c1f2eec415361921a169bec7b8f57e06ee4c4505ac6e533a61aec6669fb51e6
Oct 30 21:43:07.646945 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:43:07.646926    6004 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Oct 30 21:43:08.334954 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:43:08.334912    6004 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-6b964d9667-7kwdn" event={"ID":"940054e3-e435-4c68-a009-991bf42b5355","Type":"ContainerStarted","Data":"1c1f2eec415361921a169bec7b8f57e06ee4c4505ac6e533a61aec6669fb51e6"}
Oct 30 21:43:09.342502 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:43:09.342470    6004 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-6b964d9667-7kwdn" event={"ID":"940054e3-e435-4c68-a009-991bf42b5355","Type":"ContainerStarted","Data":"7bdcfa44fa9ded5488e4037e829a7441881a22371563a65fdd682405c193c3ad"}
Oct 30 21:43:09.342907 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:43:09.342582    6004 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-6b964d9667-7kwdn"
Oct 30 21:43:09.462761 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:43:09.462696    6004 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-6b964d9667-7kwdn" podStartSLOduration=2.665917702 podStartE2EDuration="3.462677053s" totalImagesPullingTime="796.759351ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:43:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:43:09.459927492 +0000 UTC m=+3895.379713611" watchObservedRunningTime="2026-10-30 21:43:09.462677053 +0000 UTC m=+3895.382463172"
Oct 30 21:43:14.286148 ip-10-0-138-85 kubenswrapper[6004]: E1030 21:43:14.286111    6004 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-zz4wr" containerName="extractor"
Oct 30 21:43:14.833714 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:43:14.833599    6004 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-sb7ds_90cd3de0-c573-41c2-bf3e-cf0e46a41d50/console-operator/2.log"
Oct 30 21:43:14.840642 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:43:14.840624    6004 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-sb7ds_90cd3de0-c573-41c2-bf3e-cf0e46a41d50/console-operator/2.log"
Oct 30 21:43:15.353251 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:43:15.353223    6004 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-6b964d9667-7kwdn"
Oct 30 21:43:15.522148 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:43:15.522118    6004 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-56b9cf7d95-4cxb4"]
Oct 30 21:43:15.522342 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:43:15.522312    6004 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-56b9cf7d95-4cxb4" podUID="8f46c99a-399f-4952-9dac-63d3761c3b65" containerName="maas-api" containerID="cri-o://d24d58c7433d8c64d96bf9effb46afd318e6998785dcbd59f26346539500cf5d" gracePeriod=30
Oct 30 21:43:16.713790 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:43:16.713749    6004 prober.go:122] "Probe failed" probeType="Readiness" pod="odh-ai-gateway-infra/maas-api-56b9cf7d95-4cxb4" podUID="8f46c99a-399f-4952-9dac-63d3761c3b65" containerName="maas-api" probeResult="failure" output="Get \"https://10.132.0.51:8443/health\": dial tcp 10.132.0.51:8443: connect: connection refused"
Oct 30 21:43:16.881301 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:43:16.881275    6004 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-56b9cf7d95-4cxb4"
Oct 30 21:43:17.019156 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:43:17.019122    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/8f46c99a-399f-4952-9dac-63d3761c3b65-kube-api-access-grp7t\" (UniqueName: \"kubernetes.io/projected/8f46c99a-399f-4952-9dac-63d3761c3b65-kube-api-access-grp7t\") pod \"8f46c99a-399f-4952-9dac-63d3761c3b65\" (UID: \"8f46c99a-399f-4952-9dac-63d3761c3b65\") "
Oct 30 21:43:17.019337 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:43:17.019173    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/8f46c99a-399f-4952-9dac-63d3761c3b65-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8f46c99a-399f-4952-9dac-63d3761c3b65-maas-api-tls\") pod \"8f46c99a-399f-4952-9dac-63d3761c3b65\" (UID: \"8f46c99a-399f-4952-9dac-63d3761c3b65\") "
Oct 30 21:43:17.019394 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:43:17.019362    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/8f46c99a-399f-4952-9dac-63d3761c3b65-metrics-certs\" (UniqueName: \"kubernetes.io/secret/8f46c99a-399f-4952-9dac-63d3761c3b65-metrics-certs\") pod \"8f46c99a-399f-4952-9dac-63d3761c3b65\" (UID: \"8f46c99a-399f-4952-9dac-63d3761c3b65\") "
Oct 30 21:43:17.019503 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:43:17.019485    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/8f46c99a-399f-4952-9dac-63d3761c3b65-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8f46c99a-399f-4952-9dac-63d3761c3b65-openshift-service-ca\") pod \"8f46c99a-399f-4952-9dac-63d3761c3b65\" (UID: \"8f46c99a-399f-4952-9dac-63d3761c3b65\") "
Oct 30 21:43:17.019946 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:43:17.019901    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8f46c99a-399f-4952-9dac-63d3761c3b65-openshift-service-ca" pod "8f46c99a-399f-4952-9dac-63d3761c3b65" (UID: "8f46c99a-399f-4952-9dac-63d3761c3b65"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:43:17.021641 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:43:17.021608    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8f46c99a-399f-4952-9dac-63d3761c3b65-maas-api-tls" pod "8f46c99a-399f-4952-9dac-63d3761c3b65" (UID: "8f46c99a-399f-4952-9dac-63d3761c3b65"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:43:17.021906 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:43:17.021883    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8f46c99a-399f-4952-9dac-63d3761c3b65-metrics-certs" pod "8f46c99a-399f-4952-9dac-63d3761c3b65" (UID: "8f46c99a-399f-4952-9dac-63d3761c3b65"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:43:17.022029 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:43:17.021972    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8f46c99a-399f-4952-9dac-63d3761c3b65-kube-api-access-grp7t" pod "8f46c99a-399f-4952-9dac-63d3761c3b65" (UID: "8f46c99a-399f-4952-9dac-63d3761c3b65"). InnerVolumeSpecName "kube-api-access-grp7t". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:43:17.122035 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:43:17.121981    6004 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8f46c99a-399f-4952-9dac-63d3761c3b65-openshift-service-ca\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:43:17.122035 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:43:17.122022    6004 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-grp7t\" (UniqueName: \"kubernetes.io/projected/8f46c99a-399f-4952-9dac-63d3761c3b65-kube-api-access-grp7t\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:43:17.122035 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:43:17.122041    6004 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8f46c99a-399f-4952-9dac-63d3761c3b65-maas-api-tls\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:43:17.122359 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:43:17.122073    6004 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8f46c99a-399f-4952-9dac-63d3761c3b65-metrics-certs\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:43:17.385993 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:43:17.385907    6004 generic.go:356] "Generic (PLEG): container finished" podID="8f46c99a-399f-4952-9dac-63d3761c3b65" containerID="d24d58c7433d8c64d96bf9effb46afd318e6998785dcbd59f26346539500cf5d" exitCode=0
Oct 30 21:43:17.385993 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:43:17.385960    6004 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-56b9cf7d95-4cxb4"
Oct 30 21:43:17.385993 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:43:17.385984    6004 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-56b9cf7d95-4cxb4" event={"ID":"8f46c99a-399f-4952-9dac-63d3761c3b65","Type":"ContainerDied","Data":"d24d58c7433d8c64d96bf9effb46afd318e6998785dcbd59f26346539500cf5d"}
Oct 30 21:43:17.386252 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:43:17.386034    6004 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-56b9cf7d95-4cxb4" event={"ID":"8f46c99a-399f-4952-9dac-63d3761c3b65","Type":"ContainerDied","Data":"1864566faf7e8f31bb143b3010f51c6502b41ceff2eb546d0b87d83f4e05381c"}
Oct 30 21:43:17.386252 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:43:17.386083    6004 scope.go:122] "RemoveContainer" containerID="d24d58c7433d8c64d96bf9effb46afd318e6998785dcbd59f26346539500cf5d"
Oct 30 21:43:17.395834 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:43:17.395813    6004 scope.go:122] "RemoveContainer" containerID="d24d58c7433d8c64d96bf9effb46afd318e6998785dcbd59f26346539500cf5d"
Oct 30 21:43:17.396120 ip-10-0-138-85 kubenswrapper[6004]: E1030 21:43:17.396099    6004 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d24d58c7433d8c64d96bf9effb46afd318e6998785dcbd59f26346539500cf5d\": container with ID starting with d24d58c7433d8c64d96bf9effb46afd318e6998785dcbd59f26346539500cf5d not found: ID does not exist" containerID="d24d58c7433d8c64d96bf9effb46afd318e6998785dcbd59f26346539500cf5d"
Oct 30 21:43:17.396178 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:43:17.396128    6004 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d24d58c7433d8c64d96bf9effb46afd318e6998785dcbd59f26346539500cf5d"} err="failed to get container status \"d24d58c7433d8c64d96bf9effb46afd318e6998785dcbd59f26346539500cf5d\": rpc error: code = NotFound desc = could not find container \"d24d58c7433d8c64d96bf9effb46afd318e6998785dcbd59f26346539500cf5d\": container with ID starting with d24d58c7433d8c64d96bf9effb46afd318e6998785dcbd59f26346539500cf5d not found: ID does not exist"
Oct 30 21:43:17.551631 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:43:17.551601    6004 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-56b9cf7d95-4cxb4"]
Oct 30 21:43:17.602020 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:43:17.601984    6004 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-56b9cf7d95-4cxb4"]
Oct 30 21:43:18.230289 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:43:18.230257    6004 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="8f46c99a-399f-4952-9dac-63d3761c3b65" path="/var/lib/kubelet/pods/8f46c99a-399f-4952-9dac-63d3761c3b65/volumes"
Oct 30 21:43:44.285309 ip-10-0-138-85 kubenswrapper[6004]: E1030 21:43:44.285272    6004 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-zz4wr" containerName="extractor"
Oct 30 21:44:14.286737 ip-10-0-138-85 kubenswrapper[6004]: E1030 21:44:14.286700    6004 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-zz4wr" containerName="extractor"
Oct 30 21:44:19.717661 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:44:19.717624    6004 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-authcfg-http-0e8a1a-696975ffbb-bswsn"]
Oct 30 21:44:19.718303 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:44:19.718247    6004 cpu_manager.go:414] "containerMap: removing container" podUID="8f46c99a-399f-4952-9dac-63d3761c3b65" containerName="maas-api"
Oct 30 21:44:19.718303 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:44:19.718268    6004 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="8f46c99a-399f-4952-9dac-63d3761c3b65" containerName="maas-api"
Oct 30 21:44:19.718430 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:44:19.718421    6004 memory_manager.go:365] "RemoveStaleState removing state" podUID="8f46c99a-399f-4952-9dac-63d3761c3b65" containerName="maas-api"
Oct 30 21:44:19.722989 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:44:19.722966    6004 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-authcfg-http-0e8a1a-696975ffbb-bswsn"
Oct 30 21:44:19.776852 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:44:19.776816    6004 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-authcfg-http-0e8a1a-serving-cert\""
Oct 30 21:44:19.815062 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:44:19.815015    6004 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-authcfg-http-0e8a1a-696975ffbb-bswsn"]
Oct 30 21:44:19.818460 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:44:19.818437    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7b0163d4-e0d9-4ab4-a6fd-f2993a8d36af-maas-api-tls\") pod \"maas-api-e2e-authcfg-http-0e8a1a-696975ffbb-bswsn\" (UID: \"7b0163d4-e0d9-4ab4-a6fd-f2993a8d36af\") " pod="odh-ai-gateway-infra/maas-api-e2e-authcfg-http-0e8a1a-696975ffbb-bswsn"
Oct 30 21:44:19.818567 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:44:19.818490    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7b0163d4-e0d9-4ab4-a6fd-f2993a8d36af-metrics-certs\") pod \"maas-api-e2e-authcfg-http-0e8a1a-696975ffbb-bswsn\" (UID: \"7b0163d4-e0d9-4ab4-a6fd-f2993a8d36af\") " pod="odh-ai-gateway-infra/maas-api-e2e-authcfg-http-0e8a1a-696975ffbb-bswsn"
Oct 30 21:44:19.818672 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:44:19.818652    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4kl8m\" (UniqueName: \"kubernetes.io/projected/7b0163d4-e0d9-4ab4-a6fd-f2993a8d36af-kube-api-access-4kl8m\") pod \"maas-api-e2e-authcfg-http-0e8a1a-696975ffbb-bswsn\" (UID: \"7b0163d4-e0d9-4ab4-a6fd-f2993a8d36af\") " pod="odh-ai-gateway-infra/maas-api-e2e-authcfg-http-0e8a1a-696975ffbb-bswsn"
Oct 30 21:44:19.818743 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:44:19.818692    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7b0163d4-e0d9-4ab4-a6fd-f2993a8d36af-openshift-service-ca\") pod \"maas-api-e2e-authcfg-http-0e8a1a-696975ffbb-bswsn\" (UID: \"7b0163d4-e0d9-4ab4-a6fd-f2993a8d36af\") " pod="odh-ai-gateway-infra/maas-api-e2e-authcfg-http-0e8a1a-696975ffbb-bswsn"
Oct 30 21:44:19.920237 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:44:19.920194    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7b0163d4-e0d9-4ab4-a6fd-f2993a8d36af-metrics-certs\") pod \"maas-api-e2e-authcfg-http-0e8a1a-696975ffbb-bswsn\" (UID: \"7b0163d4-e0d9-4ab4-a6fd-f2993a8d36af\") " pod="odh-ai-gateway-infra/maas-api-e2e-authcfg-http-0e8a1a-696975ffbb-bswsn"
Oct 30 21:44:19.920445 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:44:19.920302    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4kl8m\" (UniqueName: \"kubernetes.io/projected/7b0163d4-e0d9-4ab4-a6fd-f2993a8d36af-kube-api-access-4kl8m\") pod \"maas-api-e2e-authcfg-http-0e8a1a-696975ffbb-bswsn\" (UID: \"7b0163d4-e0d9-4ab4-a6fd-f2993a8d36af\") " pod="odh-ai-gateway-infra/maas-api-e2e-authcfg-http-0e8a1a-696975ffbb-bswsn"
Oct 30 21:44:19.920445 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:44:19.920332    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7b0163d4-e0d9-4ab4-a6fd-f2993a8d36af-openshift-service-ca\") pod \"maas-api-e2e-authcfg-http-0e8a1a-696975ffbb-bswsn\" (UID: \"7b0163d4-e0d9-4ab4-a6fd-f2993a8d36af\") " pod="odh-ai-gateway-infra/maas-api-e2e-authcfg-http-0e8a1a-696975ffbb-bswsn"
Oct 30 21:44:19.920445 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:44:19.920387    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7b0163d4-e0d9-4ab4-a6fd-f2993a8d36af-maas-api-tls\") pod \"maas-api-e2e-authcfg-http-0e8a1a-696975ffbb-bswsn\" (UID: \"7b0163d4-e0d9-4ab4-a6fd-f2993a8d36af\") " pod="odh-ai-gateway-infra/maas-api-e2e-authcfg-http-0e8a1a-696975ffbb-bswsn"
Oct 30 21:44:19.921121 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:44:19.921098    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7b0163d4-e0d9-4ab4-a6fd-f2993a8d36af-openshift-service-ca\") pod \"maas-api-e2e-authcfg-http-0e8a1a-696975ffbb-bswsn\" (UID: \"7b0163d4-e0d9-4ab4-a6fd-f2993a8d36af\") " pod="odh-ai-gateway-infra/maas-api-e2e-authcfg-http-0e8a1a-696975ffbb-bswsn"
Oct 30 21:44:19.923107 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:44:19.923083    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7b0163d4-e0d9-4ab4-a6fd-f2993a8d36af-maas-api-tls\") pod \"maas-api-e2e-authcfg-http-0e8a1a-696975ffbb-bswsn\" (UID: \"7b0163d4-e0d9-4ab4-a6fd-f2993a8d36af\") " pod="odh-ai-gateway-infra/maas-api-e2e-authcfg-http-0e8a1a-696975ffbb-bswsn"
Oct 30 21:44:19.923196 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:44:19.923138    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7b0163d4-e0d9-4ab4-a6fd-f2993a8d36af-metrics-certs\") pod \"maas-api-e2e-authcfg-http-0e8a1a-696975ffbb-bswsn\" (UID: \"7b0163d4-e0d9-4ab4-a6fd-f2993a8d36af\") " pod="odh-ai-gateway-infra/maas-api-e2e-authcfg-http-0e8a1a-696975ffbb-bswsn"
Oct 30 21:44:19.977502 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:44:19.977432    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4kl8m\" (UniqueName: \"kubernetes.io/projected/7b0163d4-e0d9-4ab4-a6fd-f2993a8d36af-kube-api-access-4kl8m\") pod \"maas-api-e2e-authcfg-http-0e8a1a-696975ffbb-bswsn\" (UID: \"7b0163d4-e0d9-4ab4-a6fd-f2993a8d36af\") " pod="odh-ai-gateway-infra/maas-api-e2e-authcfg-http-0e8a1a-696975ffbb-bswsn"
Oct 30 21:44:20.036071 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:44:20.036028    6004 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-authcfg-http-0e8a1a-696975ffbb-bswsn"
Oct 30 21:44:20.408874 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:44:20.408851    6004 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-authcfg-http-0e8a1a-696975ffbb-bswsn"]
Oct 30 21:44:20.410784 ip-10-0-138-85 kubenswrapper[6004]: W1030 21:44:20.410753    6004 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7b0163d4_e0d9_4ab4_a6fd_f2993a8d36af.slice/crio-392088fb47c2aa0229dd9f174c7ab16c6c8b57746ca64ec06d7d8c9bfeb6e952 WatchSource:0}: Error finding container 392088fb47c2aa0229dd9f174c7ab16c6c8b57746ca64ec06d7d8c9bfeb6e952: Status 404 returned error can't find the container with id 392088fb47c2aa0229dd9f174c7ab16c6c8b57746ca64ec06d7d8c9bfeb6e952
Oct 30 21:44:20.717347 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:44:20.717265    6004 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-authcfg-http-0e8a1a-696975ffbb-bswsn" event={"ID":"7b0163d4-e0d9-4ab4-a6fd-f2993a8d36af","Type":"ContainerStarted","Data":"392088fb47c2aa0229dd9f174c7ab16c6c8b57746ca64ec06d7d8c9bfeb6e952"}
Oct 30 21:44:21.725586 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:44:21.725548    6004 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-authcfg-http-0e8a1a-696975ffbb-bswsn" event={"ID":"7b0163d4-e0d9-4ab4-a6fd-f2993a8d36af","Type":"ContainerStarted","Data":"6befde58a113c0755558101157452b809ec776bc5dcf451a2912df643c1e8484"}
Oct 30 21:44:21.725984 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:44:21.725614    6004 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-authcfg-http-0e8a1a-696975ffbb-bswsn"
Oct 30 21:44:21.853904 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:44:21.853848    6004 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-authcfg-http-0e8a1a-696975ffbb-bswsn" podStartSLOduration=2.067710236 podStartE2EDuration="2.853835246s" totalImagesPullingTime="786.12501ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:44:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:44:21.853208584 +0000 UTC m=+3967.772994702" watchObservedRunningTime="2026-10-30 21:44:21.853835246 +0000 UTC m=+3967.773621364"
Oct 30 21:44:27.737534 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:44:27.737450    6004 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-authcfg-http-0e8a1a-696975ffbb-bswsn"
Oct 30 21:44:44.285945 ip-10-0-138-85 kubenswrapper[6004]: E1030 21:44:44.285900    6004 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-zz4wr" containerName="extractor"
Oct 30 21:45:14.285480 ip-10-0-138-85 kubenswrapper[6004]: E1030 21:45:14.285443    6004 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-zz4wr" containerName="extractor"
Oct 30 21:45:44.285232 ip-10-0-138-85 kubenswrapper[6004]: E1030 21:45:44.285190    6004 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-zz4wr" containerName="extractor"
Oct 30 21:46:14.285643 ip-10-0-138-85 kubenswrapper[6004]: E1030 21:46:14.285600    6004 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-zz4wr" containerName="extractor"
Oct 30 21:46:20.745154 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:46:20.745117    6004 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-authcfg-http-0e8a1a-696975ffbb-bswsn"]
Oct 30 21:46:20.745745 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:46:20.745329    6004 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-authcfg-http-0e8a1a-696975ffbb-bswsn" podUID="7b0163d4-e0d9-4ab4-a6fd-f2993a8d36af" containerName="maas-api" containerID="cri-o://6befde58a113c0755558101157452b809ec776bc5dcf451a2912df643c1e8484" gracePeriod=30
Oct 30 21:46:21.009441 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:46:21.009380    6004 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-authcfg-http-0e8a1a-696975ffbb-bswsn"
Oct 30 21:46:21.141013 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:46:21.140967    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/7b0163d4-e0d9-4ab4-a6fd-f2993a8d36af-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7b0163d4-e0d9-4ab4-a6fd-f2993a8d36af-openshift-service-ca\") pod \"7b0163d4-e0d9-4ab4-a6fd-f2993a8d36af\" (UID: \"7b0163d4-e0d9-4ab4-a6fd-f2993a8d36af\") "
Oct 30 21:46:21.141221 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:46:21.141029    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/7b0163d4-e0d9-4ab4-a6fd-f2993a8d36af-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7b0163d4-e0d9-4ab4-a6fd-f2993a8d36af-maas-api-tls\") pod \"7b0163d4-e0d9-4ab4-a6fd-f2993a8d36af\" (UID: \"7b0163d4-e0d9-4ab4-a6fd-f2993a8d36af\") "
Oct 30 21:46:21.141221 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:46:21.141104    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/7b0163d4-e0d9-4ab4-a6fd-f2993a8d36af-kube-api-access-4kl8m\" (UniqueName: \"kubernetes.io/projected/7b0163d4-e0d9-4ab4-a6fd-f2993a8d36af-kube-api-access-4kl8m\") pod \"7b0163d4-e0d9-4ab4-a6fd-f2993a8d36af\" (UID: \"7b0163d4-e0d9-4ab4-a6fd-f2993a8d36af\") "
Oct 30 21:46:21.141357 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:46:21.141242    6004 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/7b0163d4-e0d9-4ab4-a6fd-f2993a8d36af-metrics-certs\" (UniqueName: \"kubernetes.io/secret/7b0163d4-e0d9-4ab4-a6fd-f2993a8d36af-metrics-certs\") pod \"7b0163d4-e0d9-4ab4-a6fd-f2993a8d36af\" (UID: \"7b0163d4-e0d9-4ab4-a6fd-f2993a8d36af\") "
Oct 30 21:46:21.141809 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:46:21.141415    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7b0163d4-e0d9-4ab4-a6fd-f2993a8d36af-openshift-service-ca" pod "7b0163d4-e0d9-4ab4-a6fd-f2993a8d36af" (UID: "7b0163d4-e0d9-4ab4-a6fd-f2993a8d36af"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:46:21.141809 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:46:21.141586    6004 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7b0163d4-e0d9-4ab4-a6fd-f2993a8d36af-openshift-service-ca\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:46:21.144372 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:46:21.144333    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7b0163d4-e0d9-4ab4-a6fd-f2993a8d36af-kube-api-access-4kl8m" pod "7b0163d4-e0d9-4ab4-a6fd-f2993a8d36af" (UID: "7b0163d4-e0d9-4ab4-a6fd-f2993a8d36af"). InnerVolumeSpecName "kube-api-access-4kl8m". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:46:21.144501 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:46:21.144429    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7b0163d4-e0d9-4ab4-a6fd-f2993a8d36af-metrics-certs" pod "7b0163d4-e0d9-4ab4-a6fd-f2993a8d36af" (UID: "7b0163d4-e0d9-4ab4-a6fd-f2993a8d36af"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:46:21.144611 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:46:21.144577    6004 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7b0163d4-e0d9-4ab4-a6fd-f2993a8d36af-maas-api-tls" pod "7b0163d4-e0d9-4ab4-a6fd-f2993a8d36af" (UID: "7b0163d4-e0d9-4ab4-a6fd-f2993a8d36af"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:46:21.242951 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:46:21.242912    6004 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4kl8m\" (UniqueName: \"kubernetes.io/projected/7b0163d4-e0d9-4ab4-a6fd-f2993a8d36af-kube-api-access-4kl8m\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:46:21.242951 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:46:21.242948    6004 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7b0163d4-e0d9-4ab4-a6fd-f2993a8d36af-metrics-certs\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:46:21.243189 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:46:21.242964    6004 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7b0163d4-e0d9-4ab4-a6fd-f2993a8d36af-maas-api-tls\") on node \"ip-10-0-138-85.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:46:21.336810 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:46:21.336719    6004 generic.go:356] "Generic (PLEG): container finished" podID="7b0163d4-e0d9-4ab4-a6fd-f2993a8d36af" containerID="6befde58a113c0755558101157452b809ec776bc5dcf451a2912df643c1e8484" exitCode=0
Oct 30 21:46:21.336810 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:46:21.336769    6004 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-authcfg-http-0e8a1a-696975ffbb-bswsn"
Oct 30 21:46:21.336995 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:46:21.336802    6004 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-authcfg-http-0e8a1a-696975ffbb-bswsn" event={"ID":"7b0163d4-e0d9-4ab4-a6fd-f2993a8d36af","Type":"ContainerDied","Data":"6befde58a113c0755558101157452b809ec776bc5dcf451a2912df643c1e8484"}
Oct 30 21:46:21.336995 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:46:21.336857    6004 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-authcfg-http-0e8a1a-696975ffbb-bswsn" event={"ID":"7b0163d4-e0d9-4ab4-a6fd-f2993a8d36af","Type":"ContainerDied","Data":"392088fb47c2aa0229dd9f174c7ab16c6c8b57746ca64ec06d7d8c9bfeb6e952"}
Oct 30 21:46:21.336995 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:46:21.336879    6004 scope.go:122] "RemoveContainer" containerID="6befde58a113c0755558101157452b809ec776bc5dcf451a2912df643c1e8484"
Oct 30 21:46:21.347291 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:46:21.347274    6004 scope.go:122] "RemoveContainer" containerID="6befde58a113c0755558101157452b809ec776bc5dcf451a2912df643c1e8484"
Oct 30 21:46:21.347554 ip-10-0-138-85 kubenswrapper[6004]: E1030 21:46:21.347531    6004 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6befde58a113c0755558101157452b809ec776bc5dcf451a2912df643c1e8484\": container with ID starting with 6befde58a113c0755558101157452b809ec776bc5dcf451a2912df643c1e8484 not found: ID does not exist" containerID="6befde58a113c0755558101157452b809ec776bc5dcf451a2912df643c1e8484"
Oct 30 21:46:21.347642 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:46:21.347559    6004 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6befde58a113c0755558101157452b809ec776bc5dcf451a2912df643c1e8484"} err="failed to get container status \"6befde58a113c0755558101157452b809ec776bc5dcf451a2912df643c1e8484\": rpc error: code = NotFound desc = could not find container \"6befde58a113c0755558101157452b809ec776bc5dcf451a2912df643c1e8484\": container with ID starting with 6befde58a113c0755558101157452b809ec776bc5dcf451a2912df643c1e8484 not found: ID does not exist"
Oct 30 21:46:21.503715 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:46:21.503678    6004 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-authcfg-http-0e8a1a-696975ffbb-bswsn"]
Oct 30 21:46:21.521508 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:46:21.521474    6004 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-authcfg-http-0e8a1a-696975ffbb-bswsn"]
Oct 30 21:46:22.229760 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:46:22.229727    6004 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="7b0163d4-e0d9-4ab4-a6fd-f2993a8d36af" path="/var/lib/kubelet/pods/7b0163d4-e0d9-4ab4-a6fd-f2993a8d36af/volumes"
Oct 30 21:46:36.123452 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:46:36.123155    6004 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-769df7846c-vnwz7 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.123:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 30 21:46:36.123452 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:46:36.123240    6004 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/maas-default-gateway-openshift-default-769df7846c-vnwz7" podUID="484fe8d9-f020-44dc-a06c-5e294b8370ae" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.123:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:46:44.285947 ip-10-0-138-85 kubenswrapper[6004]: E1030 21:46:44.285911    6004 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-zz4wr" containerName="extractor"
Oct 30 21:47:14.285198 ip-10-0-138-85 kubenswrapper[6004]: E1030 21:47:14.285157    6004 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-zz4wr" containerName="extractor"
Oct 30 21:47:44.285827 ip-10-0-138-85 kubenswrapper[6004]: E1030 21:47:44.285790    6004 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-zz4wr" containerName="extractor"
Oct 30 21:47:56.459881 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:47:56.459849    6004 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-module-controller-manager-7566cf5fc8-4jjs7_53e10898-ebc3-41bf-9335-6e2af9bfab30/manager/0.log"
Oct 30 21:47:56.844143 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:47:56.844064    6004 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-6466c554d8-6rqgs_eb8c513a-bb2a-40d4-8a81-33782f9d6585/manager/0.log"
Oct 30 21:47:58.117748 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:47:58.117721    6004 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_usage-logs-tenancy-proxy-9c5d49bcd-25knx_0544d6f1-ae3f-4a61-ac1c-3876cbff174f/proxy/0.log"
Oct 30 21:47:58.887520 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:47:58.887487    6004 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-6b964d9667-7kwdn_940054e3-e435-4c68-a009-991bf42b5355/maas-api/0.log"
Oct 30 21:48:00.198880 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:48:00.198850    6004 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_postgres-7cdbf6dc44-m2jtb_e5dec31c-f2e1-4d0e-9a92-9d137c715764/postgres/0.log"
Oct 30 21:48:02.191449 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:48:02.191409    6004 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-7b7bb4bc77-bxsjs_4983e813-fc1f-4f21-8566-85bf64283efb/manager/0.log"
Oct 30 21:48:02.417749 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:48:02.417721    6004 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-8557cbdb84-nsfwz_5161191a-b984-4f95-b35e-2c095ec17d15/manager/0.log"
Oct 30 21:48:03.017257 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:48:03.017226    6004 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-678d87766f-bjdgq_ee6a6b41-b28b-4ee5-8d22-97a3aaadc6d8/manager/0.log"
Oct 30 21:48:04.399857 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:48:04.399829    6004 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-649697ffd5cp5d2_36a522ba-4b20-409f-9e05-e74b55595875/istio-proxy/0.log"
Oct 30 21:48:05.421265 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:48:05.421234    6004 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-769df7846c-846s7_a6eb53ac-7fdc-4ad3-9b83-4068cc24066b/istio-proxy/0.log"
Oct 30 21:48:07.062020 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:48:07.061990    6004 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-769df7846c-t9zxd_63f0a1f2-255c-4159-8d3f-6c79a470a2c7/istio-proxy/0.log"
Oct 30 21:48:07.339831 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:48:07.339759    6004 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-769df7846c-vnwz7_484fe8d9-f020-44dc-a06c-5e294b8370ae/istio-proxy/0.log"
Oct 30 21:48:08.596643 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:48:08.596611    6004 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-5b9d6cdd59-4g6mx_cd59fef4-66a5-471b-a8ef-18df25e44d5c/router/0.log"
Oct 30 21:48:14.284906 ip-10-0-138-85 kubenswrapper[6004]: E1030 21:48:14.284871    6004 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-zz4wr" containerName="extractor"
Oct 30 21:48:14.876552 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:48:14.876422    6004 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-sb7ds_90cd3de0-c573-41c2-bf3e-cf0e46a41d50/console-operator/2.log"
Oct 30 21:48:14.882737 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:48:14.882713    6004 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-sb7ds_90cd3de0-c573-41c2-bf3e-cf0e46a41d50/console-operator/2.log"
Oct 30 21:48:22.024265 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:48:22.024225    6004 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-module-controller-manager-7566cf5fc8-4jjs7_53e10898-ebc3-41bf-9335-6e2af9bfab30/manager/0.log"
Oct 30 21:48:22.407761 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:48:22.407673    6004 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-6466c554d8-6rqgs_eb8c513a-bb2a-40d4-8a81-33782f9d6585/manager/0.log"
Oct 30 21:48:23.643965 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:48:23.643927    6004 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_usage-logs-tenancy-proxy-9c5d49bcd-25knx_0544d6f1-ae3f-4a61-ac1c-3876cbff174f/proxy/0.log"
Oct 30 21:48:24.255491 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:48:24.255452    6004 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-6b964d9667-7kwdn_940054e3-e435-4c68-a009-991bf42b5355/maas-api/0.log"
Oct 30 21:48:25.516155 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:48:25.516124    6004 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_postgres-7cdbf6dc44-m2jtb_e5dec31c-f2e1-4d0e-9a92-9d137c715764/postgres/0.log"
Oct 30 21:48:27.206223 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:48:27.206194    6004 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-7b7bb4bc77-bxsjs_4983e813-fc1f-4f21-8566-85bf64283efb/manager/0.log"
Oct 30 21:48:27.533895 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:48:27.533811    6004 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-8557cbdb84-nsfwz_5161191a-b984-4f95-b35e-2c095ec17d15/manager/0.log"
Oct 30 21:48:27.991817 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:48:27.991774    6004 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-678d87766f-bjdgq_ee6a6b41-b28b-4ee5-8d22-97a3aaadc6d8/manager/0.log"
Oct 30 21:48:29.342640 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:48:29.342611    6004 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-649697ffd5cp5d2_36a522ba-4b20-409f-9e05-e74b55595875/istio-proxy/0.log"
Oct 30 21:48:30.350445 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:48:30.350408    6004 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-769df7846c-846s7_a6eb53ac-7fdc-4ad3-9b83-4068cc24066b/istio-proxy/0.log"
Oct 30 21:48:32.016399 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:48:32.016365    6004 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-769df7846c-t9zxd_63f0a1f2-255c-4159-8d3f-6c79a470a2c7/istio-proxy/0.log"
Oct 30 21:48:32.299495 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:48:32.299412    6004 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-769df7846c-vnwz7_484fe8d9-f020-44dc-a06c-5e294b8370ae/istio-proxy/0.log"
Oct 30 21:48:33.510103 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:48:33.510074    6004 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-5b9d6cdd59-4g6mx_cd59fef4-66a5-471b-a8ef-18df25e44d5c/router/0.log"
Oct 30 21:48:44.285803 ip-10-0-138-85 kubenswrapper[6004]: E1030 21:48:44.285764    6004 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-zz4wr" containerName="extractor"
Oct 30 21:49:14.286088 ip-10-0-138-85 kubenswrapper[6004]: E1030 21:49:14.286035    6004 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-zz4wr" containerName="extractor"
Oct 30 21:49:44.286007 ip-10-0-138-85 kubenswrapper[6004]: E1030 21:49:44.285969    6004 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-zz4wr" containerName="extractor"
Oct 30 21:49:53.438963 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:49:53.438928    6004 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-tvvd9_a4cdc725-3dd0-4917-b8a0-c8ff77a40abb/global-pull-secret-syncer/0.log"
Oct 30 21:49:54.626099 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:49:54.625994    6004 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kas-connection-checker-685895c7c9-tpsd4_db64c15b-58b0-4829-b702-de7b6c846ab4/connection-checker/0.log"
Oct 30 21:49:55.052124 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:49:55.052092    6004 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kas-connection-checker-685895c7c9-tvmvh_f1a05736-0bc6-4914-981e-5524121561e4/connection-checker/0.log"
Oct 30 21:49:55.467210 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:49:55.467179    6004 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kas-connection-checker-685895c7c9-x8fpd_793cb601-841f-4511-9b8f-ff30262611c2/connection-checker/0.log"
Oct 30 21:49:56.760003 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:49:56.759953    6004 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-x6f58_ef128f2b-0a66-4c2d-a969-6197e0f82c58/konnectivity-agent/0.log"
Oct 30 21:49:58.142294 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:49:58.142252    6004 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-138-85.us-west-1.compute.internal_9d0b6e5dd2bbef8c0c7895485f0fdbd3/haproxy/0.log"
Oct 30 21:50:03.415333 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:50:03.415293    6004 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-7b7bb4bc77-bxsjs_4983e813-fc1f-4f21-8566-85bf64283efb/manager/0.log"
Oct 30 21:50:03.550019 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:50:03.549982    6004 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-must-gather-8xd6d/perf-node-gather-daemonset-wkdzb"]
Oct 30 21:50:03.550425 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:50:03.550410    6004 cpu_manager.go:414] "containerMap: removing container" podUID="7b0163d4-e0d9-4ab4-a6fd-f2993a8d36af" containerName="maas-api"
Oct 30 21:50:03.550469 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:50:03.550426    6004 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="7b0163d4-e0d9-4ab4-a6fd-f2993a8d36af" containerName="maas-api"
Oct 30 21:50:03.550515 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:50:03.550507    6004 memory_manager.go:365] "RemoveStaleState removing state" podUID="7b0163d4-e0d9-4ab4-a6fd-f2993a8d36af" containerName="maas-api"
Oct 30 21:50:03.553592 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:50:03.553576    6004 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-8xd6d/perf-node-gather-daemonset-wkdzb"
Oct 30 21:50:03.606406 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:50:03.606378    6004 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-8xd6d\"/\"kube-root-ca.crt\""
Oct 30 21:50:03.606406 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:50:03.606378    6004 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-8xd6d\"/\"openshift-service-ca.crt\""
Oct 30 21:50:03.606610 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:50:03.606470    6004 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-8xd6d\"/\"default-dockercfg-hwbdz\""
Oct 30 21:50:03.606610 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:50:03.606557    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6fkhr\" (UniqueName: \"kubernetes.io/projected/9d81dfe4-cb60-45f5-972e-ccb2beb4cbfc-kube-api-access-6fkhr\") pod \"perf-node-gather-daemonset-wkdzb\" (UID: \"9d81dfe4-cb60-45f5-972e-ccb2beb4cbfc\") " pod="openshift-must-gather-8xd6d/perf-node-gather-daemonset-wkdzb"
Oct 30 21:50:03.606610 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:50:03.606583    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/9d81dfe4-cb60-45f5-972e-ccb2beb4cbfc-lib-modules\") pod \"perf-node-gather-daemonset-wkdzb\" (UID: \"9d81dfe4-cb60-45f5-972e-ccb2beb4cbfc\") " pod="openshift-must-gather-8xd6d/perf-node-gather-daemonset-wkdzb"
Oct 30 21:50:03.606757 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:50:03.606613    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/9d81dfe4-cb60-45f5-972e-ccb2beb4cbfc-proc\") pod \"perf-node-gather-daemonset-wkdzb\" (UID: \"9d81dfe4-cb60-45f5-972e-ccb2beb4cbfc\") " pod="openshift-must-gather-8xd6d/perf-node-gather-daemonset-wkdzb"
Oct 30 21:50:03.606839 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:50:03.606806    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9d81dfe4-cb60-45f5-972e-ccb2beb4cbfc-sys\") pod \"perf-node-gather-daemonset-wkdzb\" (UID: \"9d81dfe4-cb60-45f5-972e-ccb2beb4cbfc\") " pod="openshift-must-gather-8xd6d/perf-node-gather-daemonset-wkdzb"
Oct 30 21:50:03.606908 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:50:03.606860    6004 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/9d81dfe4-cb60-45f5-972e-ccb2beb4cbfc-podres\") pod \"perf-node-gather-daemonset-wkdzb\" (UID: \"9d81dfe4-cb60-45f5-972e-ccb2beb4cbfc\") " pod="openshift-must-gather-8xd6d/perf-node-gather-daemonset-wkdzb"
Oct 30 21:50:03.658724 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:50:03.658696    6004 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-8xd6d/perf-node-gather-daemonset-wkdzb"]
Oct 30 21:50:03.707938 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:50:03.707906    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/9d81dfe4-cb60-45f5-972e-ccb2beb4cbfc-podres\") pod \"perf-node-gather-daemonset-wkdzb\" (UID: \"9d81dfe4-cb60-45f5-972e-ccb2beb4cbfc\") " pod="openshift-must-gather-8xd6d/perf-node-gather-daemonset-wkdzb"
Oct 30 21:50:03.708142 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:50:03.708006    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6fkhr\" (UniqueName: \"kubernetes.io/projected/9d81dfe4-cb60-45f5-972e-ccb2beb4cbfc-kube-api-access-6fkhr\") pod \"perf-node-gather-daemonset-wkdzb\" (UID: \"9d81dfe4-cb60-45f5-972e-ccb2beb4cbfc\") " pod="openshift-must-gather-8xd6d/perf-node-gather-daemonset-wkdzb"
Oct 30 21:50:03.708142 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:50:03.708032    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/9d81dfe4-cb60-45f5-972e-ccb2beb4cbfc-podres\") pod \"perf-node-gather-daemonset-wkdzb\" (UID: \"9d81dfe4-cb60-45f5-972e-ccb2beb4cbfc\") " pod="openshift-must-gather-8xd6d/perf-node-gather-daemonset-wkdzb"
Oct 30 21:50:03.708142 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:50:03.708041    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/9d81dfe4-cb60-45f5-972e-ccb2beb4cbfc-lib-modules\") pod \"perf-node-gather-daemonset-wkdzb\" (UID: \"9d81dfe4-cb60-45f5-972e-ccb2beb4cbfc\") " pod="openshift-must-gather-8xd6d/perf-node-gather-daemonset-wkdzb"
Oct 30 21:50:03.708142 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:50:03.708114    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/9d81dfe4-cb60-45f5-972e-ccb2beb4cbfc-proc\") pod \"perf-node-gather-daemonset-wkdzb\" (UID: \"9d81dfe4-cb60-45f5-972e-ccb2beb4cbfc\") " pod="openshift-must-gather-8xd6d/perf-node-gather-daemonset-wkdzb"
Oct 30 21:50:03.708352 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:50:03.708172    6004 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9d81dfe4-cb60-45f5-972e-ccb2beb4cbfc-sys\") pod \"perf-node-gather-daemonset-wkdzb\" (UID: \"9d81dfe4-cb60-45f5-972e-ccb2beb4cbfc\") " pod="openshift-must-gather-8xd6d/perf-node-gather-daemonset-wkdzb"
Oct 30 21:50:03.708352 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:50:03.708198    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/9d81dfe4-cb60-45f5-972e-ccb2beb4cbfc-lib-modules\") pod \"perf-node-gather-daemonset-wkdzb\" (UID: \"9d81dfe4-cb60-45f5-972e-ccb2beb4cbfc\") " pod="openshift-must-gather-8xd6d/perf-node-gather-daemonset-wkdzb"
Oct 30 21:50:03.708352 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:50:03.708238    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/9d81dfe4-cb60-45f5-972e-ccb2beb4cbfc-proc\") pod \"perf-node-gather-daemonset-wkdzb\" (UID: \"9d81dfe4-cb60-45f5-972e-ccb2beb4cbfc\") " pod="openshift-must-gather-8xd6d/perf-node-gather-daemonset-wkdzb"
Oct 30 21:50:03.708352 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:50:03.708263    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9d81dfe4-cb60-45f5-972e-ccb2beb4cbfc-sys\") pod \"perf-node-gather-daemonset-wkdzb\" (UID: \"9d81dfe4-cb60-45f5-972e-ccb2beb4cbfc\") " pod="openshift-must-gather-8xd6d/perf-node-gather-daemonset-wkdzb"
Oct 30 21:50:03.767661 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:50:03.767628    6004 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6fkhr\" (UniqueName: \"kubernetes.io/projected/9d81dfe4-cb60-45f5-972e-ccb2beb4cbfc-kube-api-access-6fkhr\") pod \"perf-node-gather-daemonset-wkdzb\" (UID: \"9d81dfe4-cb60-45f5-972e-ccb2beb4cbfc\") " pod="openshift-must-gather-8xd6d/perf-node-gather-daemonset-wkdzb"
Oct 30 21:50:03.832485 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:50:03.832445    6004 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-8557cbdb84-nsfwz_5161191a-b984-4f95-b35e-2c095ec17d15/manager/0.log"
Oct 30 21:50:03.866210 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:50:03.866185    6004 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-8xd6d/perf-node-gather-daemonset-wkdzb"
Oct 30 21:50:04.234939 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:50:04.234917    6004 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-8xd6d/perf-node-gather-daemonset-wkdzb"]
Oct 30 21:50:04.236538 ip-10-0-138-85 kubenswrapper[6004]: W1030 21:50:04.236502    6004 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod9d81dfe4_cb60_45f5_972e_ccb2beb4cbfc.slice/crio-5dc8ea594ecf3f434ca7595417549975b987089de9a35b57b84f0ee86a4ecc92 WatchSource:0}: Error finding container 5dc8ea594ecf3f434ca7595417549975b987089de9a35b57b84f0ee86a4ecc92: Status 404 returned error can't find the container with id 5dc8ea594ecf3f434ca7595417549975b987089de9a35b57b84f0ee86a4ecc92
Oct 30 21:50:04.519653 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:50:04.519567    6004 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-8xd6d/perf-node-gather-daemonset-wkdzb" event={"ID":"9d81dfe4-cb60-45f5-972e-ccb2beb4cbfc","Type":"ContainerStarted","Data":"f6fccdfb2c8ed95836bd594b8ae319243e7acec9d6b737170d0b7bb646fd4004"}
Oct 30 21:50:04.519653 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:50:04.519617    6004 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-8xd6d/perf-node-gather-daemonset-wkdzb" event={"ID":"9d81dfe4-cb60-45f5-972e-ccb2beb4cbfc","Type":"ContainerStarted","Data":"5dc8ea594ecf3f434ca7595417549975b987089de9a35b57b84f0ee86a4ecc92"}
Oct 30 21:50:04.520042 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:50:04.519655    6004 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-8xd6d/perf-node-gather-daemonset-wkdzb"
Oct 30 21:50:04.633863 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:50:04.633811    6004 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-must-gather-8xd6d/perf-node-gather-daemonset-wkdzb" podStartSLOduration=1.6337967180000001 podStartE2EDuration="1.633796718s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 21:50:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:50:04.633771068 +0000 UTC m=+4310.553557185" watchObservedRunningTime="2026-10-30 21:50:04.633796718 +0000 UTC m=+4310.553582835"
Oct 30 21:50:04.719838 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:50:04.719806    6004 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-678d87766f-bjdgq_ee6a6b41-b28b-4ee5-8d22-97a3aaadc6d8/manager/0.log"
Oct 30 21:50:10.535827 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:50:10.535795    6004 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-8xd6d/perf-node-gather-daemonset-wkdzb"
Oct 30 21:50:11.255944 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:50:11.255914    6004 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-884576c57-fl7nf_d1fd1b0a-3831-4cb8-b6f3-ad2e67685188/cluster-monitoring-operator/0.log"
Oct 30 21:50:14.285505 ip-10-0-138-85 kubenswrapper[6004]: E1030 21:50:14.285468    6004 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-zz4wr" containerName="extractor"
Oct 30 21:50:16.348526 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:50:16.348497    6004 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-t4s4p_18d56389-8b1b-45d7-ac47-cd2b6c19c5dd/node-exporter/0.log"
Oct 30 21:50:16.759529 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:50:16.759499    6004 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-t4s4p_18d56389-8b1b-45d7-ac47-cd2b6c19c5dd/kube-rbac-proxy/0.log"
Oct 30 21:50:17.210942 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:50:17.210909    6004 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-t4s4p_18d56389-8b1b-45d7-ac47-cd2b6c19c5dd/init-textfile/0.log"
Oct 30 21:50:22.619810 ip-10-0-138-85 kubenswrapper[6004]: I1030 21:50:22.619780    6004 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-6489d8bf89-fqdw6_708a2c3c-e061-4bb1-b9ff-48f111b08943/prometheus-operator-admission-webhook/0.log"